RITA_m / tokenizer_config.json
DanielHesslow's picture
add tokenizer
50fbecb
raw
history blame contribute delete
167 Bytes
{"special_tokens_map_file": "Seledorn/RITA_tokenizer/special_tokens_map.json", "name_or_path": "Seledorn/RITA_tokenizer", "tokenizer_class": "PreTrainedTokenizerFast"}