ybelkada
/

japanese-dummy-tokenizer

Inference Endpoints

Model card Files Files and versions Community

japanese-dummy-tokenizer / special_tokens_map.json

Younes Belkada

move old files

cb780b5 almost 3 years ago

history blame contribute delete

65 Bytes

{"eos_token": "</s>", "unk_token": "<unk>", "pad_token": "<pad>"}