Clean tokenizer_config.json
#16
by
skwon
- opened
Remove reference to ArthurZ's local directory. It might be better to set "special_tokens_map_file" to null and delete special_tokens_map.json, since the special tokens are already included via "additional_special_tokens".