Clean tokenizer_config.json

#16
by skwon - opened

Remove reference to ArthurZ's local directory. It might be better to set "special_tokens_map_file" to null and delete special_tokens_map.json, since the special tokens are already included via "additional_special_tokens".

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment