not-lain commited on
Commit
831e62e
โ€ข
1 Parent(s): 77e9297

added tokenizer

Browse files
TunBERT/special_tokens_map.json โ†’ special_tokens_map.json RENAMED
File without changes
TunBERT/tokenizer.json โ†’ tokenizer.json RENAMED
File without changes
TunBERT/tokenizer_config.json โ†’ tokenizer_config.json RENAMED
File without changes
TunBERT/vocab.txt โ†’ vocab.txt RENAMED
File without changes