js-fakes-4bars / tokenizer_config.json
TristanBehrens's picture
add tokenizer
9504e6c
raw
history blame
46 Bytes
{"tokenizer_class": "PreTrainedTokenizerFast"}