Spaces:

xu-song
/

tokenizer-arena

Running

App Files Files Community

tokenizer-arena / vocab /deepseek_coder_33b_instruct

226 Bytes

2 contributors

History: 1 commit

xu-song's picture

add more tokenizers

a1b0cd0 about 2 years ago

__init__.py

226 Bytes

add more tokenizers about 2 years ago