Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

heilerich
/

llama-tokenizer-fast

Model card Files Files and versions Community

llama-tokenizer-fast

1 contributor

History: 2 commits

heilerich's picture

Upload tokenizer

e16f8e0 over 1 year ago

.gitattributes

1.48 kB

initial commit over 1 year ago
special_tokens_map.json

411 Bytes

Upload tokenizer over 1 year ago
tokenizer.json

1.84 MB

Upload tokenizer over 1 year ago
tokenizer.model

500 kB
LFS

Upload tokenizer over 1 year ago
tokenizer_config.json

727 Bytes

Upload tokenizer over 1 year ago