Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

oobabooga
/

llama-tokenizer

Model card Files Files and versions Community

llama-tokenizer

2 contributors

History: 2 commits

oobabooga's picture

Upload 4 files

de79a1e over 1 year ago

.gitattributes

1.48 kB

initial commit over 1 year ago
README.md

23 Bytes

initial commit over 1 year ago
special_tokens_map.json

411 Bytes

Upload 4 files over 1 year ago
tokenizer.json

1.84 MB

Upload 4 files over 1 year ago
tokenizer.model

500 kB
LFS

Upload 4 files over 1 year ago
tokenizer_config.json

727 Bytes

Upload 4 files over 1 year ago