Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ArabovMK
/
tajik-tokenizers-v1
like
0
Tajik
tajik
tokenizer
central-asia
nlp
linguistics
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
main
tajik-tokenizers-v1
7.91 MB
1 contributor
History:
10 commits
ArabovMK
Update README.md
506ac9d
verified
6 months ago
.gitattributes
Safe
1.52 kB
initial commit
6 months ago
README.md
2.38 kB
Update README.md
6 months ago
tajik_bpe.json
Safe
2.41 MB
Upload tajik_bpe.json with huggingface_hub
6 months ago
tajik_sp_bpe.model
926 kB
xet
Upload tajik_sp_bpe.model with huggingface_hub
6 months ago
tajik_sp_bpe.vocab
648 kB
Upload tajik_sp_bpe.vocab with huggingface_hub
6 months ago
tajik_sp_unigram.model
965 kB
xet
Upload tajik_sp_unigram.model with huggingface_hub
6 months ago
tajik_unigram.json
Safe
2.1 MB
Upload tajik_unigram.json with huggingface_hub
6 months ago
tajik_wordpiece.json
Safe
856 kB
Upload tajik_wordpiece.json with huggingface_hub
6 months ago
