Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
NorHsangPha
/
shan_bpe_tokenizer
like
0
Transformers
Shan
Inference Endpoints
License:
cc
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
739bd58
shan_bpe_tokenizer
1 contributor
History:
2 commits
NorHsangPha
Upload tokenizer
739bd58
verified
10 months ago
.gitattributes
Safe
1.52 kB
initial commit
10 months ago
README.md
Safe
5.18 kB
Upload tokenizer
10 months ago
merges.txt
Safe
256 kB
Upload tokenizer
10 months ago
special_tokens_map.json
Safe
99 Bytes
Upload tokenizer
10 months ago
tokenizer.json
Safe
1.1 MB
Upload tokenizer
10 months ago
tokenizer_config.json
Safe
468 Bytes
Upload tokenizer
10 months ago
vocab.json
Safe
420 kB
Upload tokenizer
10 months ago
