Morton-Li
/

QiTianTokenizer-Medium

Model card Files Files and versions

QiTianTokenizer-Medium

4.76 MB

1 contributor

History: 3 commits

Morton-Li's picture

添加 QiTianTokenizerFast 类及其配置，移除 QiTianTokenizer 类的引用并完善 QiTianTokenizerFast 的配置

f69fb49 1 day ago

.gitattributes

1.52 kB

initial commit 5 days ago
README.md

7.28 kB

Initial commit 5 days ago
chat_template.jinja

292 Bytes

添加 QiTianTokenizerFast 类及其配置，移除 QiTianTokenizer 类的引用并完善 QiTianTokenizerFast 的配置 1 day ago
special_tokens_map.json

674 Bytes

Initial commit 5 days ago
tokenizer.json

4.75 MB

Initial commit 5 days ago
tokenizer.py

202 Bytes

添加 QiTianTokenizerFast 类及其配置，移除 QiTianTokenizer 类的引用并完善 QiTianTokenizerFast 的配置 1 day ago
tokenizer_config.json

1.89 kB

添加 QiTianTokenizerFast 类及其配置，移除 QiTianTokenizer 类的引用并完善 QiTianTokenizerFast 的配置 1 day ago