kobart-base-v2 / tokenizer.json

Commit History

fix unk token issue
4b254b6

haven-jeon commited on

add <unk>
5de4c45

haven-jeon commited on

first commit
a1ac306

haven-jeon commited on