punctuation_fa_parsbert / added_tokens.json
AliHF2020's picture
Upload tokenizer
c4ab01c
raw
history blame
74 Bytes
{
"[CLS]": 2,
"[MASK]": 3,
"[PAD]": 0,
"[SEP]": 4,
"[UNK]": 1
}