law-glm-10b / added_tokens.json
law-llm's picture
Upload tokenizer
b0ce0a4
raw
history blame
224 Bytes
{
"<|endofpiece|>": 50007,
"<|endoftext|>": 50000,
"<|startofpiece|>": 50006,
"[CLS]": 50002,
"[MASK]": 50003,
"[SEP]": 50001,
"[UNUSED1]": 50004,
"[UNUSED2]": 50005,
"[gMASK]": 50009,
"[sMASK]": 50008
}