NHTV2 / added_tokens.json
madhaviit's picture
Upload tokenizer
8b760b7
raw
history blame contribute delete
51 Bytes
{
"<|im_end|>": 32000,
"<|im_start|>": 32001
}