xlsr-nm-nomi / added_tokens.json
susmitabhatt's picture
Upload tokenizer
a9a4072 verified
raw
history blame contribute delete
30 Bytes
{
"</s>": 29,
"<s>": 28
}