BanglaGPT_512 / added_tokens.json
shahidul034's picture
Upload tokenizer
3ce75cc verified
raw
history blame contribute delete
47 Bytes
{
"<|endoftext|>": 50000,
"[UNK]": 50001
}