llamalized-midm-tokenizer / added_tokens.json
madatnlp's picture
Upload tokenizer
4a80417
raw
history blame
21 Bytes
{
"<pad>": 72154
}