smolLM2-article-digestor / added_tokens.json
soumitsr's picture
Upload tokenizer
d776a30 verified
raw
history blame contribute delete
29 Bytes
{
"<|PAD_TOKEN|>": 49152
}