nekozutranslate_small / added_tokens.json
farihdzaky's picture
Upload tokenizer
5a90304 verified
raw
history blame contribute delete
29 Bytes
{
"<|PAD_TOKEN|>": 49152
}