vit-rugpt3-medium-tyutchev / added_tokens.json
AnyaSchen's picture
Upload tokenizer
c9d12ca
raw
history blame contribute delete
83 Bytes
{
"<bos>": 50258,
"<eos>": 50259,
"<sep>": 50260,
"<|endoftext|>": 50257
}