gpt2_wikitext-2-raw-v1_L2-H4-E256-C256 / special_tokens_map.json
pietrolesci's picture
Upload tokenizer
a768e2f
raw
history blame contribute delete
99 Bytes
{
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"pad_token": "<|endoftext|>"
}