AllyAI / onnx /special_tokens_map.json
Rgecode's picture
Upload 15 files
92352d7 verified
raw
history blame contribute delete
104 Bytes
{
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"unk_token": "<|endoftext|>"
}