open_llama_13b_8k / added_tokens.json
Asif Ahmad
Upload added_tokens.json with huggingface_hub
5759ff6
raw
history blame
151 Bytes
{
"<pad>": 32000,
"<|assistant|>": 32001,
"<|prefix_begin|>": 32004,
"<|prefix_end|>": 32002,
"<|prompter|>": 32005,
"<|system|>": 32003
}