samantha-1-tokenizer / added_tokens.json
diwank's picture
Upload tokenizer
2baf777
raw
history blame contribute delete
252 Bytes
{
"<|behavior_anthropoid|>": 32002,
"<|behavior_mechanoid|>": 32003,
"<|im_end|>": 32001,
"<|im_start|>": 32000,
"<|safety_benign|>": 32005,
"<|safety_bold|>": 32006,
"<|safety_conservative|>": 32004,
"<|safety_unrestricted|>": 32007
}