personachat-arabic / added_tokens.json
system's picture
system HF staff
Update added_tokens.json
cd62b07
raw
history blame
90 Bytes
{"<bos>": 50257, "<eos>": 50258, "<pad>": 50259, "<speaker1>": 50260, "<speaker2>": 50261}