zero-shot-vanilla-gpt2 / added_tokens.json
StefanH's picture
add tokenizer
9d65d6a
raw
history blame contribute delete
171 Bytes
{"[ANSW]": 50264, "[eot]": 50265, "[PAD]": 50257, "[TEXT]": 50263, "<|answer|>": 50260, "[QUES]": 50262, "<|text|>": 50259, "<|question|>": 50258, "<|answer_sep|>": 50261}