leddoc-wikiauto / added_tokens.json
janbakker's picture
Upload tokenizer
e14f3cb verified
raw
history blame contribute delete
181 Bytes
{
"<COPY>": 50270,
"<DELETE>": 50273,
"<REPHRASE>": 50271,
"<RL_0>": 50265,
"<RL_1>": 50266,
"<RL_2>": 50267,
"<RL_3>": 50268,
"<RL_4>": 50269,
"<SPLIT>": 50272
}