santacoder-finetuned-unit-test / added_tokens.json
AyoubMDL's picture
Upload tokenizer
3c901db
raw
history blame contribute delete
126 Bytes
{
"<fim-middle>": 49154,
"<fim-pad>": 49156,
"<fim-prefix>": 49153,
"<fim-suffix>": 49155,
"<|endoftext|>": 49152
}