albert-pt-br / added_tokens.json
josu's picture
add tokenizer
db97e63
raw
history blame contribute delete
65 Bytes
{"[CLS]": 32000, "[SEP]": 32001, "<pad>": 32002, "[MASK]": 32003}