BUT-FIT
/

DeCRED_uni5000_normalized_tokenizer

Inference Endpoints

Model card Files Files and versions Community

DeCRED_uni5000_normalized_tokenizer / special_tokens_map.json

Lakoc's picture

Upload tokenizer

1584050 verified about 1 month ago

history blame contribute delete

135 Bytes

	{
	"bos_token": "([bos])",
	"eos_token": "([eos])",
	"mask_token": "([mask])",
	"pad_token": "([pad])",
	"unk_token": "([unk])"
	}