gpt1_original-pretrain_xnli / tokenizer_config.json

Training in progress, step 1000

b5ea109 about 1 year ago

163 Bytes

	{
	"clean_up_tokenization_spaces": true,
	"model_max_length": 512,
	"padding_side": "left",
	"tokenizer_class": "OpenAIGPTTokenizer",
	"unk_token": "<unk>"
	}