flax-community
/

pino-bigbird-roberta-base

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

pino-bigbird-roberta-base / create_pt_tokenizer.py

dat

add pt tokenizer

b439f0a about 3 years ago

No virus

119 Bytes

	from transformers import AutoTokenizer
	tokenizer = AutoTokenizer.from_pretrained("./")
	tokenizer.save_pretrained("./")