pietrolesci
/

raw_tokenisers

Model card Files Files and versions Community

raw_tokenisers / bpe_minipile_2024-10-11T11-23-27 /metadata.yaml

pietrolesci's picture

Upload folder using huggingface_hub

72714a5 verified 5 days ago

history blame contribute delete

66 Bytes

	max_vocab_size: 320000
	num_docs: 1000000
	eos_token: <\|endoftext\|>