Hugging Face's logo

EleutherAI
/
pythia-410m

Text Generation
Transformers
PyTorch
Safetensors
English
gpt_neox
causal-lm
pythia
text-generation-inference
Inference Endpoints
Model card Files Community
6

Update tokenizer_config.json

#3
by owen-yeung - opened
base: refs/heads/main
←
from: refs/pr/3
Discussion Files changed
+1
-1
owen-yeung

There is no GPTNeoXTokenizer, only GPTNeoXTokenizerFast it seems
See https://github.com/huggingface/transformers/issues/17756

Update tokenizer_config.json6b69a5b8
Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment