missing tokenizer.json
#1
by
Suparious
- opened
the tokenizer.json is used by inference engines to determine the prompt template and other things.
Without providing, the tokenizer configuration, this model doe not work well in inference engines, such as TGI, vLLM and ollama.
Without this file, I cannot make any quantized versions of this model in: https://huggingface.co/solidrust