missing pre-tokenizer type / quality will be degraded (improper configuration?)
#2
by
Nazosan
- opened
Upon initial loading I see this warning:
llm_load_vocab:
llm_load_vocab: ************************************
llm_load_vocab: GENERATION QUALITY WILL BE DEGRADED!
llm_load_vocab: CONSIDER REGENERATING THE MODEL
llm_load_vocab: ************************************```
It seems to actually come from even the initial GGUF conversion, so maybe the original model was misconfigured/converted wrong?