Text Generation
GGUF
English
gpt_oss
gpt-oss
openai
mxfp4
programming
code generation
code
coding
coder
chat
reasoning
thinking
r1
cot
deepseek
128k context
general usage
problem solving
brainstorming
solve riddles
uncensored
abliterated
Neo
MOE
Mixture of Experts
24 experts
NEO Imatrix
Imatrix
DI-Matrix
Tri-Matrix
imatrix
conversational
IQ4_NL Model not generating output
#10
by
atinesh
- opened
I downloaded the IQ4_NL model in Ollama v0.11.10 on my PC, but it is not generating any output. I used the following command to download and run the model:
ollama run hf.co/DavidAU/OpenAi-GPT-oss-20b-abliterated-uncensored-NEO-Imatrix-gguf:IQ4_NL
System Specs:
- CPU: Intel Core i5 9400f
- GPU: Nvidia RTX 2060 Super
8GB - System memory:
32GB
Hey;
Ollama may be having issues with these quants ; try in Lmstudio, Jan, Koboldcpp etc etc.
All quants were tested.
Hey;
Ollama may be having issues with these quants ; try in Lmstudio, Jan, Koboldcpp etc etc.
All quants were tested.
Hi DavidAU, thanks for the info, it works fine on KoboldCpp not sure why its not working in Ollama
atinesh
changed discussion status to
closed