Hugging Face's logo

TheBloke
/
SauerkrautLM-Mixtral-8x7B-Instruct-AWQ

Text Generation
Transformers
Safetensors
mixtral
mistral
finetune
dpo
Instruct
augmentation
german
conversational
text-generation-inference
4-bit precision
awq
Model card Files Community
1
New discussion

AWQ model performs significantly worse than the GPTQ model

1
#1 opened 10 months ago by martinkozle