Hugging Face's logo

heyholetsgo
/
Nous-Hermes-2-Mistral-7B-DPO-AWQ

Text Generation
Transformers
Safetensors
English
mistral
Mistral
instruct
finetune
chatml
DPO
RLHF
gpt4
synthetic data
distillation
awq
conversational
text-generation-inference
Inference Endpoints
4-bit precision
Model card Files Community
2
Nous-Hermes-2-Mistral-7B-DPO-AWQ / quant_config.json

Commit History

Add missing quant_config.json for compatibility with vLLM backends out of the box.
2a52ed5
verified

vaclavkosar commited on