Hugging Face's logo

NousResearch
/
Nous-Hermes-2-Mixtral-8x7B-DPO

Text Generation
Transformers
Safetensors
English
mixtral
Mixtral
instruct
finetune
chatml
DPO
RLHF
gpt4
synthetic data
distillation
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
13
New discussion

Non-English languages in fine-tuning data?
#13 opened 4 months ago by lisabecker

[AUTOMATED] Model Memory Requirements

1
#12 opened 8 months ago by model-sizer-bot

Amazon Sagemaker deployment

3
#11 opened 8 months ago by jdmiwx

Adding Evaluation Results
#10 opened 9 months ago by leaderboard-pr-bot

No responses

4
#9 opened 9 months ago by emilios

Request: DOI

1
#7 opened 9 months ago by paulgavrikov

Training Hyperparameters
#6 opened 9 months ago by qiying

set `add_special_tokens=True` when using the model with a "text-generation" pipeline
#5 opened 10 months ago by dcfidalgo

Is the SFT phase a full finetune or a lora?

3
#3 opened 10 months ago by dividebythree

Endless response

2
#1 opened 10 months ago by alexfilus