Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
alvarobartt
/
Mistral-7B-v0.1-ORPO
like
14
Text Generation
Transformers
TensorBoard
Safetensors
alvarobartt/dpo-mix-7k-simplified
argilla/dpo-mix-7k
English
mistral
orpo
qlora
trl
conversational
text-generation-inference
arxiv:
2403.07691
License:
apache-2.0
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Deploy
Use this model
f4b8032
Mistral-7B-v0.1-ORPO
File size: 51 Bytes
21038f9
1
2
3
4
5
{
"<|im_end|>"
:
32001
,
"<|im_start|>"
:
32000
}