Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
silviasapora
/
mistral-7b-orpo-noisy-6e-5
like
0
Text Generation
Transformers
TensorBoard
Safetensors
silviasapora/dpo_7k_noisy_10
mistral
Generated from Trainer
alignment-handbook
trl
orpo
conversational
text-generation-inference
Inference Endpoints
arxiv:
2403.07691
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Deploy
Use this model
e19d20c
mistral-7b-orpo-noisy-6e-5
Commit History
Training in progress, step 315
e19d20c
verified
silviasapora
commited on
12 days ago
initial commit
703b425
verified
silviasapora
commited on
12 days ago