Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
silviasapora
/
mistral-7b-orpo-noisy-v2
like
0
Text Generation
Transformers
TensorBoard
Safetensors
silviasapora/dpo_7k_noisy_10
mistral
Generated from Trainer
alignment-handbook
trl
orpo
conversational
text-generation-inference
Inference Endpoints
arxiv:
2403.07691
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Deploy
Use this model
869f06e
mistral-7b-orpo-noisy-v2
/
tokenizer.json
silviasapora
Training in progress, step 315
1662d10
verified
11 days ago
raw
Copy download link
history
Safe
3.67 MB
File too large to display, you can
check the raw version
instead.