qgallouedec
/

Qwen2.5-7B-DPO-main

Text Generation

Generated from Trainer

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

qgallouedec HF staff commited on 20 days ago

Commit

c91bf95

•

1 Parent(s): 662f1e6

End of training

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -1,5 +1,6 @@
 ---
 base_model: Qwen/Qwen2.5-7B-Instruct
 library_name: transformers
 model_name: Qwen2.5-7B-DPO-main
 tags:
@@ -11,7 +12,7 @@ licence: license
 # Model Card for Qwen2.5-7B-DPO-main
-This model is a fine-tuned version of [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct).
 It has been trained using [TRL](https://github.com/huggingface/trl).
 ## Quick start

 ---
 base_model: Qwen/Qwen2.5-7B-Instruct
+datasets: trl-lib/ultrafeedback_binarized
 library_name: transformers
 model_name: Qwen2.5-7B-DPO-main
 tags:
 # Model Card for Qwen2.5-7B-DPO-main
+This model is a fine-tuned version of [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct) on the [trl-lib/ultrafeedback_binarized](https://huggingface.co/datasets/trl-lib/ultrafeedback_binarized) dataset.
 It has been trained using [TRL](https://github.com/huggingface/trl).
 ## Quick start