metadata
base_model: base_model
datasets: dataset_name
library_name: transformers
model_name: online-dpo-qwen2-2
tags:
- trl
- online-dpo
- generated_from_trainer
- peft
licence: license
Model Card for online-dpo-qwen2-2
This model is a fine-tuned version of Qwen/Qwen2-0.5B-Instruct on the https://huggingface.co/datasets/trl-lib/ultrafeedback-prompt dataset.