Commit
•
4a240a5
1
Parent(s):
5e99eca
Update README.md
Browse files
README.md
CHANGED
|
@@ -8,4 +8,4 @@ base_model:
|
|
| 8 |
- PKU-Alignment/alpaca-7b-reproduced
|
| 9 |
---
|
| 10 |
|
| 11 |
-
This model is for the reproduction of results of paper "The crucial role of samplers in online direct preference optimization". You can download it and save it as "models/rlhflow_iter1", and then start the training pipeline.
|
|
|
|
| 8 |
- PKU-Alignment/alpaca-7b-reproduced
|
| 9 |
---
|
| 10 |
|
| 11 |
+
This model is for the reproduction of results on Safe-RLHF dataset of paper "The crucial role of samplers in online direct preference optimization". You can download it and save it as "models/rlhflow_iter1", and then start the training pipeline. Since we've retrained the models, the results may slightly differ from that reported in the paper, and we will update it later.
|