Commit
•
32b016f
1
Parent(s):
e44d545
End of training
Browse files
README.md
CHANGED
@@ -28,7 +28,7 @@ print(output["generated_text"][1]["content"])
|
|
28 |
|
29 |
## Training procedure
|
30 |
|
31 |
-
[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/huggingface/huggingface/runs/
|
32 |
|
33 |
This model was trained with XPO, a method introduced in [Exploratory Preference Optimization: Harnessing Implicit Q*-Approximation for Sample-Efficient RLHF](https://huggingface.co/papers/2405.21046).
|
34 |
|
@@ -46,12 +46,11 @@ Cite XPO as:
|
|
46 |
|
47 |
```bibtex
|
48 |
@article{jung2024binary,
|
49 |
-
|
50 |
-
|
51 |
-
|
52 |
-
|
53 |
-
|
54 |
-
|
55 |
```
|
56 |
|
57 |
Cite TRL as:
|
|
|
28 |
|
29 |
## Training procedure
|
30 |
|
31 |
+
[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/huggingface/huggingface/runs/bg6y6mom)
|
32 |
|
33 |
This model was trained with XPO, a method introduced in [Exploratory Preference Optimization: Harnessing Implicit Q*-Approximation for Sample-Efficient RLHF](https://huggingface.co/papers/2405.21046).
|
34 |
|
|
|
46 |
|
47 |
```bibtex
|
48 |
@article{jung2024binary,
|
49 |
+
title = {{Binary Classifier Optimization for Large Language Model Alignment}},
|
50 |
+
author = {Seungjae Jung and Gunsoo Han and Daniel Wontae Nam and Kyoung{-}Woon On},
|
51 |
+
year = 2024,
|
52 |
+
eprint = {arXiv:2404.04656}
|
53 |
+
}
|
|
|
54 |
```
|
55 |
|
56 |
Cite TRL as:
|