Update README.md
Browse files
README.md
CHANGED
@@ -52,7 +52,7 @@ We have included a [chat template](https://huggingface.co/docs/transformers/main
|
|
52 |
## Intended uses & limitations
|
53 |
|
54 |
The model was initially fine-tuned on a filtered and preprocessed of the [Tulu V2 mix dataset](https://huggingface.co/datasets/allenai/tulu-v2-sft-mixture), which contains a diverse range of human created instructions and synthetic dialogues generated primarily by other LLMs.
|
55 |
-
We then further aligned the model with a [Jax DPO trainer](https://github.com/hamishivi/EasyLM/blob/main/EasyLM/models/llama/llama_train_dpo.py) built on [EasyLM](https://github.com/young-geng/EasyLM) on the
|
56 |
|
57 |
## Bias, Risks, and Limitations
|
58 |
|
|
|
52 |
## Intended uses & limitations
|
53 |
|
54 |
The model was initially fine-tuned on a filtered and preprocessed of the [Tulu V2 mix dataset](https://huggingface.co/datasets/allenai/tulu-v2-sft-mixture), which contains a diverse range of human created instructions and synthetic dialogues generated primarily by other LLMs.
|
55 |
+
We then further aligned the model with a [Jax DPO trainer](https://github.com/hamishivi/EasyLM/blob/main/EasyLM/models/llama/llama_train_dpo.py) built on [EasyLM](https://github.com/young-geng/EasyLM) on the dataset mentioned above.
|
56 |
|
57 |
## Bias, Risks, and Limitations
|
58 |
|