Update README.md
Browse files
README.md
CHANGED
|
@@ -2,4 +2,13 @@
|
|
| 2 |
license: other
|
| 3 |
license_name: yi-license
|
| 4 |
license_link: LICENSE
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
license: other
|
| 3 |
license_name: yi-license
|
| 4 |
license_link: LICENSE
|
| 5 |
+
tags:
|
| 6 |
+
- finetune
|
| 7 |
+
- fine-tune
|
| 8 |
+
datasets:
|
| 9 |
+
- adamo1139/rawrr_v1
|
| 10 |
---
|
| 11 |
+
|
| 12 |
+
|
| 13 |
+
This model is Yi-34B-200K fine-tuned using DPO on rawrr_v1 dataset using QLoRA at ctx 200. I then merged the adapter with base model.
|
| 14 |
+
This model is akin to raw LLaMa 65B, it's not meant to follow instructions but instead should be useful as base for further fine-tuning.
|