---
license: other
license_name: yi-license
license_link: LICENSE
tags:
- finetune
- fine-tune
datasets:
- adamo1139/rawrr_v1
---


This model is Yi-34B-200K fine-tuned using DPO on rawrr_v1 dataset using QLoRA at ctx 200. I then merged the adapter with base model.
This model is akin to raw LLaMa 65B, it's not meant to follow instructions but instead should be useful as base for further fine-tuning.