---
license: apache-2.0
datasets:
- argilla/distilabel-intel-orca-dpo-pairs
---
# Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->

This model is a DPO finetuned variation of https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B using the argilla/distilabel-intel-orca-dpo-pairs