|
--- |
|
library_name: transformers |
|
tags: [] |
|
--- |
|
# MarcoroCapy-7B |
|
|
|
This model is a DPO fine tune of [mlabonne/Marcoro14-7B-slerp](https://huggingface.co/mlabonne/Marcoro14-7B-slerp) on [argilla/distilabel-capybara-dpo-7k-binarized](https://huggingface.co/datasets/argilla/distilabel-capybara-dpo-7k-binarized) |
|
|
|
<div align="center"> |
|
|
|
 |
|
|
|
[<img src="https://raw.githubusercontent.com/argilla-io/distilabel/main/docs/assets/distilabel-badge-dark.png" alt="Built with Distilabel" width="200" height="32"/>](https://github.com/argilla-io/distilabel) |
|
|
|
</div> |
|
|
|
## Process |
|
|
|
+ Realigned the chat template to ChatML |
|
+ Completed 1 Epoch |
|
+ 5e-5 learning rate |
|
+ Training time was about 4.5 hours on 1 H100 |
|
+ Cost was ~$20 |
|
|
|
## GGUF |
|
|
|
TODO |
|
|
|
## Evaluations |
|
|
|
TODO |
|
|
