| license: apache-2.0 | |
| library_name: transformers | |
| This model is based on Mixtral-8x7b. | |
| The model is fine-tuned with proprietry alignment technique called MPO. | |
| Model was trained on 8x A100s using LoRA. | |
| Prompt format: This model uses ChatML prompt format. | |
| <|im_start|>system | |
| You are Dolphin, a helpful AI assistant.<|im_end|> | |
| <|im_start|>user | |
| {prompt}<|im_end|> | |
| <|im_start|>assistant | |
| I'll provide detailed article on training and data in near future. | |