The base model is meta's Llama-2-7b-hf. It was finetuned using SFT and the Guanaco dataset. The model prompt is similar to the original Guanaco model. This repo contains the merged fp16 model.
Legal Disclaimer: This model is bound by the usage restrictions of the original Llama-2 model. And comes with no warranty or gurantees of any kind.
- license:
- llama2
- llama2
- datasets:
- timdettmers/openassistant-guanaco
- timdettmers/openassistant-guanaco
- language:
- en
- en
- reference: https://gist.github.com/younesbelkada/9f7f75c94bdc1981c8ca5cc937d4a4da
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 43.83 |
| ARC (25-shot) | 52.47 |
| HellaSwag (10-shot) | 78.75 |
| MMLU (5-shot) | 45.33 |
| TruthfulQA (0-shot) | 43.9 |
| Winogrande (5-shot) | 74.19 |
| GSM8K (5-shot) | 6.07 |
| DROP (3-shot) | 6.11 |