Update README.md
Browse files
README.md
CHANGED
@@ -126,6 +126,19 @@ Taurus is an [OpenHermes 2.5](https://huggingface.co/teknium/OpenHermes-2.5-Mist
|
|
126 |
|
127 |
The model was trained for 2 epochs (QLoRA) using [axolotl](https://github.com/OpenAccess-AI-Collective/axolotl). The exact config I used can be found [here](https://huggingface.co/rxavier/Taurus-1.0-Mistral-7B/tree/main/axolotl).
|
128 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
129 |
## Prompt format
|
130 |
|
131 |
Taurus uses **ChatML**.
|
@@ -173,17 +186,4 @@ print(tokenizer.decode(outputs["sequences"].cpu().tolist()[0]))
|
|
173 |
|
174 |
## GGUF quants
|
175 |
|
176 |
-
You can find GGUF quants for llama.cpp [here](https://huggingface.co/rxavier/Taurus-7B-1.0-GGUF).
|
177 |
-
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
178 |
-
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_rxavier__Taurus-7B-1.0)
|
179 |
-
|
180 |
-
| Metric |Value|
|
181 |
-
|---------------------------------|----:|
|
182 |
-
|Avg. |66.40|
|
183 |
-
|AI2 Reasoning Challenge (25-Shot)|63.57|
|
184 |
-
|HellaSwag (10-Shot) |83.64|
|
185 |
-
|MMLU (5-Shot) |63.50|
|
186 |
-
|TruthfulQA (0-shot) |50.21|
|
187 |
-
|Winogrande (5-shot) |78.14|
|
188 |
-
|GSM8k (5-shot) |59.36|
|
189 |
-
|
|
|
126 |
|
127 |
The model was trained for 2 epochs (QLoRA) using [axolotl](https://github.com/OpenAccess-AI-Collective/axolotl). The exact config I used can be found [here](https://huggingface.co/rxavier/Taurus-1.0-Mistral-7B/tree/main/axolotl).
|
128 |
|
129 |
+
## [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
130 |
+
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_rxavier__Taurus-7B-1.0)
|
131 |
+
|
132 |
+
| Metric |Value|
|
133 |
+
|---------------------------------|----:|
|
134 |
+
|Avg. |66.40|
|
135 |
+
|AI2 Reasoning Challenge (25-Shot)|63.57|
|
136 |
+
|HellaSwag (10-Shot) |83.64|
|
137 |
+
|MMLU (5-Shot) |63.50|
|
138 |
+
|TruthfulQA (0-shot) |50.21|
|
139 |
+
|Winogrande (5-shot) |78.14|
|
140 |
+
|GSM8k (5-shot) |59.36|
|
141 |
+
|
142 |
## Prompt format
|
143 |
|
144 |
Taurus uses **ChatML**.
|
|
|
186 |
|
187 |
## GGUF quants
|
188 |
|
189 |
+
You can find GGUF quants for llama.cpp [here](https://huggingface.co/rxavier/Taurus-7B-1.0-GGUF).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|