Adding Evaluation Results

README.md

@@ -2,6 +2,109 @@
 license: llama2
 datasets:
 - jondurbin/airoboros-3.1
+model-index:
+- name: airoboros-l2-70b-3.1.2
+  results:
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: AI2 Reasoning Challenge (25-Shot)
+      type: ai2_arc
+      config: ARC-Challenge
+      split: test
+      args:
+        num_few_shot: 25
+    metrics:
+    - type: acc_norm
+      value: 70.14
+      name: normalized accuracy
+    source:
+      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=jondurbin/airoboros-l2-70b-3.1.2
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: HellaSwag (10-Shot)
+      type: hellaswag
+      split: validation
+      args:
+        num_few_shot: 10
+    metrics:
+    - type: acc_norm
+      value: 86.88
+      name: normalized accuracy
+    source:
+      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=jondurbin/airoboros-l2-70b-3.1.2
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: MMLU (5-Shot)
+      type: cais/mmlu
+      config: all
+      split: test
+      args:
+        num_few_shot: 5
+    metrics:
+    - type: acc
+      value: 69.72
+      name: accuracy
+    source:
+      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=jondurbin/airoboros-l2-70b-3.1.2
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: TruthfulQA (0-shot)
+      type: truthful_qa
+      config: multiple_choice
+      split: validation
+      args:
+        num_few_shot: 0
+    metrics:
+    - type: mc2
+      value: 59.19
+    source:
+      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=jondurbin/airoboros-l2-70b-3.1.2
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: Winogrande (5-shot)
+      type: winogrande
+      config: winogrande_xl
+      split: validation
+      args:
+        num_few_shot: 5
+    metrics:
+    - type: acc
+      value: 83.11
+      name: accuracy
+    source:
+      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=jondurbin/airoboros-l2-70b-3.1.2
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: GSM8k (5-shot)
+      type: gsm8k
+      config: main
+      split: test
+      args:
+        num_few_shot: 5
+    metrics:
+    - type: acc
+      value: 49.43
+      name: accuracy
+    source:
+      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=jondurbin/airoboros-l2-70b-3.1.2
+      name: Open LLM Leaderboard
 ---
 
 ### Overview
@@ -516,3 +619,17 @@ I am purposingly leaving this license ambiguous (other than the fact you must co
 Your best bet is probably to avoid using this commercially due to the OpenAI API usage.
 
 Either way, by using this model, you agree to completely indemnify me.
+
+# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
+Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_jondurbin__airoboros-l2-70b-3.1.2)
+
+|             Metric              |Value|
+|---------------------------------|----:|
+|Avg.                             |69.74|
+|AI2 Reasoning Challenge (25-Shot)|70.14|
+|HellaSwag (10-Shot)              |86.88|
+|MMLU (5-Shot)                    |69.72|
+|TruthfulQA (0-shot)              |59.19|
+|Winogrande (5-shot)              |83.11|
+|GSM8k (5-shot)                   |49.43|
+