neuralmagic
/

Llama-2-7b-dolphin-open_platypus-pruned_50

shubhrapandit commited on Mar 19

Commit

6e691b3

•

1 Parent(s): 4ee2327

Update README.md (#2)

- Update README.md (fc464208567ffb393ae17d77a77d5fef895ee826)

Co-authored-by: Shubhra Pandit <shubhrapandit@users.noreply.huggingface.co>

Files changed (1) hide show

README.md CHANGED Viewed

@@ -50,8 +50,8 @@ Model evaluation metrics and results.
 | Benchmark                                      | Metric        | Llama-2-7b-instruct  | Llama-2-7b-pruned50-retrained-instruct |
 |------------------------------------------------|---------------|-------------|-------------------------------|
-| [MMLU](https://arxiv.org/abs/2009.03300)       | 5-shot, top-1 | 48.60%  | 45.10% |
-| [HellaSwag](https://arxiv.org/abs/1905.07830)  | 0-shot        | 79.45%  | 78.86% |
 | [WinoGrande](https://arxiv.org/abs/1907.10641) | 5-shot        | 75.69%  | 72.61% |
 | [ARC-c](https://arxiv.org/abs/1911.01547)      | 25-shot       | 53.92%  | 50.77% |
 | [TruthfulQA](https://arxiv.org/abs/2109.07958) | 0-shot        | 43.63%  | 44.40% |

 | Benchmark                                      | Metric        | Llama-2-7b-instruct  | Llama-2-7b-pruned50-retrained-instruct |
 |------------------------------------------------|---------------|-------------|-------------------------------|
+| [MMLU](https://arxiv.org/abs/2009.03300)       | 5-shot        | 48.60%  | 45.10% |
+| [HellaSwag](https://arxiv.org/abs/1905.07830)  | 10-shot       | 79.45%  | 78.86% |
 | [WinoGrande](https://arxiv.org/abs/1907.10641) | 5-shot        | 75.69%  | 72.61% |
 | [ARC-c](https://arxiv.org/abs/1911.01547)      | 25-shot       | 53.92%  | 50.77% |
 | [TruthfulQA](https://arxiv.org/abs/2109.07958) | 0-shot        | 43.63%  | 44.40% |