upstage
/

Llama-2-70b-instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

wonhosong commited on Jul 24, 2023

Commit

f1758fb

•

1 Parent(s): 5c91a28

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -65,7 +65,8 @@ We used the [lm-evaluation-harness repository](https://github.com/EleutherAI/lm-
 ### Main Results
 | Model                                         | Average | ARC   | HellaSwag | MMLU  | TruthfulQA |
 |-----------------------------------------------|---------|-------|-----------|-------|------------|
-  | Llama-2-70b-instruct-1024 (***Ours***, ***Local Reproduction***) | **72.0** | **70.7** | **87.4** | **69.3** | **60.7** |
 | llama-65b-instruct (***Ours***, ***Local Reproduction***) | 69.4 | 67.6 | 86.5 | 64.9 | 58.8 |
 | llama-30b-instruct-2048 (***Ours***, ***Open LLM Leaderboard***) | 67.0 | 64.9 | 84.9 | 61.9 | 56.3 |
 | Llama-2-70b-chat-hf | 66.8 | 64.6 | 85.9 | 63.9 | 52.8 |

 ### Main Results
 | Model                                         | Average | ARC   | HellaSwag | MMLU  | TruthfulQA |
 |-----------------------------------------------|---------|-------|-----------|-------|------------|
+| Llama-2-70b-instruct-1024 (***Ours***, ***Local Reproduction***) | **72.0** | **70.7** | **87.4** | **69.3** | **60.7** |
+| Llama-2-70b-hf | 67.3 | 67.3 | 87.3 | 69.8 | 44.9 |
 | llama-65b-instruct (***Ours***, ***Local Reproduction***) | 69.4 | 67.6 | 86.5 | 64.9 | 58.8 |
 | llama-30b-instruct-2048 (***Ours***, ***Open LLM Leaderboard***) | 67.0 | 64.9 | 84.9 | 61.9 | 56.3 |
 | Llama-2-70b-chat-hf | 66.8 | 64.6 | 85.9 | 63.9 | 52.8 |