devingulliver
commited on
Commit
β’
2d13ea1
1
Parent(s):
46d65a2
Elaborate
Browse files
app.py
CHANGED
@@ -38,7 +38,8 @@ with gr.Blocks() as demo:
|
|
38 |
|
39 |
with gr.Tab("π About"):
|
40 |
gr.Markdown("""
|
41 |
-
The **Subquadratic LLM Leaderboard** evaluates LLMs with subquadratic architectures (ie RWKV & Mamba)
|
|
|
42 |
This leaderboard is maintained by Devin Gulliver and is still under construction, check back regularly for further improvements!
|
43 |
""")
|
44 |
|
|
|
38 |
|
39 |
with gr.Tab("π About"):
|
40 |
gr.Markdown("""
|
41 |
+
The **Subquadratic LLM Leaderboard** evaluates LLMs with subquadratic architectures (ie RWKV & Mamba) with the goal of providing open evaluation results while the architectures themselves are pending inclusion in π€ Transformers.
|
42 |
+
The metrics are the same as the Open LLM Leaderboard: ARC 25-shot, HellaSwag 10-shot, MMLU 5-shot, TruthfulQA zeroshot, Winogrande 5-shot, and GSM8K 5-shot.
|
43 |
This leaderboard is maintained by Devin Gulliver and is still under construction, check back regularly for further improvements!
|
44 |
""")
|
45 |
|