devingulliver commited on
Commit
2d13ea1
β€’
1 Parent(s): 46d65a2
Files changed (1) hide show
  1. app.py +2 -1
app.py CHANGED
@@ -38,7 +38,8 @@ with gr.Blocks() as demo:
38
 
39
  with gr.Tab("πŸ“ About"):
40
  gr.Markdown("""
41
- The **Subquadratic LLM Leaderboard** evaluates LLMs with subquadratic architectures (ie RWKV & Mamba) on the same benchmarks as the Open LLM Leaderboard, with the goal of providing open evaluation results while the architectures themselves are pending inclusion in πŸ€— Transformers.
 
42
  This leaderboard is maintained by Devin Gulliver and is still under construction, check back regularly for further improvements!
43
  """)
44
 
 
38
 
39
  with gr.Tab("πŸ“ About"):
40
  gr.Markdown("""
41
+ The **Subquadratic LLM Leaderboard** evaluates LLMs with subquadratic architectures (ie RWKV & Mamba) with the goal of providing open evaluation results while the architectures themselves are pending inclusion in πŸ€— Transformers.
42
+ The metrics are the same as the Open LLM Leaderboard: ARC 25-shot, HellaSwag 10-shot, MMLU 5-shot, TruthfulQA zeroshot, Winogrande 5-shot, and GSM8K 5-shot.
43
  This leaderboard is maintained by Devin Gulliver and is still under construction, check back regularly for further improvements!
44
  """)
45