JacopoAbate commited on
Commit
8fb4b85
1 Parent(s): 9ad925a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -19,6 +19,14 @@ It has been trained on a mixture of opensource datasets, like SQUAD-it (https://
19
 
20
  It is not just a Q&A, it is a Q&A + Context model, with the goal being it being used for RAGs and application in need of a context.
21
 
 
 
 
 
 
 
 
 
22
 
23
  ## Usage
24
 
 
19
 
20
  It is not just a Q&A, it is a Q&A + Context model, with the goal being it being used for RAGs and application in need of a context.
21
 
22
+ # Evaluation
23
+
24
+ We evaluated the model using the same test sets as used for the Open Ita LLM Leaderboard
25
+
26
+ | hellaswag_it acc_norm | arc_it acc_norm | m_mmlu_it 5-shot acc | Average |
27
+ |:----------------------:| :---------------: | :--------------------: | :-------: |
28
+ | 0.6067 | 0.4405 | 0.5112 | 0,52 |
29
+
30
 
31
  ## Usage
32