File size: 922 Bytes
53a2780 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|-------------|------:|------|-----:|--------|-----:|---|-----:|
|openbookqa | 1|none | 0|acc |0.2040|± |0.0180|
| | |none | 0|acc_norm|0.3180|± |0.0208|
|arc_challenge| 1|none | 0|acc |0.2500|± |0.0127|
| | |none | 0|acc_norm|0.3020|± |0.0134|
|arc_easy | 1|none | 0|acc |0.5311|± |0.0102|
| | |none | 0|acc_norm|0.4899|± |0.0103|
|winogrande | 1|none | 0|acc |0.5604|± |0.0139|
|hellaswag | 1|none | 0|acc |0.4246|± |0.0049|
| | |none | 0|acc_norm|0.5772|± |0.0049|
|piqa | 1|none | 0|acc |0.6621|± |0.0110|
| | |none | 0|acc_norm|0.6725|± |0.0109|
|boolq | 2|none | 0|acc |0.5804|± |0.0086|
|