Intel
/

bloom-7b1-int4-inc

Model card Files Files and versions Community

yintongl commited on May 21, 2024

Commit

92edfdd

·

verified ·

1 Parent(s): 4fc7a47

Update README.md

Files changed (1) hide show

README.md +10 -10

README.md CHANGED Viewed

@@ -51,17 +51,17 @@ lm_eval --model hf --model_args pretrained="Intel/bloom-7b1-int4-inc",autogptq=T
 | Metric         | FP16   | INT4   |
 | -------------- | ------ | ------ |
-| Avg.           | 0.4736 | 0.4716 |
-| mmlu           | 0.2663 | 0.2598 |
-| lambada_openai | 0.5758 | 0.5729 |
-| hellaswag      | 0.4648 | 0.4619 |
 | winogrande     | 0.6456 | 0.6369 |
-| piqa           | 0.7263 | 0.7263 |
-| truthfulqa_mc1 | 0.2228 | 0.2350 |
-| openbookqa     | 0.2520 | 0.2440 |
-| boolq          | 0.6287 | 0.6294 |
-| arc_easy       | 0.6503 | 0.6444 |
-| arc_challenge  | 0.3038 | 0.3055 |

 | Metric         | FP16   | INT4   |
 | -------------- | ------ | ------ |
+| Avg.           | 0.4732 | 0.4716 |
+| mmlu           | 0.2638 | 0.2598 |
+| lambada_openai | 0.5760 | 0.5729 |
+| hellaswag      | 0.4649 | 0.4619 |
 | winogrande     | 0.6456 | 0.6369 |
+| piqa           | 0.7269 | 0.7263 |
+| truthfulqa_mc1 | 0.2240 | 0.2350 |
+| openbookqa     | 0.2500 | 0.2440 |
+| boolq          | 0.6284 | 0.6294 |
+| arc_easy       | 0.6498 | 0.6444 |
+| arc_challenge  | 0.3029 | 0.3055 |