Hugging Face's logo

fedric95
/
gemma-2-9b-GGUF

Text Generation
Transformers
GGUF
conversational
Inference Endpoints
Model card Files Community
fedric95 commited on
Commit
5142179
•
1 Parent(s): cb1a06b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -49,6 +49,11 @@ Original model: https://huggingface.co/google/gemma-2-9b
49
  | HellaSwag (0-shot) | Q3_K_M | 76.64807807 |
50
  | HellaSwag (0-shot) | Q3_K_S | 76.08046206 |
51
  | HellaSwag (0-shot) | Q2_K | 73.07309301 |
 
 
 
 
 
52
 
53
  ## Downloading using huggingface-cli
54
 
 
49
  | HellaSwag (0-shot) | Q3_K_M | 76.64807807 |
50
  | HellaSwag (0-shot) | Q3_K_S | 76.08046206 |
51
  | HellaSwag (0-shot) | Q2_K | 73.07309301 |
52
+ | MMLU (0-shot) | Q8_0 | 42.5065 +/- 1.2569 |
53
+ | MMLU (0-shot) | Q4_K_M | 42.5065 +/- 1.2569 |
54
+ | MMLU (0-shot) | Q3_K_M | 41.3437 +/- 1.2520 |
55
+ | MMLU (0-shot) | Q3_K_S | 40.5685 +/- 1.2484 |
56
+ | MMLU (0-shot) | Q2_K | 38.1137 +/- 1.2348 |
57
 
58
  ## Downloading using huggingface-cli
59