bartowski commited on
Commit
0e1c3ce
1 Parent(s): 2bac882

Update metadata with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +127 -1
README.md CHANGED
@@ -1,6 +1,132 @@
1
  ---
2
- quantized_by: bartowski
 
3
  pipeline_tag: text-generation
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
  ---
5
 
6
  ## Llamacpp imatrix Quantizations of granite-3.0-1b-a400m-instruct
 
1
  ---
2
+ base_model: ibm-granite/granite-3.0-1b-a400m-instruct
3
+ license: apache-2.0
4
  pipeline_tag: text-generation
5
+ tags:
6
+ - language
7
+ - granite-3.0
8
+ quantized_by: bartowski
9
+ inference: false
10
+ model-index:
11
+ - name: granite-3.0-2b-instruct
12
+ results:
13
+ - task:
14
+ type: text-generation
15
+ dataset:
16
+ name: IFEval
17
+ type: instruction-following
18
+ metrics:
19
+ - type: pass@1
20
+ value: 32.39
21
+ name: pass@1
22
+ - type: pass@1
23
+ value: 6.17
24
+ name: pass@1
25
+ - task:
26
+ type: text-generation
27
+ dataset:
28
+ name: AGI-Eval
29
+ type: human-exams
30
+ metrics:
31
+ - type: pass@1
32
+ value: 20.35
33
+ name: pass@1
34
+ - type: pass@1
35
+ value: 32.0
36
+ name: pass@1
37
+ - type: pass@1
38
+ value: 12.21
39
+ name: pass@1
40
+ - task:
41
+ type: text-generation
42
+ dataset:
43
+ name: OBQA
44
+ type: commonsense
45
+ metrics:
46
+ - type: pass@1
47
+ value: 38.4
48
+ name: pass@1
49
+ - type: pass@1
50
+ value: 47.55
51
+ name: pass@1
52
+ - type: pass@1
53
+ value: 65.59
54
+ name: pass@1
55
+ - type: pass@1
56
+ value: 61.17
57
+ name: pass@1
58
+ - type: pass@1
59
+ value: 49.11
60
+ name: pass@1
61
+ - task:
62
+ type: text-generation
63
+ dataset:
64
+ name: BoolQ
65
+ type: reading-comprehension
66
+ metrics:
67
+ - type: pass@1
68
+ value: 70.12
69
+ name: pass@1
70
+ - type: pass@1
71
+ value: 1.27
72
+ name: pass@1
73
+ - task:
74
+ type: text-generation
75
+ dataset:
76
+ name: ARC-C
77
+ type: reasoning
78
+ metrics:
79
+ - type: pass@1
80
+ value: 41.21
81
+ name: pass@1
82
+ - type: pass@1
83
+ value: 23.07
84
+ name: pass@1
85
+ - type: pass@1
86
+ value: 31.77
87
+ name: pass@1
88
+ - task:
89
+ type: text-generation
90
+ dataset:
91
+ name: HumanEvalSynthesis
92
+ type: code
93
+ metrics:
94
+ - type: pass@1
95
+ value: 30.18
96
+ name: pass@1
97
+ - type: pass@1
98
+ value: 26.22
99
+ name: pass@1
100
+ - type: pass@1
101
+ value: 21.95
102
+ name: pass@1
103
+ - type: pass@1
104
+ value: 15.4
105
+ name: pass@1
106
+ - task:
107
+ type: text-generation
108
+ dataset:
109
+ name: GSM8K
110
+ type: math
111
+ metrics:
112
+ - type: pass@1
113
+ value: 26.31
114
+ name: pass@1
115
+ - type: pass@1
116
+ value: 10.88
117
+ name: pass@1
118
+ - task:
119
+ type: text-generation
120
+ dataset:
121
+ name: PAWS-X (7 langs)
122
+ type: multilingual
123
+ metrics:
124
+ - type: pass@1
125
+ value: 45.84
126
+ name: pass@1
127
+ - type: pass@1
128
+ value: 11.8
129
+ name: pass@1
130
  ---
131
 
132
  ## Llamacpp imatrix Quantizations of granite-3.0-1b-a400m-instruct