huseinzol05
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -22,6 +22,22 @@ Continue finetuning https://huggingface.co/meta-llama/Llama-3.2-3B on highly cur
|
|
22 |
## MalayMMLU
|
23 |
|
24 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
25 |
```
|
26 |
|
27 |
## Training session
|
|
|
22 |
## MalayMMLU
|
23 |
|
24 |
```
|
25 |
+
Model Accuracy shot by_letter category
|
26 |
+
0 Llama-3.2-3B-Malaysian-Reasoning 57.347524 0shot True STEM
|
27 |
+
1 Llama-3.2-3B-Malaysian-Reasoning 59.653308 0shot True Language
|
28 |
+
2 Llama-3.2-3B-Malaysian-Reasoning 57.690084 0shot True Social science
|
29 |
+
3 Llama-3.2-3B-Malaysian-Reasoning 57.639722 0shot True Others
|
30 |
+
4 Llama-3.2-3B-Malaysian-Reasoning 60.045506 0shot True Humanities
|
31 |
+
{'Social science': 6918, 'Language': 6288, 'Humanities': 4395, 'Others': 4169, 'STEM': 2443}
|
32 |
+
Model : Llama-3.2-3B-Malaysian-Reasoning
|
33 |
+
Metric : first
|
34 |
+
Shot : 0shot
|
35 |
+
average accuracy 58.58423161111799
|
36 |
+
accuracy for STEM 57.34752353663528
|
37 |
+
accuracy for Language 59.65330788804071
|
38 |
+
accuracy for Social science 57.6900838392599
|
39 |
+
accuracy for Others 57.639721755816744
|
40 |
+
accuracy for Humanities 60.04550625711035
|
41 |
```
|
42 |
|
43 |
## Training session
|