huseinzol05 commited on
Commit
391fde4
·
verified ·
1 Parent(s): a2c8815

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md CHANGED
@@ -22,6 +22,22 @@ Continue finetuning https://huggingface.co/meta-llama/Llama-3.2-3B on highly cur
22
  ## MalayMMLU
23
 
24
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
25
  ```
26
 
27
  ## Training session
 
22
  ## MalayMMLU
23
 
24
  ```
25
+ Model Accuracy shot by_letter category
26
+ 0 Llama-3.2-3B-Malaysian-Reasoning 57.347524 0shot True STEM
27
+ 1 Llama-3.2-3B-Malaysian-Reasoning 59.653308 0shot True Language
28
+ 2 Llama-3.2-3B-Malaysian-Reasoning 57.690084 0shot True Social science
29
+ 3 Llama-3.2-3B-Malaysian-Reasoning 57.639722 0shot True Others
30
+ 4 Llama-3.2-3B-Malaysian-Reasoning 60.045506 0shot True Humanities
31
+ {'Social science': 6918, 'Language': 6288, 'Humanities': 4395, 'Others': 4169, 'STEM': 2443}
32
+ Model : Llama-3.2-3B-Malaysian-Reasoning
33
+ Metric : first
34
+ Shot : 0shot
35
+ average accuracy 58.58423161111799
36
+ accuracy for STEM 57.34752353663528
37
+ accuracy for Language 59.65330788804071
38
+ accuracy for Social science 57.6900838392599
39
+ accuracy for Others 57.639721755816744
40
+ accuracy for Humanities 60.04550625711035
41
  ```
42
 
43
  ## Training session