rodrigo-nogueira commited on
Commit
ec6b8e8
1 Parent(s): 2702b15

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -3
README.md CHANGED
@@ -25,9 +25,10 @@ Sabiá-7B is Portuguese language model developed by [Maritaca AI](https://www.ma
25
 
26
  Given that Sabiá-7B was trained solely on a language modeling objective without fine-tuning for instruction following, it is recommended for few-shot tasks rather than zero-shot tasks.
27
 
28
- **Results**
29
 
30
- Below we show the results on the Poeta benchmark, which consists of 14 Portuguese datasets:
 
31
 
32
  |Model | NPM |
33
  |--|--|
@@ -35,7 +36,16 @@ Below we show the results on the Poeta benchmark, which consists of 14 Portugues
35
  |LLaMA-2-7B| 43.7|
36
  |Sabiá-7B| 48.5|
37
 
38
- For more information on the Normalized Preferred Metric (NPM), please check out our paper.
 
 
 
 
 
 
 
 
 
39
 
40
  Please use the following bibtex to cite our paper:
41
  ```
 
25
 
26
  Given that Sabiá-7B was trained solely on a language modeling objective without fine-tuning for instruction following, it is recommended for few-shot tasks rather than zero-shot tasks.
27
 
28
+ **Results in Portuguese**
29
 
30
+ Below we show the results on the Poeta benchmark, which consists of 14 Portuguese datasets.
31
+ For more information on the Normalized Preferred Metric (NPM), please check out our paper.
32
 
33
  |Model | NPM |
34
  |--|--|
 
36
  |LLaMA-2-7B| 43.7|
37
  |Sabiá-7B| 48.5|
38
 
39
+ **Results in English**
40
+
41
+ Below we show the average results on 6 English datasets: PIQA, HellaSwag, WinoGrande, ARC-e, ARC-c, and OpenBookQA.
42
+
43
+ |Model | NPM |
44
+ |--|--|
45
+ |LLaMA-1-7B| 50.1|
46
+ |Sabiá-7B| 49.0|
47
+
48
+
49
 
50
  Please use the following bibtex to cite our paper:
51
  ```