SultanR commited on
Commit
fcfc71c
1 Parent(s): 880d348

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -38,7 +38,7 @@ There's a few reasons on why I called this model v0:
38
 
39
  I ran these evaluations using [SmolLM2's evaluation code](https://github.com/huggingface/smollm/tree/main/evaluation) for a more fair comparison.
40
 
41
- | Metric | SultanR/SmolTulu-1.7b-it-v0 | SmolLM2-1.7B-Instruct | Llama-1B-Instruct | Qwen2.5-1.5B-Instruct | SmolLM1-1.7B-Instruct |
42
  |:----------------------------|:---------------------:|:---------------------:|:---------------------:|:---------------------:|:---------------------:|
43
  | IFEval (Average prompt/inst) | **67.7** | 56.7 | 53.5 | 47.4 | 23.1 |
44
  | GSM8K (5-shot) | **51.6** | 48.2 | 26.8 | 42.8 | 4.6 |
 
38
 
39
  I ran these evaluations using [SmolLM2's evaluation code](https://github.com/huggingface/smollm/tree/main/evaluation) for a more fair comparison.
40
 
41
+ | Metric | SmolTulu-1.7b-it-v0 | SmolLM2-1.7B-Instruct | Llama-1B-Instruct | Qwen2.5-1.5B-Instruct | SmolLM1-1.7B-Instruct |
42
  |:----------------------------|:---------------------:|:---------------------:|:---------------------:|:---------------------:|:---------------------:|
43
  | IFEval (Average prompt/inst) | **67.7** | 56.7 | 53.5 | 47.4 | 23.1 |
44
  | GSM8K (5-shot) | **51.6** | 48.2 | 26.8 | 42.8 | 4.6 |