add results table
Browse files
README.md
CHANGED
@@ -9,6 +9,19 @@ INTELLECT-MATH is a 7B parameter model optimized for mathematical reasoning. It
|
|
9 |
We demonstrate that the quality of our SFT data can impact the performance and training speed of the RL stage: Due to its better synthetic SFT dataset that encourages the model to imitate the reasoning behavior of a strong teacher model, INTELLECT-MATH outperforms Eurus-2-PRIME, the previous state-of-the-art trained with PRIME-RL, and matches its performance with 10x faster training.
|
10 |
|
11 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
12 |
### Links
|
13 |
|
14 |
- 📜 [Blog Post]()
|
|
|
9 |
We demonstrate that the quality of our SFT data can impact the performance and training speed of the RL stage: Due to its better synthetic SFT dataset that encourages the model to imitate the reasoning behavior of a strong teacher model, INTELLECT-MATH outperforms Eurus-2-PRIME, the previous state-of-the-art trained with PRIME-RL, and matches its performance with 10x faster training.
|
10 |
|
11 |
|
12 |
+
|
13 |
+
| | Intellect-Math (Step 255) | Intellect-Math (Step 47) | Eurus-2-Prime (Step 592) | Intellect-Math-SFT | Eurus-2-SFT | Qwen-2.5-Math |
|
14 |
+
|----------------|---------------------------:|--------------------------:|--------------------------:|--------------------:|------------:|-------------:|
|
15 |
+
| **MATH-500** | 82.0 | 81.6 | 79.2 | 72.8 | 65.1 | 79.8 |
|
16 |
+
| **OLYMPIADBENCH** | 49.5 | 46.7 | 42.1 | 39.1 | 29.8 | 40.7 |
|
17 |
+
| **AIME 2024** | 26.7 | 26.7 | 26.7 | 16.6 | 3.3 | 13.3 |
|
18 |
+
| **AMC** | 60.2 | 57.8 | 57.8 | 45.8 | 30.1 | 50.6 |
|
19 |
+
| **MINERVA MATH** | 39.7 | 37.8 | 38.6 | 33.8 | 32.7 | 34.6 |
|
20 |
+
| **AVG** | 51.6 | 50.1 | 48.9 | 41.6 | 32.2 | 43.8 |
|
21 |
+
|
22 |
+
|
23 |
+
|
24 |
+
|
25 |
### Links
|
26 |
|
27 |
- 📜 [Blog Post]()
|