Commit
•
aee98da
1
Parent(s):
3d605a6
Update README.md
Browse files
README.md
CHANGED
|
@@ -42,7 +42,7 @@ Quantized version of [HuggingFaceTB/SmolLM2-1.7B](HuggingFaceTB/SmolLM2-1.7B) us
|
|
| 42 |
|
| 43 |
Quantization framework: [Intel AutoRound](https://github.com/intel/auto-round) v0.4.3
|
| 44 |
|
| 45 |
-
Note: this INT4 version of SmolLM2-
|
| 46 |
|
| 47 |
## Replication Recipe
|
| 48 |
|
|
|
|
| 42 |
|
| 43 |
Quantization framework: [Intel AutoRound](https://github.com/intel/auto-round) v0.4.3
|
| 44 |
|
| 45 |
+
Note: this INT4 version of SmolLM2-1.7B has been quantized to run inference through CPU.
|
| 46 |
|
| 47 |
## Replication Recipe
|
| 48 |
|