Update README.md
Browse files
README.md
CHANGED
|
@@ -14,7 +14,7 @@ tags:
|
|
| 14 |
|
| 15 |
# L3-8B-Stheno-v3.2-MLX
|
| 16 |
|
| 17 |
-
This is the MLX version of the fantastic [L3-8B-Stheno-v3.2](https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2) by Sao10K.
|
| 18 |
|
| 19 |
## Use with mlx
|
| 20 |
|
|
|
|
| 14 |
|
| 15 |
# L3-8B-Stheno-v3.2-MLX
|
| 16 |
|
| 17 |
+
This is the MLX version of the fantastic [L3-8B-Stheno-v3.2](https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2) by Sao10K. Achieves roughly 10-15 tok/sec faster on my system then the original 4 bit quant.
|
| 18 |
|
| 19 |
## Use with mlx
|
| 20 |
|