mwitiderrick
commited on
Commit
•
51e53c5
1
Parent(s):
6ae44ff
Update README.md
Browse files
README.md
CHANGED
@@ -10,10 +10,11 @@ quantized_by: mwitiderrick
|
|
10 |
tags:
|
11 |
- deepsparse
|
12 |
---
|
13 |
-
#
|
14 |
-
This repo contains model files for [
|
15 |
|
16 |
This model was quantized and pruned with [SparseGPT](https://arxiv.org/abs/2301.00774), using [SparseML](https://github.com/neuralmagic/sparseml).
|
|
|
17 |
## Inference
|
18 |
Install [DeepSparse LLM](https://github.com/neuralmagic/deepsparse) for fast inference on CPUs:
|
19 |
```bash
|
|
|
10 |
tags:
|
11 |
- deepsparse
|
12 |
---
|
13 |
+
# SOLAR-10.7B-Instruct-v1.0 - DeepSparse
|
14 |
+
This repo contains model files for [SOLAR-10.7B-Instruct-v1.0](https://huggingface.co/upstage/SOLAR-10.7B-Instruct-v1.0) optimized for [DeepSparse](https://github.com/neuralmagic/deepsparse), a CPU inference runtime for sparse models.
|
15 |
|
16 |
This model was quantized and pruned with [SparseGPT](https://arxiv.org/abs/2301.00774), using [SparseML](https://github.com/neuralmagic/sparseml).
|
17 |
+
|
18 |
## Inference
|
19 |
Install [DeepSparse LLM](https://github.com/neuralmagic/deepsparse) for fast inference on CPUs:
|
20 |
```bash
|