Hugging Face's logo

mgoin
/
zephyr-7b-alpha-ds

Text Generation
Transformers
ONNX
mistral
deepsparse
conversational
Inference Endpoints
Model card Files Community
mgoin commited on
Commit
cb734fc
•
1 Parent(s): 295bc1f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -5,7 +5,7 @@ tags:
5
  # zephyr-7b-alpha for DeepSparse
6
 
7
  ## Usage
8
-
9
  ```python
10
  from deepsparse import TextGeneration
11
  model = TextGeneration(model="hf:mgoin/zephyr-7b-alpha-ds")
@@ -16,6 +16,7 @@ print(out.generations[0].text)
16
 
17
 
18
  ## How to export from [zephyr-7b-alpha](https://huggingface.co/HuggingFaceH4/zephyr-7b-alpha)
 
19
 
20
  ```
21
  git clone https://huggingface.co/HuggingFaceH4/zephyr-7b-alpha
 
5
  # zephyr-7b-alpha for DeepSparse
6
 
7
  ## Usage
8
+ `pip install deepsparse-nightly[llm]`
9
  ```python
10
  from deepsparse import TextGeneration
11
  model = TextGeneration(model="hf:mgoin/zephyr-7b-alpha-ds")
 
16
 
17
 
18
  ## How to export from [zephyr-7b-alpha](https://huggingface.co/HuggingFaceH4/zephyr-7b-alpha)
19
+ Install SparseML with this [PR](https://github.com/neuralmagic/sparseml/pull/1766)
20
 
21
  ```
22
  git clone https://huggingface.co/HuggingFaceH4/zephyr-7b-alpha