chandlerTSLabs commited on
Commit
6610f74
1 Parent(s): 8f80cd9

Update README

Browse files
Files changed (1) hide show
  1. README.md +13 -1
README.md CHANGED
@@ -6,5 +6,17 @@ license: apache-2.0
6
  * Original Model: [Zephyr 7B Beta](hhttps://huggingface.co/HuggingFaceH4/zephyr-7b-beta)
7
  * Quantized Model: [Zephyr 7B Beta GGUF](https://huggingface.co/TheBloke/zephyr-7B-beta-GGUF)
8
  * Llamafile Source Code: [Mozilla-Ocho/llamafile](https://github.com/Mozilla-Ocho/llamafile)
 
9
 
10
- Both the server and the CLI are based on [TheBloke's Zephyr 7B Beta GGUF Q4_M_M](https://huggingface.co/TheBloke/zephyr-7B-beta-GGUF/resolve/main/zephyr-7b-beta. Q4_K_M.gguf?download=true) model.
 
 
 
 
 
 
 
 
 
 
 
 
6
  * Original Model: [Zephyr 7B Beta](hhttps://huggingface.co/HuggingFaceH4/zephyr-7b-beta)
7
  * Quantized Model: [Zephyr 7B Beta GGUF](https://huggingface.co/TheBloke/zephyr-7B-beta-GGUF)
8
  * Llamafile Source Code: [Mozilla-Ocho/llamafile](https://github.com/Mozilla-Ocho/llamafile)
9
+ + Built with [Llamafile `5ea929c`](https://github.com/Mozilla-Ocho/llamafile/tree/5ea929c618e9a2b162d39d8cc1c91cb564934a9f)
10
 
11
+ Both the server and the CLI are based on [TheBloke's Zephyr 7B Beta GGUF Q4_K_M](https://huggingface.co/TheBloke/zephyr-7B-beta-GGUF) model.
12
+
13
+ ## Usage
14
+
15
+ **NOTE:** Due to the executable being greater than 4GB, it is currently not compatible with Windows. I will update with a Windows friendly version of Zephyr 7B Beta when I can.
16
+
17
+ ```bash
18
+ # replace with the CLI if you prefer
19
+ wget https://huggingface.co/TimeSurgeLabs/zephyr-7b-beta-llamafile/resolve/main/zephyr-beta-server.llamafile
20
+ chmod +x zephyr-beta-server.llamafile
21
+ ./zephyr-beta-server.llamafile
22
+ ```