chandlerTSLabs
commited on
Commit
•
6610f74
1
Parent(s):
8f80cd9
Update README
Browse files
README.md
CHANGED
@@ -6,5 +6,17 @@ license: apache-2.0
|
|
6 |
* Original Model: [Zephyr 7B Beta](hhttps://huggingface.co/HuggingFaceH4/zephyr-7b-beta)
|
7 |
* Quantized Model: [Zephyr 7B Beta GGUF](https://huggingface.co/TheBloke/zephyr-7B-beta-GGUF)
|
8 |
* Llamafile Source Code: [Mozilla-Ocho/llamafile](https://github.com/Mozilla-Ocho/llamafile)
|
|
|
9 |
|
10 |
-
Both the server and the CLI are based on [TheBloke's Zephyr 7B Beta GGUF
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
6 |
* Original Model: [Zephyr 7B Beta](hhttps://huggingface.co/HuggingFaceH4/zephyr-7b-beta)
|
7 |
* Quantized Model: [Zephyr 7B Beta GGUF](https://huggingface.co/TheBloke/zephyr-7B-beta-GGUF)
|
8 |
* Llamafile Source Code: [Mozilla-Ocho/llamafile](https://github.com/Mozilla-Ocho/llamafile)
|
9 |
+
+ Built with [Llamafile `5ea929c`](https://github.com/Mozilla-Ocho/llamafile/tree/5ea929c618e9a2b162d39d8cc1c91cb564934a9f)
|
10 |
|
11 |
+
Both the server and the CLI are based on [TheBloke's Zephyr 7B Beta GGUF Q4_K_M](https://huggingface.co/TheBloke/zephyr-7B-beta-GGUF) model.
|
12 |
+
|
13 |
+
## Usage
|
14 |
+
|
15 |
+
**NOTE:** Due to the executable being greater than 4GB, it is currently not compatible with Windows. I will update with a Windows friendly version of Zephyr 7B Beta when I can.
|
16 |
+
|
17 |
+
```bash
|
18 |
+
# replace with the CLI if you prefer
|
19 |
+
wget https://huggingface.co/TimeSurgeLabs/zephyr-7b-beta-llamafile/resolve/main/zephyr-beta-server.llamafile
|
20 |
+
chmod +x zephyr-beta-server.llamafile
|
21 |
+
./zephyr-beta-server.llamafile
|
22 |
+
```
|