davidrpugh
commited on
Added funding details.
Browse files
README.md
CHANGED
@@ -191,11 +191,13 @@ extra_gated_description: The information you provide will be collected, stored,
|
|
191 |
extra_gated_button_content: Submit
|
192 |
---
|
193 |
|
194 |
-
# davidrpugh/Llama-3.1-8B-Instruct-
|
|
|
195 |
This model was converted to GGUF format from [`meta-llama/Llama-3.1-8B-Instruct`](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
196 |
Refer to the [original model card](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct) for more details on the model.
|
197 |
|
198 |
## Use with llama.cpp
|
|
|
199 |
Install llama.cpp through brew (works on Mac and Linux)
|
200 |
|
201 |
```bash
|
@@ -234,3 +236,7 @@ or
|
|
234 |
```
|
235 |
./llama-server --hf-repo davidrpugh/Llama-3.1-8B-Instruct-Q4_K_M-GGUF --hf-file llama-3.1-8b-instruct-q4_k_m.gguf -c 2048
|
236 |
```
|
|
|
|
|
|
|
|
|
|
191 |
extra_gated_button_content: Submit
|
192 |
---
|
193 |
|
194 |
+
# davidrpugh/Llama-3.1-8B-Instruct-GGUF
|
195 |
+
|
196 |
This model was converted to GGUF format from [`meta-llama/Llama-3.1-8B-Instruct`](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
197 |
Refer to the [original model card](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct) for more details on the model.
|
198 |
|
199 |
## Use with llama.cpp
|
200 |
+
|
201 |
Install llama.cpp through brew (works on Mac and Linux)
|
202 |
|
203 |
```bash
|
|
|
236 |
```
|
237 |
./llama-server --hf-repo davidrpugh/Llama-3.1-8B-Instruct-Q4_K_M-GGUF --hf-file llama-3.1-8b-instruct-q4_k_m.gguf -c 2048
|
238 |
```
|
239 |
+
|
240 |
+
## Funding Acknowledgment
|
241 |
+
|
242 |
+
This project is supported by funding from [King Abdullah University of Science and Technology (KAUST) - Center of Excellence for Generative AI](https://genai.kaust.edu.sa/), under award number 5940.
|