Hugging Face's logo

leafspark
/
Llama-3-8B-Instruct-Gradient-4194k-GGUF

Text Generation
Transformers
GGUF
Safetensors
English
meta
llama-3
Inference Endpoints
conversational
Model card Files Community
leafspark commited on
Commit
25a7ee6
•
1 Parent(s): fb7130e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -11,6 +11,9 @@ pipeline_tag: text-generation
11
  ---
12
 
13
  # leafspark/llama-3-8b-instruct-gradient-4194k.Q8_0-GGUF
 
 
 
14
  This model was converted to GGUF format from [`gradientai/Llama-3-8B-Instruct-Gradient-4194k`](https://huggingface.co/gradientai/Llama-3-8B-Instruct-Gradient-4194k) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
15
  Refer to the [original model card](https://huggingface.co/gradientai/Llama-3-8B-Instruct-Gradient-4194k) for more details on the model.
16
 
 
11
  ---
12
 
13
  # leafspark/llama-3-8b-instruct-gradient-4194k.Q8_0-GGUF
14
+
15
+ # Please use iMatrix quants to avoid any output issues, currently debugging the issue
16
+
17
  This model was converted to GGUF format from [`gradientai/Llama-3-8B-Instruct-Gradient-4194k`](https://huggingface.co/gradientai/Llama-3-8B-Instruct-Gradient-4194k) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
18
  Refer to the [original model card](https://huggingface.co/gradientai/Llama-3-8B-Instruct-Gradient-4194k) for more details on the model.
19