mradermacher
/

Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT-DPO-GGUF

Inference Endpoints

Model card Files Files and versions Community

mradermacher commited on Aug 13

Commit

c41af6b

•

1 Parent(s): 05702a2

auto-patch README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ tags: []
 static quants of https://huggingface.co/Na0s/Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT-DPO
 <!-- provided-files -->
-weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
 ## Usage
 If you are unsure how to use GGUF files, refer to one of [TheBloke's

 static quants of https://huggingface.co/Na0s/Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT-DPO
 <!-- provided-files -->
+weighted/imatrix quants are available at https://huggingface.co/mradermacher/Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT-DPO-i1-GGUF
 ## Usage
 If you are unsure how to use GGUF files, refer to one of [TheBloke's