Q5_K_M

#2
by Herman555 - opened

Can you upload Q5_K_M?, would greatly appreciate it. Been enjoying the other merge and want to try this too. Thanks for your work.

@Herman555 I have here: https://huggingface.co/SilverFan/Llama-3-LewdPlay-8B-evo-Q5_K_M-GGUF
Should be some imatrix quaints around too

Herman555 changed discussion status to closed

Sign up or log in to comment