GGUFs of Llama-3-monika-ddlc-8b-v1. (Primarily tested and run with Koboldcpp v1.64.1+).

Downloads last month
138
GGUF
Model size
8.03B params
Architecture
llama

4-bit

5-bit

6-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .