duyntnet/EvolCodeLlama-7b-imatrix-GGUF

Quantizations of https://huggingface.co/mlabonne/EvolCodeLlama-7b

Inference Clients/UIs

• llama.cpp
• KoboldCPP
• text-generation-webui
• ollama

---

From original readme

This is a codellama/CodeLlama-7b-hf model fine-tuned using QLoRA (4-bit precision) on the mlabonne/Evol-Instruct-Python-1k.