4-bit GPTQ quantized version of Qwen2.5-Coder-1.5B-Instruct for use with the Private LLM app.
Base model