Quantized GGUF models for QwQ-0.5B-Distilled

Downloads last month: 186

GGUF

Model size

494M params

Architecture

qwen2

16-bit

View +1 file

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for kz919/QwQ-0.5B-Distilled-gguf

Base model

Qwen/Qwen2.5-0.5B

Finetuned

Qwen/Qwen2.5-0.5B-Instruct

Quantized

(79)

this model

kz919
/

QwQ-0.5B-Distilled-gguf

Model tree for kz919/QwQ-0.5B-Distilled-gguf

Dataset used to train kz919/QwQ-0.5B-Distilled-gguf