Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

GGUF quants of Replete-LLM-V2.5-Qwen-3b

Downloads last month
11
GGUF
Model size
3.4B params
Architecture
qwen2

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .