Hugging Face's logo

ggml-org
/
SmolVLM2-2.2B-Instruct-GGUF

GGUF
conversational
Model card Files
xet
Community
2

SmolVLM2-2.2B-Instruct

Original model: https://huggingface.co/HuggingFaceTB/SmolVLM2-2.2B-Instruct

For more info, please refer to this PR: https://github.com/ggml-org/llama.cpp/pull/13050

Downloads last month
5,864
GGUF
Model size
2B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

4-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ggml-org/SmolVLM2-2.2B-Instruct-GGUF

Base model

HuggingFaceTB/SmolLM2-1.7B
Quantized
HuggingFaceTB/SmolLM2-1.7B-Instruct
Quantized
HuggingFaceTB/SmolVLM-Instruct
Finetuned
HuggingFaceTB/SmolVLM2-2.2B-Instruct
Quantized
(7)
this model

Space using ggml-org/SmolVLM2-2.2B-Instruct-GGUF 1

Collection including ggml-org/SmolVLM2-2.2B-Instruct-GGUF