GGUF llama.cpp quantized version of:
- Original model: Mistral-Small-3.2-24B-Instruct-2506
- Model creator: Mistral
- License
Recommended Prompt Format (mistral-v7-tekken)
<s>[SYSTEM_PROMPT]<system prompt>[/SYSTEM_PROMPT][INST]<user message>[/INST]<assistant response></s>[INST]<user message>[/INST]
- Downloads last month
- 72
Hardware compatibility
Log In
to view the estimation
4-bit
5-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support