iMatrix GGUFs for https://huggingface.co/BeaverAI/mistral-dory-12b

imat generated using Kalomaze's groups-merged.txt

Downloads last month
31
GGUF
Model size
12.2B params
Architecture
llama
Inference API
Unable to determine this model’s pipeline type. Check the docs .

Model tree for MarsupialAI/Mistral-Dory-12B_iMatrix_GGUF

Quantized
(54)
this model