Hugging Face's logo

knifeayumu
/
Lite-Cydonia-22B-v1.1-75-25-GGUF

Transformers
GGUF
English
Inference Endpoints
conversational
Model card Files Community
Edit model card

Llamacpp Quantizations of knifeayumu/Lite-Cydonia-22B-v1.1-75-25

Using llama.cpp release b3837 for quantization.

Original model: knifeayumu/Lite-Cydonia-22B-v1.1-75-25

Quant Types:

Filename Quant type File Size
Lite-Cydonia-22B-v1.1-75-25-F16.gguf F16 41.4GB
Lite-Cydonia-22B-v1.1-75-25-Q8_0.gguf Q8_0 22.0GB
Lite-Cydonia-22B-v1.1-75-25-Q6_K.gguf Q6_K 16.9GB
Lite-Cydonia-22B-v1.1-75-25-Q5_K_M.gguf Q5_K_M 14.6GB
Lite-Cydonia-22B-v1.1-75-25-Q5_K_S.gguf Q5_K_S 14.2GB
Lite-Cydonia-22B-v1.1-75-25-Q4_K_M.gguf Q4_K_M 12.4GB
Lite-Cydonia-22B-v1.1-75-25-Q4_K_S.gguf Q4_K_S 11.7GB
Lite-Cydonia-22B-v1.1-75-25-Q3_K_L.gguf Q3_K_L 10.9GB
Lite-Cydonia-22B-v1.1-75-25-Q3_K_M.gguf Q3_K_M 10.0GB
Lite-Cydonia-22B-v1.1-75-25-Q3_K_S.gguf Q3_K_S 8.97GB
Lite-Cydonia-22B-v1.1-75-25-Q2_K.gguf Q2_K 7.70GB
Downloads last month
68
GGUF
Model size
22.2B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference API
Unable to determine this model’s pipeline type. Check the docs .

Model tree for knifeayumu/Lite-Cydonia-22B-v1.1-75-25-GGUF

Base model

knifeayumu/Lite-Cydonia-22B-v1.1-75-25
Quantized
(3)
this model

Collection including knifeayumu/Lite-Cydonia-22B-v1.1-75-25-GGUF