Hugging Face's logo

knifeayumu
/
Lite-Cydonia-22B-v1.1-75-25-GGUF

Transformers
GGUF
English
Inference Endpoints
conversational
Model card Files Community
knifeayumu commited on
Commit
e5cf134
•
1 Parent(s): b05eade

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -14
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  base_model:
3
- - knifeayumu/Lite-Cydonia-22B-v1.1
4
  language:
5
  - en
6
  library_name: transformers
@@ -8,25 +8,25 @@ license: other
8
  quantized_by: knifeayumu
9
  ---
10
 
11
- ## Llamacpp Quantizations of knifeayumu/Lite-Cydonia-22B-v1.1
12
 
13
  Using [llama.cpp](https://github.com/ggerganov/llama.cpp/) release [b3837](https://github.com/ggerganov/llama.cpp/releases/tag/b3837) for quantization.
14
 
15
- Original model: [knifeayumu/Lite-Cydonia-22B-v1.1](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1)
16
 
17
 
18
  ## Quant Types:
19
 
20
  | Filename | Quant type | File Size |
21
  | -------- | ---------- | --------- |
22
- | [Lite-Cydonia-22B-v1.1-F16.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-F16.gguf) | F16 | 41.4GB |
23
- | [Lite-Cydonia-22B-v1.1-Q8_0.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-Q8_0.gguf) | Q8_0 | 22.0GB |
24
- | [Lite-Cydonia-22B-v1.1-Q6_K.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-Q6_K.gguf) | Q6_K | 16.9GB |
25
- | [Lite-Cydonia-22B-v1.1-Q5_K_M.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-Q5_K_M.gguf) | Q5_K_M | 14.6GB |
26
- | [Lite-Cydonia-22B-v1.1-Q5_K_S.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-Q5_K_S.gguf) | Q5_K_S | 14.2GB |
27
- | [Lite-Cydonia-22B-v1.1-Q4_K_M.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-Q4_K_M.gguf) | Q4_K_M | 12.4GB |
28
- | [Lite-Cydonia-22B-v1.1-Q4_K_S.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-Q4_K_S.gguf) | Q4_K_S | 11.7GB |
29
- | [Lite-Cydonia-22B-v1.1-Q3_K_L.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-Q3_K_L.gguf) | Q3_K_L | 10.9GB |
30
- | [Lite-Cydonia-22B-v1.1-Q3_K_M.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-Q3_K_M.gguf) | Q3_K_M | 10.0GB |
31
- | [Lite-Cydonia-22B-v1.1-Q3_K_S.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-Q3_K_S.gguf) | Q3_K_S | 8.97GB |
32
- | [Lite-Cydonia-22B-v1.1-Q2_K.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-Q2_K.gguf) | Q2_K | 7.70GB |
 
1
  ---
2
  base_model:
3
+ - knifeayumu/Lite-Cydonia-22B-v1.1-75-25
4
  language:
5
  - en
6
  library_name: transformers
 
8
  quantized_by: knifeayumu
9
  ---
10
 
11
+ ## Llamacpp Quantizations of knifeayumu/Lite-Cydonia-22B-v1.1-75-25
12
 
13
  Using [llama.cpp](https://github.com/ggerganov/llama.cpp/) release [b3837](https://github.com/ggerganov/llama.cpp/releases/tag/b3837) for quantization.
14
 
15
+ Original model: [knifeayumu/Lite-Cydonia-22B-v1.1-75-25](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-75-25)
16
 
17
 
18
  ## Quant Types:
19
 
20
  | Filename | Quant type | File Size |
21
  | -------- | ---------- | --------- |
22
+ | [Lite-Cydonia-22B-v1.1-75-25-F16.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-75-25-F16.gguf) | F16 | 41.4GB |
23
+ | [Lite-Cydonia-22B-v1.1-75-25-Q8_0.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-75-25-Q8_0.gguf) | Q8_0 | 22.0GB |
24
+ | [Lite-Cydonia-22B-v1.1-75-25-Q6_K.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-75-25-Q6_K.gguf) | Q6_K | 16.9GB |
25
+ | [Lite-Cydonia-22B-v1.1-75-25-Q5_K_M.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-75-25-Q5_K_M.gguf) | Q5_K_M | 14.6GB |
26
+ | [Lite-Cydonia-22B-v1.1-75-25-Q5_K_S.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-75-25-Q5_K_S.gguf) | Q5_K_S | 14.2GB |
27
+ | [Lite-Cydonia-22B-v1.1-75-25-Q4_K_M.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-75-25-Q4_K_M.gguf) | Q4_K_M | 12.4GB |
28
+ | [Lite-Cydonia-22B-v1.1-75-25-Q4_K_S.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-75-25-Q4_K_S.gguf) | Q4_K_S | 11.7GB |
29
+ | [Lite-Cydonia-22B-v1.1-75-25-Q3_K_L.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-75-25-Q3_K_L.gguf) | Q3_K_L | 10.9GB |
30
+ | [Lite-Cydonia-22B-v1.1-75-25-Q3_K_M.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-75-25-Q3_K_M.gguf) | Q3_K_M | 10.0GB |
31
+ | [Lite-Cydonia-22B-v1.1-75-25-Q3_K_S.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-75-25-Q3_K_S.gguf) | Q3_K_S | 8.97GB |
32
+ | [Lite-Cydonia-22B-v1.1-75-25-Q2_K.gguf](https://huggingface.co/knifeayumu/Lite-Cydonia-22B-v1.1-75-25-Q2_K.gguf) | Q2_K | 7.70GB |