second-state
/

gemma-1.1-7b-it-GGUF

Model card Files Files and versions Community

Xin Liu commited on Apr 11

Commit

c3b0d53

•

1 Parent(s): 2a2757f

Update

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -73,6 +73,6 @@ quantized_by: Second State Inc.
 | [gemma-1.1-7b-it-Q5_K_S.gguf](https://huggingface.co/second-state/gemma-1.1-7b-it-GGUF/blob/main/gemma-1.1-7b-it-Q5_K_S.gguf) | Q5_K_S | 5 | 5.98 GB| large, low quality loss - recommended |
 | [gemma-1.1-7b-it-Q6_K.gguf](https://huggingface.co/second-state/gemma-1.1-7b-it-GGUF/blob/main/gemma-1.1-7b-it-Q6_K.gguf)     | Q6_K   | 6 | 7.01 GB| very large, extremely low quality loss |
 | [gemma-1.1-7b-it-Q8_0.gguf](https://huggingface.co/second-state/gemma-1.1-7b-it-GGUF/blob/main/gemma-1.1-7b-it-Q8_0.gguf)     | Q8_0   | 8 | 9.08 GB| very large, extremely low quality loss - not recommended |
-| [gemma-1.1-7b-it-f16.gguf](https://huggingface.co/second-state/gemma-1.1-7b-it-GGUF/blob/main/gemma-1.1-7b-it-f16.gguf)     | f16   | 16 | 34.2 GB|  |
 *Quantized with llama.cpp b2589*

 | [gemma-1.1-7b-it-Q5_K_S.gguf](https://huggingface.co/second-state/gemma-1.1-7b-it-GGUF/blob/main/gemma-1.1-7b-it-Q5_K_S.gguf) | Q5_K_S | 5 | 5.98 GB| large, low quality loss - recommended |
 | [gemma-1.1-7b-it-Q6_K.gguf](https://huggingface.co/second-state/gemma-1.1-7b-it-GGUF/blob/main/gemma-1.1-7b-it-Q6_K.gguf)     | Q6_K   | 6 | 7.01 GB| very large, extremely low quality loss |
 | [gemma-1.1-7b-it-Q8_0.gguf](https://huggingface.co/second-state/gemma-1.1-7b-it-GGUF/blob/main/gemma-1.1-7b-it-Q8_0.gguf)     | Q8_0   | 8 | 9.08 GB| very large, extremely low quality loss - not recommended |
+| [gemma-1.1-7b-it-f16.gguf](https://huggingface.co/second-state/gemma-1.1-7b-it-GGUF/blob/main/gemma-1.1-7b-it-f16.gguf)     | f16   | 16 | 17.1 GB|  |
 *Quantized with llama.cpp b2589*