Hampetiudo
/

gemma-2-Ifable-9B-i1-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Hampetiudo commited on Sep 24

Commit

dd7f181

•

1 Parent(s): 8750c44

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -11,7 +11,7 @@ Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a
 Original model: https://huggingface.co/ifable/gemma-2-Ifable-9B
-All quants were made using the imatrix option (except BF16, that's the original model). The imatrix was generated with the dataset from [here](https://gist.github.com/tristandruyen/9e207a95c7d75ddf37525d353e00659c), using the BF16 GGUF with a context size of 8192 tokens (default is 512 but higher/same as model context size should improve quality) and 13 chunks.
 How to make your own quants:

 Original model: https://huggingface.co/ifable/gemma-2-Ifable-9B
+All quants were made using the imatrix option (except BF16, that's the original precision). The imatrix was generated with the dataset from [here](https://gist.github.com/tristandruyen/9e207a95c7d75ddf37525d353e00659c), using the BF16 GGUF with a context size of 8192 tokens (default is 512 but higher/same as model context size should improve quality) and 13 chunks.
 How to make your own quants: