robbiemu
/

salamandra-2b-instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

robbiemu commited on 24 days ago

Commit

d40467d

•

1 Parent(s): 594a804

minor language change

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -44,7 +44,7 @@ source repo: [BSC-LT/salamandra](https://huggingface.co/BSC-LT/salamandra-2b)
 # Quantization summary
-| **Quantization Type** | **PPL(Q)** | **Log PPL Difference** | **File Size (G)** | **Notes**                                                      |
 |-----------------------|------------|------------------------|-------------------|----------------------------------------------------------------|
 | [**IQ3_M**](salamandra-2b-instruct_IQ3_M.gguf)             | 16.774     | 0.086769               | 1.7               | Good size efficiency with acceptable PPL increase              |
 | [**Q3_K_L**](salamandra-2b-instruct_Q3_K_L.gguf)            | 16.5067    | 0.070705               | 1.8               | Further size reduction with modest PPL increase                |

 # Quantization summary
+| **Quantization Type** | **PPL(Q)** | **ln(PPL(Q)/PPL(bf16))** | **File Size (G)** | **Notes**                                                      |
 |-----------------------|------------|------------------------|-------------------|----------------------------------------------------------------|
 | [**IQ3_M**](salamandra-2b-instruct_IQ3_M.gguf)             | 16.774     | 0.086769               | 1.7               | Good size efficiency with acceptable PPL increase              |
 | [**Q3_K_L**](salamandra-2b-instruct_Q3_K_L.gguf)            | 16.5067    | 0.070705               | 1.8               | Further size reduction with modest PPL increase                |