Lewdiculous
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -16,7 +16,7 @@ GGUF-IQ-Imatrix quants for [ChaoticNeutrals/Poppy_Porpoise-v0.4-L3-8B](https://h
|
|
16 |
> The recommended presets to use are **ChatML** format the based presets. <br>
|
17 |
> Read the model information information bellow. <br>
|
18 |
> Use the latest version of KoboldCpp. **Use the provided presets.** <br>
|
19 |
-
> This is all still highly experimental,
|
20 |
|
21 |
> [!NOTE]
|
22 |
> For **8GB VRAM** GPUs, I recommend the **Q4_K_M-imat** quant for up to 12288 context sizes.
|
|
|
16 |
> The recommended presets to use are **ChatML** format the based presets. <br>
|
17 |
> Read the model information information bellow. <br>
|
18 |
> Use the latest version of KoboldCpp. **Use the provided presets.** <br>
|
19 |
+
> This is all still highly experimental, let the authors know how it performs for you, feedback is more important than ever now.
|
20 |
|
21 |
> [!NOTE]
|
22 |
> For **8GB VRAM** GPUs, I recommend the **Q4_K_M-imat** quant for up to 12288 context sizes.
|