Update README.md
Browse files
README.md
CHANGED
@@ -113,11 +113,11 @@ AMD64.
|
|
113 |
|
114 |
## About Quantization Formats
|
115 |
|
116 |
-
This model works
|
117 |
-
|
118 |
-
|
119 |
aistudio.google.com. If you encounter any divergences, then try using
|
120 |
-
the BF16 weights, which have the original fidelity.
|
121 |
|
122 |
---
|
123 |
|
|
|
113 |
|
114 |
## About Quantization Formats
|
115 |
|
116 |
+
This model works well with any quantization format. Q6\_K is the best
|
117 |
+
choice overall. We tested that it's able to produce identical responses
|
118 |
+
to the Gemma2 27B model that's hosted by Google themselves on
|
119 |
aistudio.google.com. If you encounter any divergences, then try using
|
120 |
+
the BF16 weights, which have the original fidelity.
|
121 |
|
122 |
---
|
123 |
|