Update README.md
Browse files
README.md
CHANGED
@@ -37,7 +37,7 @@ And decimal points are critical to model performance.
|
|
37 |
|
38 |
SMALL?
|
39 |
|
40 |
-
Yes... but
|
41 |
|
42 |
<B>The result:</b>
|
43 |
|
@@ -50,7 +50,7 @@ At Q4KM a whopping drop of 976 points in perplexity.
|
|
50 |
At Q6 an awesome drop of 234 points in perplexity.
|
51 |
(VS: Q6 original base model -> PPL = 8.6070 +/- 0.05907 )
|
52 |
|
53 |
-
To put this in perspective "Q6" now operates ABOVE the
|
54 |
and Q4KM operates at close to Q6 level quality.
|
55 |
|
56 |
This because at "Q6" the quant / compressed model is considered to be accurate within "+0.0008 ppl" of the full,
|
@@ -104,7 +104,7 @@ Imatrix Plus repo (with the same floating 32 enhancement at "reg quant plus") th
|
|
104 |
Imatrix Depo is here: [ https://huggingface.co/DavidAU/Psyonic-Cetacean-Ultra-Quality-20b-GGUF-imatrix ]
|
105 |
|
106 |
Details of all methods (and pitfalls to avoid) employed to make this high precision remasters will be
|
107 |
-
posted shortly along with
|
108 |
|
109 |
Thanks again to Jeb Carter, the original creator of "Psyonic-Cetacean 20B"
|
110 |
|
|
|
37 |
|
38 |
SMALL?
|
39 |
|
40 |
+
Yes... but multiplied by each merge(s), and compression(s): 20 billion times.
|
41 |
|
42 |
<B>The result:</b>
|
43 |
|
|
|
50 |
At Q6 an awesome drop of 234 points in perplexity.
|
51 |
(VS: Q6 original base model -> PPL = 8.6070 +/- 0.05907 )
|
52 |
|
53 |
+
To put this in perspective "Q6" now operates ABOVE the original full precision version of "Psyonic-Cetacean-20b"
|
54 |
and Q4KM operates at close to Q6 level quality.
|
55 |
|
56 |
This because at "Q6" the quant / compressed model is considered to be accurate within "+0.0008 ppl" of the full,
|
|
|
104 |
Imatrix Depo is here: [ https://huggingface.co/DavidAU/Psyonic-Cetacean-Ultra-Quality-20b-GGUF-imatrix ]
|
105 |
|
106 |
Details of all methods (and pitfalls to avoid) employed to make this high precision remasters will be
|
107 |
+
posted shortly along with comparison of original model and new ultra remaster.
|
108 |
|
109 |
Thanks again to Jeb Carter, the original creator of "Psyonic-Cetacean 20B"
|
110 |
|