legraphista
commited on
Commit
β’
ef19676
1
Parent(s):
d5aca60
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -59,7 +59,7 @@ Link: [here](https://huggingface.co/legraphista/Higgs-Llama-3-70B-IMat-GGUF/blob
|
|
59 |
| [Higgs-Llama-3-70B.Q6_K/*](https://huggingface.co/legraphista/Higgs-Llama-3-70B-IMat-GGUF/tree/main/Higgs-Llama-3-70B.Q6_K) | Q6_K | 57.89GB | β
Available | βͺ Static | β Yes
|
60 |
| [Higgs-Llama-3-70B.Q4_K.gguf](https://huggingface.co/legraphista/Higgs-Llama-3-70B-IMat-GGUF/blob/main/Higgs-Llama-3-70B.Q4_K.gguf) | Q4_K | 42.52GB | β
Available | π’ IMatrix | π¦ No
|
61 |
| [Higgs-Llama-3-70B.Q3_K.gguf](https://huggingface.co/legraphista/Higgs-Llama-3-70B-IMat-GGUF/blob/main/Higgs-Llama-3-70B.Q3_K.gguf) | Q3_K | 34.27GB | β
Available | π’ IMatrix | π¦ No
|
62 |
-
| Higgs-Llama-3-70B.Q2_K | Q2_K |
|
63 |
|
64 |
|
65 |
### All Quants
|
@@ -82,7 +82,7 @@ Link: [here](https://huggingface.co/legraphista/Higgs-Llama-3-70B-IMat-GGUF/blob
|
|
82 |
| Higgs-Llama-3-70B.IQ3_S | IQ3_S | - | β³ Processing | π’ IMatrix | -
|
83 |
| Higgs-Llama-3-70B.IQ3_XS | IQ3_XS | - | β³ Processing | π’ IMatrix | -
|
84 |
| Higgs-Llama-3-70B.IQ3_XXS | IQ3_XXS | - | β³ Processing | π’ IMatrix | -
|
85 |
-
| Higgs-Llama-3-70B.Q2_K | Q2_K |
|
86 |
| Higgs-Llama-3-70B.Q2_K_S | Q2_K_S | - | β³ Processing | π’ IMatrix | -
|
87 |
| Higgs-Llama-3-70B.IQ2_M | IQ2_M | - | β³ Processing | π’ IMatrix | -
|
88 |
| Higgs-Llama-3-70B.IQ2_S | IQ2_S | - | β³ Processing | π’ IMatrix | -
|
|
|
59 |
| [Higgs-Llama-3-70B.Q6_K/*](https://huggingface.co/legraphista/Higgs-Llama-3-70B-IMat-GGUF/tree/main/Higgs-Llama-3-70B.Q6_K) | Q6_K | 57.89GB | β
Available | βͺ Static | β Yes
|
60 |
| [Higgs-Llama-3-70B.Q4_K.gguf](https://huggingface.co/legraphista/Higgs-Llama-3-70B-IMat-GGUF/blob/main/Higgs-Llama-3-70B.Q4_K.gguf) | Q4_K | 42.52GB | β
Available | π’ IMatrix | π¦ No
|
61 |
| [Higgs-Llama-3-70B.Q3_K.gguf](https://huggingface.co/legraphista/Higgs-Llama-3-70B-IMat-GGUF/blob/main/Higgs-Llama-3-70B.Q3_K.gguf) | Q3_K | 34.27GB | β
Available | π’ IMatrix | π¦ No
|
62 |
+
| [Higgs-Llama-3-70B.Q2_K.gguf](https://huggingface.co/legraphista/Higgs-Llama-3-70B-IMat-GGUF/blob/main/Higgs-Llama-3-70B.Q2_K.gguf) | Q2_K | 26.38GB | β
Available | π’ IMatrix | π¦ No
|
63 |
|
64 |
|
65 |
### All Quants
|
|
|
82 |
| Higgs-Llama-3-70B.IQ3_S | IQ3_S | - | β³ Processing | π’ IMatrix | -
|
83 |
| Higgs-Llama-3-70B.IQ3_XS | IQ3_XS | - | β³ Processing | π’ IMatrix | -
|
84 |
| Higgs-Llama-3-70B.IQ3_XXS | IQ3_XXS | - | β³ Processing | π’ IMatrix | -
|
85 |
+
| [Higgs-Llama-3-70B.Q2_K.gguf](https://huggingface.co/legraphista/Higgs-Llama-3-70B-IMat-GGUF/blob/main/Higgs-Llama-3-70B.Q2_K.gguf) | Q2_K | 26.38GB | β
Available | π’ IMatrix | π¦ No
|
86 |
| Higgs-Llama-3-70B.Q2_K_S | Q2_K_S | - | β³ Processing | π’ IMatrix | -
|
87 |
| Higgs-Llama-3-70B.IQ2_M | IQ2_M | - | β³ Processing | π’ IMatrix | -
|
88 |
| Higgs-Llama-3-70B.IQ2_S | IQ2_S | - | β³ Processing | π’ IMatrix | -
|