Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -25,7 +25,7 @@ IMatrix dataset: [here](https://gist.githubusercontent.com/legraphista/d6d93f1a2
|
|
25 |
## Files
|
26 |
|
27 |
### IMatrix
|
28 |
-
Status:
|
29 |
Link: [here](https://huggingface.co/legraphista/RoLlama2-7b-Base-IMat-GGUF/blob/main/imatrix.dat)
|
30 |
|
31 |
### Common Quants
|
@@ -42,9 +42,9 @@ Link: [here](https://huggingface.co/legraphista/RoLlama2-7b-Base-IMat-GGUF/blob/
|
|
42 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
43 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
44 |
| [RoLlama2-7b-Base.FP16.gguf](https://huggingface.co/legraphista/RoLlama2-7b-Base-IMat-GGUF/blob/main/RoLlama2-7b-Base.FP16.gguf) | F16 | 13.48GB | β
Available | No | π¦ No
|
45 |
-
| RoLlama2-7b-Base.BF16 | BF16 |
|
46 |
| [RoLlama2-7b-Base.Q5_K.gguf](https://huggingface.co/legraphista/RoLlama2-7b-Base-IMat-GGUF/blob/main/RoLlama2-7b-Base.Q5_K.gguf) | Q5_K | 4.78GB | β
Available | No | π¦ No
|
47 |
-
| RoLlama2-7b-Base.Q5_K_S | Q5_K_S |
|
48 |
| RoLlama2-7b-Base.Q4_K_S | Q4_K_S | - | β³ Processing | Yes | -
|
49 |
| RoLlama2-7b-Base.Q3_K_L | Q3_K_L | - | β³ Processing | Yes | -
|
50 |
| RoLlama2-7b-Base.Q3_K_S | Q3_K_S | - | β³ Processing | Yes | -
|
|
|
25 |
## Files
|
26 |
|
27 |
### IMatrix
|
28 |
+
Status: β
Available
|
29 |
Link: [here](https://huggingface.co/legraphista/RoLlama2-7b-Base-IMat-GGUF/blob/main/imatrix.dat)
|
30 |
|
31 |
### Common Quants
|
|
|
42 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
43 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
44 |
| [RoLlama2-7b-Base.FP16.gguf](https://huggingface.co/legraphista/RoLlama2-7b-Base-IMat-GGUF/blob/main/RoLlama2-7b-Base.FP16.gguf) | F16 | 13.48GB | β
Available | No | π¦ No
|
45 |
+
| [RoLlama2-7b-Base.BF16.gguf](https://huggingface.co/legraphista/RoLlama2-7b-Base-IMat-GGUF/blob/main/RoLlama2-7b-Base.BF16.gguf) | BF16 | 13.48GB | β
Available | No | π¦ No
|
46 |
| [RoLlama2-7b-Base.Q5_K.gguf](https://huggingface.co/legraphista/RoLlama2-7b-Base-IMat-GGUF/blob/main/RoLlama2-7b-Base.Q5_K.gguf) | Q5_K | 4.78GB | β
Available | No | π¦ No
|
47 |
+
| [RoLlama2-7b-Base.Q5_K_S.gguf](https://huggingface.co/legraphista/RoLlama2-7b-Base-IMat-GGUF/blob/main/RoLlama2-7b-Base.Q5_K_S.gguf) | Q5_K_S | 4.65GB | β
Available | No | π¦ No
|
48 |
| RoLlama2-7b-Base.Q4_K_S | Q4_K_S | - | β³ Processing | Yes | -
|
49 |
| RoLlama2-7b-Base.Q3_K_L | Q3_K_L | - | β³ Processing | Yes | -
|
50 |
| RoLlama2-7b-Base.Q3_K_S | Q3_K_S | - | β³ Processing | Yes | -
|