Update README.md
Browse files
README.md
CHANGED
@@ -1,7 +1,7 @@
|
|
1 |
---
|
2 |
license: llama2
|
3 |
---
|
4 |
-
EXL2 quant of alpindale/goliath-120b (https://huggingface.co/alpindale/goliath-120b), to be used on exllamav2. 4.25bpw to being to able to use CFG comfortably on 72GB VRAM.
|
5 |
|
6 |
Calibration dataset is a cleaned, fixed pippa RP dataset, which does affect the results (in favor) for RP usage.
|
7 |
|
|
|
1 |
---
|
2 |
license: llama2
|
3 |
---
|
4 |
+
EXL2 quant of alpindale/goliath-120b (https://huggingface.co/alpindale/goliath-120b), to be used on exllamav2. 4.25bpw to being to able to use CFG comfortably on 72GB VRAM. (20,21,22 for gpu split)
|
5 |
|
6 |
Calibration dataset is a cleaned, fixed pippa RP dataset, which does affect the results (in favor) for RP usage.
|
7 |
|