Darkknight535
/

magnum-v2-72b-exl2-2.75bpw

Text Generation

Model card Files Files and versions Community

Darkknight535 commited on Oct 10, 2024

Commit

b21fa0c

·

verified ·

1 Parent(s): c4c8d8d

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -27,7 +27,7 @@
     "quantization_config": {
         "quant_method": "exl2",
         "version": "0.1.8",
-        "bits": 3.0,
         "head_bits": 6,
         "calibration": {
             "rows": 115,

     "quantization_config": {
         "quant_method": "exl2",
         "version": "0.1.8",
+        "bits": 2.75,
         "head_bits": 6,
         "calibration": {
             "rows": 115,