R136a1
/

MM-ReMM-L2-20B-exl2

Text Generation

Inference Endpoints

Model card Files Files and versions Community

R136a1 commited on Oct 17, 2023

Commit

b5e78cf

•

1 Parent(s): d7e6d06

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -9,13 +9,13 @@ language:
 ## Model details
-Quantized at 3.18bpw with hb 6, This one can actually go full 4K context on 16GB VRAM, will redo the other 20b models later
 Perplexity:
 Base = 6.9504
-3.23 h8 = 7.0138
 Dataset = [wikitext](https://huggingface.co/datasets/wikitext/resolve/refs%2Fconvert%2Fparquet/wikitext-2-v1/test/0000.parquet)

 ## Model details
+Quantized at 3.18bpw with hb 6, This one can actually go full 4K context on 16GB VRAM, will redo the other 20b models later.
 Perplexity:
 Base = 6.9504
+3.18 h6 = 7.0138
 Dataset = [wikitext](https://huggingface.co/datasets/wikitext/resolve/refs%2Fconvert%2Fparquet/wikitext-2-v1/test/0000.parquet)