Natkituwu
/

mistral-doryV2-12b-6.9bpw-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Natkituwu commited on Jul 22

Commit

c9dfeda

•

1 Parent(s): ae648e4

Update README.md

Files changed (1) hide show

README.md +3 -0

README.md CHANGED Viewed

@@ -7,6 +7,9 @@ language:
 - en
 library_name: transformers
 ---
 # Dory 12b (v2)
 (redone) redone instruct finetune of mistral nemo 12b's base. *not* (E)RP-focused, leave that to drummer.

 - en
 library_name: transformers
 ---
+6.9bpw (nice) h8 exl2 quant of (https://huggingface.co/BeaverAI/mistral-doryV2-12b)
 # Dory 12b (v2)
 (redone) redone instruct finetune of mistral nemo 12b's base. *not* (E)RP-focused, leave that to drummer.