altomek
/

mistral-nemo-gutenberg-12B-v2-8bpw-EXL2

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

Edit model card

mistral-nemo-gutenberg-12B-v2

ExLlamav2 8 bpw quants of https://huggingface.co/nbeerbower/mistral-nemo-gutenberg-12B-v2

Downloads last month: 22

Inference Examples

Text Generation

Inference API (serverless) is not available, repository is disabled.

Model tree for altomek/mistral-nemo-gutenberg-12B-v2-8bpw-EXL2

Base model

winglian/m12b-20240721-test010

Finetuned

axolotl-ai-co/romulus-mistral-nemo-12b-simpo

Finetuned

nbeerbower/mistral-nemo-gutenberg-12B-v2

Quantized

this model

Dataset used to train altomek/mistral-nemo-gutenberg-12B-v2-8bpw-EXL2