Hugging Face's logo

iproskurina
/
Mistral-7B-v0.3-GPTQ2-4bit-g2

Text Generation
Transformers
mistral
Inference Endpoints
4-bit precision
gptq
Model card Files Community
Mistral-7B-v0.3-GPTQ2-4bit-g2

Commit History

AutoGPTQ model for mistralai/Mistral-7B-v0.3: 4 bits, gr128, desc_act=False
a6bac73
verified

iproskurina commited on

AutoGPTQ model for mistralai/Mistral-7B-v0.3: 4 bits, gr128, desc_act=False
98bd840
verified

iproskurina commited on

initial commit
b345a22
verified

iproskurina commited on