mobiuslabsgmbh
/

Mixtral-8x7B-Instruct-v0.1-hf-2bit_g16_s128-HQQ

Text Generation

Mixture of Experts

Model card Files Files and versions Community

Resources

View closed (1)

New Exciting quant method

#3 opened 11 months ago by

KeyError: 'mixtral'

#2 opened 11 months ago by

How is the performance of the model with 2bits only?

#1 opened 11 months ago by