Hugging Face's logo

mistralai
/
Mixtral-8x7B-Instruct-v0.1

Text Generation
Transformers
Safetensors
mixtral
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
238

run Mixtral_8x7b on cpu

#253
by rakmik - opened
Discussion
rakmik

https://github.com/kim90000/Mixtral-8x7b-AQLM-2Bit-1x16-hf-on-cpu/blob/main/succ_Mixtral_8x7b_AQLM_2Bit_1x16_hf%20(1).ipynb

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment