Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
mobiuslabsgmbh
/
Mixtral-8x7B-Instruct-v0.1-hf-4bit_g64-HQQ
like
9
Follow
Mobius Labs GmbH
53
Text Generation
Transformers
mixtral
Mixture of Experts
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
4
Train
Deploy
Use this model
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (1)
Serving with TGI or vLLM?
1
#3 opened 11 months ago by
kno10
only use one gpu?
2
#2 opened 11 months ago by
jgbrblmd
persist dequantized model
1
#1 opened 11 months ago by
nudelbrot