Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
MixTAO-7Bx2-MoE-v8.1-GGUF
like
11
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mixtral
Mixture of Experts
Eval Results
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
6
Train
Deploy
Use this model
d1347f5
MixTAO-7Bx2-MoE-v8.1-GGUF
1 contributor
History:
5 commits
MaziyarPanahi
7d30544dc3151f94fdae758f7419c7aaba7fe15a33a4e8c65dd7850e0509163c
d1347f5
verified
8 months ago
.gitattributes
1.79 kB
7d30544dc3151f94fdae758f7419c7aaba7fe15a33a4e8c65dd7850e0509163c
8 months ago
MixTAO-7Bx2-MoE-v8.1.IQ4_XS.gguf
6.98 GB
LFS
4b28163765d2a5c315bdcaa3301cf38dfb14b26e7c5e99ecf78f794edd8dab34
8 months ago
MixTAO-7Bx2-MoE-v8.1.Q2_K.gguf
4.76 GB
LFS
8d47b9c5385a2dc8eb2c9be88206ebfb69b1dc76bd096d796762c6bfb82a5421
8 months ago
MixTAO-7Bx2-MoE-v8.1.Q3_K_L.gguf
6.73 GB
LFS
fbbc5d324ce0fc2bc49486dfc969642c072e64ccb8fc450d227eed2ed9448812
8 months ago
MixTAO-7Bx2-MoE-v8.1.Q3_K_M.gguf
6.21 GB
LFS
7d30544dc3151f94fdae758f7419c7aaba7fe15a33a4e8c65dd7850e0509163c
8 months ago
