Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen1.5-8x7b-v0.1-GGUF
like
6
Text Generation
Transformers
GGUF
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mixtral
axolotl
Generated from Trainer
Mixture of Experts
qwen
text-generation-inference
conversational
dataset:Crystalcareai/MoD-150k
Inference Endpoints
License:
tongyi-qianwen
Model card
Files
Files and versions
Community
6
Train
Deploy
Use this model
d66e598
Qwen1.5-8x7b-v0.1-GGUF
1 contributor
History:
4 commits
MaziyarPanahi
6153d909ab12183a001bc207cb11c7a27060fa8ef32ceaeb40a170de902d17bc
d66e598
verified
7 months ago
.gitattributes
1.72 kB
6153d909ab12183a001bc207cb11c7a27060fa8ef32ceaeb40a170de902d17bc
7 months ago
Qwen1.5-8x7b-v0.1.Q2_K.gguf
14.9 GB
LFS
2a502d29eefcf1d562d5d63cceea41d05914c2c2fd58e6008e6160febfdf2101
7 months ago
Qwen1.5-8x7b-v0.1.Q3_K_L.gguf
20.2 GB
LFS
183ff2a97e31b2ec4cb531a2af793e297fa2560cd4e196e83b7689ea0f478f4a
7 months ago
Qwen1.5-8x7b-v0.1.Q3_K_M.gguf
19 GB
LFS
6153d909ab12183a001bc207cb11c7a27060fa8ef32ceaeb40a170de902d17bc
7 months ago