Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Mistral-7B-v0.2-GGUF
like
3
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
pretrained
7b
arxiv:2310.06825
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
Mistral-7B-v0.2-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
b90bf635b42d45cbe07359a66c6437f6a20c550d1f92457398275667ffdd34c4
adab292
verified
8 months ago
.gitattributes
2.22 kB
a4f2e9a62cc7c8f1505decb19a90ac1f5da73696e434dbb33a02666521324ace
8 months ago
Mistral-7B-v0.2.IQ4_XS.gguf
3.94 GB
LFS
13c47bae21fec616a74171211916e34a60818aaa4591dc13b9977b9b0ddcda53
8 months ago
Mistral-7B-v0.2.Q2_K.gguf
2.72 GB
LFS
6d89c11cb0d5822cf8c8f9ae4fd0013c88d6fd0bd450c1dc295c82c6c9e61cc7
8 months ago
Mistral-7B-v0.2.Q3_K_L.gguf
3.82 GB
LFS
758d66786b68b60125fcd1c5765197174fa3672e125d56441e7f902bfc8e189b
8 months ago
Mistral-7B-v0.2.Q3_K_M.gguf
3.52 GB
LFS
24880baab378f709eb3fbc3a4090bcb9a7ab35e44a57b4938e200fda6270e890
8 months ago
Mistral-7B-v0.2.Q3_K_S.gguf
3.16 GB
LFS
10e18ba5cf194ad1db96b6023a02da08733f65fbd1e767a78275c9102909219e
8 months ago
Mistral-7B-v0.2.Q4_K_M.gguf
4.37 GB
LFS
3358d4808718ada59578f9c00e5852e01bb3dfacc649d95cc778bfdd5be9d529
8 months ago
Mistral-7B-v0.2.Q4_K_S.gguf
4.14 GB
LFS
ba48914e1efe4aa859b9bdc6e95085e82a7fc2e093a638733dd0e93c28111bf6
8 months ago
Mistral-7B-v0.2.Q5_K_M.gguf
5.13 GB
LFS
30e0d52a407a97a86d3606411197f30180eda47a40ed7decf9a817de4db2c29a
8 months ago
Mistral-7B-v0.2.Q5_K_S.gguf
5 GB
LFS
eb0a80615e97b91bb2e2abf71a27acd2b07ea6a9f9061a9fa63bdf73dffcad22
8 months ago
Mistral-7B-v0.2.Q6_K.gguf
5.94 GB
LFS
191d4cbbe2d0fc448e9bf787fa1848efd261e2f2586cc2e566e1d5679b979acb
8 months ago
Mistral-7B-v0.2.Q8_0.gguf
7.7 GB
LFS
a4f2e9a62cc7c8f1505decb19a90ac1f5da73696e434dbb33a02666521324ace
8 months ago
README.md
10.9 kB
b90bf635b42d45cbe07359a66c6437f6a20c550d1f92457398275667ffdd34c4
8 months ago