Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
YamT3qm7x-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
e56a7cb
YamT3qm7x-7B-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
2c73ba2629a8a3961451eb2c9622937106cc6f4a3d7a2e2d13cc756eac64e1f4
e56a7cb
verified
8 months ago
.gitattributes
1.94 kB
2c73ba2629a8a3961451eb2c9622937106cc6f4a3d7a2e2d13cc756eac64e1f4
8 months ago
YamT3qm7x-7B.IQ3_XS.gguf
3.02 GB
LFS
b518f12afc85168fb9dc6ff0157fa628bbae95edac89c597cd6b5b844e6f6277
8 months ago
YamT3qm7x-7B.IQ4_XS.gguf
3.94 GB
LFS
64fc84d7c85ba3f4f607020ec282becec31b70c547fec469f765390dd3776295
8 months ago
YamT3qm7x-7B.Q2_K.gguf
2.72 GB
LFS
f369624d40028f49a033825d79d2235cadbf7265e863aad2c2aa354b8fd65dec
8 months ago
YamT3qm7x-7B.Q3_K_L.gguf
3.82 GB
LFS
d94fc30da707fc8e526937ba8644fb4e5b56b9c85484f1277f3701cd5b1fdb8e
8 months ago
YamT3qm7x-7B.Q3_K_M.gguf
3.52 GB
LFS
a9a8f899e92c6e16a90c74250afb02e3d801c078d23df9d48c97c19999199530
8 months ago
YamT3qm7x-7B.Q3_K_S.gguf
3.16 GB
LFS
0da9b1f6a6f713c3f2e656479ebd0f2bc1fa2f935811a8a476fbb9dda51134bc
8 months ago
YamT3qm7x-7B.Q4_K_M.gguf
4.37 GB
LFS
2c73ba2629a8a3961451eb2c9622937106cc6f4a3d7a2e2d13cc756eac64e1f4
8 months ago
