Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
YamT3qm7x-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
a15390e
YamT3qm7x-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
71bb02bbf26f29057296404a0369f4dd304531ab517284705c6dbbd6e3453d3f
a15390e
verified
8 months ago
.gitattributes
2.19 kB
19a7ea6690af0587f06d79c5b616b4fcef9ee222a69f30d110643fbf5df2ca11
8 months ago
README.md
10.8 kB
71bb02bbf26f29057296404a0369f4dd304531ab517284705c6dbbd6e3453d3f
8 months ago
YamT3qm7x-7B.IQ3_XS.gguf
3.02 GB
LFS
b518f12afc85168fb9dc6ff0157fa628bbae95edac89c597cd6b5b844e6f6277
8 months ago
YamT3qm7x-7B.IQ4_XS.gguf
3.94 GB
LFS
64fc84d7c85ba3f4f607020ec282becec31b70c547fec469f765390dd3776295
8 months ago
YamT3qm7x-7B.Q2_K.gguf
2.72 GB
LFS
f369624d40028f49a033825d79d2235cadbf7265e863aad2c2aa354b8fd65dec
8 months ago
YamT3qm7x-7B.Q3_K_L.gguf
3.82 GB
LFS
d94fc30da707fc8e526937ba8644fb4e5b56b9c85484f1277f3701cd5b1fdb8e
8 months ago
YamT3qm7x-7B.Q3_K_M.gguf
3.52 GB
LFS
a9a8f899e92c6e16a90c74250afb02e3d801c078d23df9d48c97c19999199530
8 months ago
YamT3qm7x-7B.Q3_K_S.gguf
3.16 GB
LFS
0da9b1f6a6f713c3f2e656479ebd0f2bc1fa2f935811a8a476fbb9dda51134bc
8 months ago
YamT3qm7x-7B.Q4_K_M.gguf
4.37 GB
LFS
2c73ba2629a8a3961451eb2c9622937106cc6f4a3d7a2e2d13cc756eac64e1f4
8 months ago
YamT3qm7x-7B.Q4_K_S.gguf
4.14 GB
LFS
008bedfcde074b380d421f48182989867142e8f5121588c105132adc232511d7
8 months ago
YamT3qm7x-7B.Q5_K_M.gguf
5.13 GB
LFS
fc7830c22eb6cc2ae69b70b8f0382c7c3044db3f0710b990af34a9b185721091
8 months ago
YamT3qm7x-7B.Q5_K_S.gguf
5 GB
LFS
c914b2d23ee4c5220f1e217f2d47b7b42554ec90d952ebe594c76ea33c0fa1ea
8 months ago
YamT3qm7x-7B.Q6_K.gguf
5.94 GB
LFS
19a7ea6690af0587f06d79c5b616b4fcef9ee222a69f30d110643fbf5df2ca11
8 months ago