Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
mergekit-ties-kkhkcqw-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
mergekit
Merge
arxiv:2306.01708
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
3d957ef
mergekit-ties-kkhkcqw-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
6b248a0cb6ca85a1c2a7061fe64153a738cb49008add983dc552b0b3a36c0d67
3d957ef
verified
5 months ago
.gitattributes
Safe
2.21 kB
6b248a0cb6ca85a1c2a7061fe64153a738cb49008add983dc552b0b3a36c0d67
5 months ago
mergekit-ties-kkhkcqw.Q2_K.gguf
Safe
2.53 GB
LFS
9a35f701f325f8e45884ccd222baf2fe6bcca4360aab5fdf939270598ea47600
5 months ago
mergekit-ties-kkhkcqw.Q3_K_L.gguf
Safe
3.6 GB
LFS
454a9ea3241d6bac4bef3b40819babd1695cd9f82f3e534723e58c489f485437
5 months ago
mergekit-ties-kkhkcqw.Q3_K_M.gguf
Safe
3.3 GB
LFS
32a231811a40368948b7e54f2ec439156f122e7fc91e33622942087830431c18
5 months ago
mergekit-ties-kkhkcqw.Q3_K_S.gguf
Safe
2.95 GB
LFS
db13eec7cff88f823c71b136e6805d8c6ae49415291b4314554e239776118249
5 months ago
mergekit-ties-kkhkcqw.Q4_K_M.gguf
Safe
4.08 GB
LFS
0d173f750dc101fe09a4144b9db6bd695b432a83f88d1e3b76a394d4bd97d898
5 months ago
mergekit-ties-kkhkcqw.Q4_K_S.gguf
Safe
3.86 GB
LFS
859cf2f0f1dbe57543837ebc55f7184f6e42bef7190b487fdfdda240cb407e13
5 months ago
mergekit-ties-kkhkcqw.Q5_K_M.gguf
Safe
4.78 GB
LFS
722a347aa12a1d5a22daae8a5a4462a6b4ceb1dc5708af799f8fdbd1d5dfb28b
5 months ago
mergekit-ties-kkhkcqw.Q5_K_S.gguf
Safe
4.65 GB
LFS
518a2f3452cf761d7ef0d30f674f9aa95b0dd08f85738dc6a3c43e93f05e1470
5 months ago
mergekit-ties-kkhkcqw.Q6_K.gguf
Safe
5.53 GB
LFS
1f72d73790e06d14fb861cf638e4b7e807185e150987ed6276e13b2beabb07fe
5 months ago
mergekit-ties-kkhkcqw.Q8_0.gguf
Safe
7.16 GB
LFS
6b248a0cb6ca85a1c2a7061fe64153a738cb49008add983dc552b0b3a36c0d67
5 months ago
