Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Calme-7B-Instruct-v0.5-GGUF
like
2
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Generated from Trainer
7b
calme
conversational
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
9bd0556
Calme-7B-Instruct-v0.5-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
55c4a322179037d5538b0188644d85a03a7f4a33e7a4121535ff364ab769a508
9bd0556
verified
8 months ago
.gitattributes
2.29 kB
9685f0317c4017856a7fac6d6469ce9a87a7e161844b259f69df343dc502f8a2
8 months ago
Calme-7B-Instruct-v0.5.IQ4_XS.gguf
3.94 GB
LFS
3d6c0d536a01e77744d7d6fb57bbfedef8521824439a4f04158c6e34df775ddf
8 months ago
Calme-7B-Instruct-v0.5.Q2_K.gguf
2.72 GB
LFS
5049c882f51e1aafdc2af8a54a06a6c5ab3cb6cb81559c7bc484fbaa0061ca7e
8 months ago
Calme-7B-Instruct-v0.5.Q3_K_L.gguf
3.82 GB
LFS
686a81b135720d7ac931167769c7da6f029ffc3452dc96e0821ebcb177fbb888
8 months ago
Calme-7B-Instruct-v0.5.Q3_K_M.gguf
3.52 GB
LFS
bc73b90f547e7def57523238cc4b45b911aec11bc9dc217e80fb21706b9a64e6
8 months ago
Calme-7B-Instruct-v0.5.Q3_K_S.gguf
3.16 GB
LFS
c1569134a09c418f5eff39ded704ce80c37407fb45ea22699b6fed4a42952dcf
8 months ago
Calme-7B-Instruct-v0.5.Q4_K_M.gguf
4.37 GB
LFS
a7c775ede0d5bb388989374ce09aa518f3ce7486603add3e210d84700ed5fc16
8 months ago
Calme-7B-Instruct-v0.5.Q4_K_S.gguf
4.14 GB
LFS
e28bd234dbd9f4f998685b72cbd8cb46ab9cfdb0729c922f47deab41e0d7649d
8 months ago
Calme-7B-Instruct-v0.5.Q5_K_M.gguf
5.13 GB
LFS
708b907e8c94bc3c81f5747cdc3e1f8cab319459a8688ac8d5e12ce018c9a357
8 months ago
Calme-7B-Instruct-v0.5.Q5_K_S.gguf
5 GB
LFS
cdd7419ece180da1229d7e711412259b6db9f461d49568e4bc6b510ca85007a5
8 months ago
Calme-7B-Instruct-v0.5.Q6_K.gguf
5.94 GB
LFS
582485163edc3ab8067ef13a60dfa542fa03459e4f8fedabb12cfcf13d2340ea
8 months ago
Calme-7B-Instruct-v0.5.Q8_0.gguf
7.7 GB
LFS
9685f0317c4017856a7fac6d6469ce9a87a7e161844b259f69df343dc502f8a2
8 months ago
README.md
11 kB
55c4a322179037d5538b0188644d85a03a7f4a33e7a4121535ff364ab769a508
8 months ago