Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
granite-3.0-8b-instruct-GGUF
like
1
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
9867366
granite-3.0-8b-instruct-GGUF
1 contributor
History:
4 commits
MaziyarPanahi
b4fbe732b564f12dd64b130a1ea13d67219064982bb6d5a9b58ab5a7190a475e
9867366
verified
22 days ago
.gitattributes
1.81 kB
b4fbe732b564f12dd64b130a1ea13d67219064982bb6d5a9b58ab5a7190a475e
22 days ago
README.md
3.04 kB
dfb04cf658f9c6548b94d3c8e32e5b0f84a441afa8d2b73b7ab93066c88606dc
22 days ago
granite-3.0-8b-instruct-GGUF_imatrix.dat
5.99 MB
LFS
dfb04cf658f9c6548b94d3c8e32e5b0f84a441afa8d2b73b7ab93066c88606dc
22 days ago
granite-3.0-8b-instruct.IQ1_M.gguf
2 GB
LFS
dfb04cf658f9c6548b94d3c8e32e5b0f84a441afa8d2b73b7ab93066c88606dc
22 days ago
granite-3.0-8b-instruct.IQ2_XS.gguf
2.5 GB
LFS
f46643c084e2c9468a55bd51aec81d2dfdc6efffd99e44d5c967a88922da1f4f
22 days ago
granite-3.0-8b-instruct.IQ3_XS.gguf
3.43 GB
LFS
b4fbe732b564f12dd64b130a1ea13d67219064982bb6d5a9b58ab5a7190a475e
22 days ago
