Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Vdr1
/
gemstone-9b-GGUF
like
2
GGUF
roleplay
gemma2
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
Edit model card
HIGHLY EXPERIMENTAL!
GGUF Quants of
crestf411/gemstone-9b
Downloads last month
56
GGUF
Model size
9.24B params
Architecture
gemma2
4-bit
Q4_K_S
Q4_K_M
5-bit
Q5_K_S
Q5_K_M
6-bit
Q6_K
Q6_K_L
8-bit
Q8_0
Q8_0_L
Inference API
Unable to determine this model's library. Check the
docs
.
Model tree for
Vdr1/gemstone-9b-GGUF
Base model
crestf411/gemstone-9b
Quantized
(
1
)
this model