Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
legraphista
/
aya-23-35B-GGUF
like
1
Text Generation
GGUF
23 languages
Inference Endpoints
conversational
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
Deploy
Use this model
Edit model card
aya-23-35B-GGUF
aya-23-35B-GGUF
This is GGUF quantized version of
CohereForAI/aya-23-35B
created using llama.cpp
74f33adf
Downloads last month
119
GGUF
Model size
35B params
Architecture
command-r
2-bit
Q2_K
3-bit
Q3_K_S
Q3_K
Q3_K_M
Q3_K_L
4-bit
Q4_K_S
Q4_K
Q4_K_M
5-bit
Q5_K_S
Q5_K
Q5_K_M
6-bit
Q6_K
8-bit
Q8_0
16-bit
BF16
View +1 file
Inference Examples
Text Generation
Unable to determine this model's library. Check the
docs
.
Model tree for
legraphista/aya-23-35B-GGUF
Base model
CohereForAI/aya-23-35B
Quantized
(
9
)
this model
Collection including
legraphista/aya-23-35B-GGUF
aya-23
Collection
4 items
•
Updated
Aug 5