TheDrummer
/

Rocinante-12B-v1-GGUF

Inference Endpoints

Model card Files Files and versions Community

Rocinante-12B-v1-GGUF

1 contributor

History: 13 commits

TheDrummer's picture

Rename Rocinante-12B-v1b-Q6_K.gguf to Rocinante-12B-v1-Q6_K.gguf

17797b5 verified 3 months ago

.gitattributes

2.48 kB

Rename Rocinante-12B-v1b-Q6_K.gguf to Rocinante-12B-v1-Q6_K.gguf 3 months ago
README.md

1.67 kB

Update README.md 3 months ago
Rocinante-12B-v1-BF16.gguf

24.5 GB
LFS

Rename Rocinante-12B-v1b-BF16.gguf to Rocinante-12B-v1-BF16.gguf 3 months ago
Rocinante-12B-v1-F16.gguf

24.5 GB
LFS

Rename Rocinante-12B-v1b-F16.gguf to Rocinante-12B-v1-F16.gguf 3 months ago
Rocinante-12B-v1-Q2_K.gguf

4.79 GB
LFS

Rename Rocinante-12B-v1b-Q2_K.gguf to Rocinante-12B-v1-Q2_K.gguf 3 months ago
Rocinante-12B-v1-Q3_K_M.gguf

6.08 GB
LFS

Rename Rocinante-12B-v1b-Q3_K_M.gguf to Rocinante-12B-v1-Q3_K_M.gguf 3 months ago
Rocinante-12B-v1-Q4_K_M.gguf

7.48 GB
LFS

Rename Rocinante-12B-v1b-Q4_K_M.gguf to Rocinante-12B-v1-Q4_K_M.gguf 3 months ago
Rocinante-12B-v1-Q5_K_M.gguf

8.73 GB
LFS

Rename Rocinante-12B-v1b-Q5_K_M.gguf to Rocinante-12B-v1-Q5_K_M.gguf 3 months ago
Rocinante-12B-v1-Q6_K.gguf

10.1 GB
LFS

Rename Rocinante-12B-v1b-Q6_K.gguf to Rocinante-12B-v1-Q6_K.gguf 3 months ago
Rocinante-12B-v1b-Q8_0.gguf

13 GB
LFS

Upload Rocinante-12B-v1b-Q8_0.gguf with huggingface_hub 3 months ago