Lewdiculous
/

Captain-Eris_Twighlight-V0.420-12B-GGUF-ARM-Imatrix

Inference Endpoints

Model card Files Files and versions Community

Captain-Eris_Twighlight-V0.420-12B-GGUF-ARM-Imatrix

1 contributor

History: 32 commits

Lewdiculous's picture

Delete Captain-Eris_Twighlight-V0.420-12B-F16.gguf

85d0196 verified 15 days ago

SillyTavern
Upload 2 files 16 days ago
.gitattributes

4.11 kB

Upload v2-Captain-Eris_Twighlight-V0.420-12B-Q5_K_S-imat.gguf 16 days ago
Captain-Eris_Twighlight-V0.420-12B-BF16.gguf

24.5 GB
LFS

add unquantized ggufs 16 days ago
README.md

1.15 kB

Update README.md 16 days ago
imatrix.rp.txt

306 kB

imatrix, Q3s 16 days ago
v2-ARM-Captain-Eris_Twighlight-V0.420-12B-Q4_0_4_8-imat.gguf

7.07 GB
LFS

ARM-Q4_0_4_8, IQ4_XS 16 days ago
v2-Captain-Eris_Twighlight-V0.420-12B-IQ3_M-imat.gguf

5.72 GB
LFS

3BPW 16 days ago
v2-Captain-Eris_Twighlight-V0.420-12B-IQ3_S-imat.gguf

5.56 GB
LFS

3BPW 16 days ago
v2-Captain-Eris_Twighlight-V0.420-12B-IQ3_XS-imat.gguf

5.31 GB
LFS

3BPW 16 days ago
v2-Captain-Eris_Twighlight-V0.420-12B-IQ3_XXS-imat.gguf

4.95 GB
LFS

3BPW 16 days ago
v2-Captain-Eris_Twighlight-V0.420-12B-IQ4_XS-imat.gguf

6.74 GB
LFS

ARM-Q4_0_4_8, IQ4_XS 16 days ago
v2-Captain-Eris_Twighlight-V0.420-12B-Q3_K_L-imat.gguf

6.56 GB
LFS

3BPW 16 days ago
v2-Captain-Eris_Twighlight-V0.420-12B-Q3_K_M-imat.gguf

6.08 GB
LFS

3BPW 16 days ago
v2-Captain-Eris_Twighlight-V0.420-12B-Q4_K_M-imat.gguf

7.48 GB
LFS

Q4_K_M 16 days ago
v2-Captain-Eris_Twighlight-V0.420-12B-Q4_K_S-imat.gguf

7.12 GB
LFS

Q4_K_S 16 days ago
v2-Captain-Eris_Twighlight-V0.420-12B-Q5_K_M-imat.gguf

8.73 GB
LFS

Q5_K_M 16 days ago
v2-Captain-Eris_Twighlight-V0.420-12B-Q5_K_S-imat.gguf

8.52 GB
LFS

Upload v2-Captain-Eris_Twighlight-V0.420-12B-Q5_K_S-imat.gguf 16 days ago
v2-imatrix.dat

7.05 MB
LFS

Upload 2 files 16 days ago