l3utterfly
/

llama-3-Stheno-Mahou-8B-gguf

Inference Endpoints

Model card Files Files and versions Community

llama-3-Stheno-Mahou-8B-gguf

1 contributor

History: 2 commits

l3utterfly's picture

Add quantised GGUF files

b9f5209 6 months ago

.gitattributes

1.56 kB

Add quantised GGUF files 6 months ago
README.md

27 Bytes

initial commit 6 months ago
llama-3-Stheno-Mahou-8B-Q2_K.gguf

3.18 GB
LFS

Add quantised GGUF files 6 months ago
llama-3-Stheno-Mahou-8B-Q4_0_4_4.gguf

4.66 GB
LFS

Add quantised GGUF files 6 months ago
llama-3-Stheno-Mahou-8B-Q4_0_4_8.gguf

4.66 GB
LFS

Add quantised GGUF files 6 months ago
llama-3-Stheno-Mahou-8B-Q4_0_8_8.gguf

4.66 GB
LFS

Add quantised GGUF files 6 months ago
llama-3-Stheno-Mahou-8B-Q4_K_M.gguf

4.92 GB
LFS

Add quantised GGUF files 6 months ago
llama-3-Stheno-Mahou-8B-Q6_K.gguf

6.6 GB
LFS

Add quantised GGUF files 6 months ago
llama-3-Stheno-Mahou-8B-Q8_0.gguf

8.54 GB
LFS

Add quantised GGUF files 6 months ago
llama-3-Stheno-Mahou-8B-f16.gguf

16.1 GB
LFS

Add quantised GGUF files 6 months ago