TheBloke
/

Seraph-7B-GGUF

Model card Files Files and versions Community

1 contributor

History: 15 commits

TheBloke's picture

Upload README.md

cd30400 11 months ago

.gitattributes

2.21 kB

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
README.md

19.9 kB

Upload README.md 11 months ago
config.json

31 Bytes

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
seraph-7b.Q2_K.gguf

3.08 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
seraph-7b.Q3_K_L.gguf

3.82 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
seraph-7b.Q3_K_M.gguf

3.52 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
seraph-7b.Q3_K_S.gguf

3.16 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
seraph-7b.Q4_0.gguf

4.11 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
seraph-7b.Q4_K_M.gguf

4.37 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
seraph-7b.Q4_K_S.gguf

4.14 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
seraph-7b.Q5_0.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
seraph-7b.Q5_K_M.gguf

5.13 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
seraph-7b.Q5_K_S.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
seraph-7b.Q6_K.gguf

5.94 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago
seraph-7b.Q8_0.gguf

7.7 GB
LFS

GGUF model commit (made with llama.cpp commit fecac45) 11 months ago