mradermacher
/

speechless-mistral-dolphin-orca-platypus-samantha-7b-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

speechless-mistral-dolphin-orca-platypus-samantha-7b-i1-GGUF

1 contributor

History: 15 commits

mradermacher's picture

uploaded from db3

b95fa2e verified 14 days ago

.gitattributes

2.71 kB

uploaded from db3 14 days ago
README.md

268 Bytes

uploaded from db3 14 days ago
imatrix.dat

4.99 MB
LFS

uploaded from db3 14 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-IQ1_M.gguf

1.75 GB
LFS

uploaded from db3 14 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-IQ2_M.gguf

2.5 GB
LFS

uploaded from db3 14 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-IQ3_M.gguf

3.28 GB
LFS

uploaded from db3 14 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-IQ3_XXS.gguf

2.83 GB
LFS

uploaded from db3 14 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-IQ4_XS.gguf

3.91 GB
LFS

uploaded from db3 14 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-Q2_K.gguf

2.72 GB
LFS

uploaded from db3 14 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-Q3_K_M.gguf

3.52 GB
LFS

uploaded from db3 14 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-Q3_K_S.gguf

3.16 GB
LFS

uploaded from db3 14 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-Q4_K_M.gguf

4.37 GB
LFS

uploaded from db3 14 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-Q4_K_S.gguf

4.14 GB
LFS

uploaded from db3 14 days ago
speechless-mistral-dolphin-orca-platypus-samantha-7b.i1-Q6_K.gguf

5.94 GB
LFS

uploaded from db3 14 days ago