Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ikawrakow
/
various-2bit-sota-gguf
like
80
GGUF
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
13
Deploy
Use this model
b0a7708
various-2bit-sota-gguf
1 contributor
History:
8 commits
ikawrakow
Adding Nous-Hermes-2-SOLAR-10.7B 2-bit quants
b0a7708
10 months ago
.gitattributes
Safe
1.56 kB
Adding first set of models
11 months ago
README.md
Safe
156 Bytes
Update README.md
11 months ago
llama-v2-13b-2.17bpw.gguf
Safe
3.54 GB
LFS
Adding first set of models
11 months ago
llama-v2-70b-2.12bpw.gguf
Safe
18.3 GB
LFS
Adding more
11 months ago
llama-v2-7b-2.20bpw.gguf
Safe
1.85 GB
LFS
Adding first set of models
11 months ago
mistral-7b-2.20bpw.gguf
Safe
1.99 GB
LFS
Adding first set of models
11 months ago
mixtral-8x7b-2.10bpw.gguf
Safe
12.3 GB
LFS
Adding Mixtral-8x7b
11 months ago
mixtral-instruct-8x7b-2.10bpw.gguf
Safe
12.3 GB
LFS
Adding Mixtral-instruct-8x7b
11 months ago
nous-hermes-2-10.7b-2.18bpw.gguf
Safe
2.92 GB
LFS
Adding Nous-Hermes-2-SOLAR-10.7B 2-bit quants
10 months ago
nous-hermes-2-10.7b-2.70bpw.gguf
Safe
3.62 GB
LFS
Adding Nous-Hermes-2-SOLAR-10.7B 2-bit quants
10 months ago
rocket-3b-2.31bpw.gguf
Safe
808 MB
LFS
Adding Rocket-3b 2-bit quants
10 months ago
rocket-3b-2.76bpw.gguf
Safe
967 MB
LFS
Adding Rocket-3b 2-bit quants
10 months ago
