Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mradermacher
/
prometheus-8x7b-v2.0-i1-GGUF
like
2
Text2Text Generation
Transformers
GGUF
prometheus-eval/Feedback-Collection
prometheus-eval/Preference-Collection
English
Inference Endpoints
imatrix
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
d2656fb
prometheus-8x7b-v2.0-i1-GGUF
1 contributor
History:
13 commits
mradermacher
uploaded from nico1
d2656fb
verified
14 days ago
.gitattributes
Safe
2.28 kB
uploaded from nico1
14 days ago
README.md
Safe
244 Bytes
uploaded from nico1
14 days ago
imatrix.dat
25.7 MB
LFS
uploaded from nico1
14 days ago
prometheus-8x7b-v2.0.i1-IQ1_M.gguf
Safe
10.8 GB
LFS
uploaded from nico1
14 days ago
prometheus-8x7b-v2.0.i1-IQ2_M.gguf
Safe
15.5 GB
LFS
uploaded from nico1
14 days ago
prometheus-8x7b-v2.0.i1-IQ3_M.gguf
Safe
21.4 GB
LFS
uploaded from nico1
14 days ago
prometheus-8x7b-v2.0.i1-IQ3_XXS.gguf
Safe
18.2 GB
LFS
uploaded from nico1
14 days ago
prometheus-8x7b-v2.0.i1-IQ4_XS.gguf
Safe
25.1 GB
LFS
uploaded from nico1
14 days ago
prometheus-8x7b-v2.0.i1-Q2_K.gguf
Safe
17.3 GB
LFS
uploaded from nico1
14 days ago
prometheus-8x7b-v2.0.i1-Q3_K_M.gguf
Safe
22.5 GB
LFS
uploaded from nico1
14 days ago
prometheus-8x7b-v2.0.i1-Q4_K_M.gguf
Safe
28.4 GB
LFS
uploaded from nico1
14 days ago
prometheus-8x7b-v2.0.i1-Q4_K_S.gguf
Safe
26.7 GB
LFS
uploaded from nico1
14 days ago
prometheus-8x7b-v2.0.i1-Q6_K.gguf
Safe
38.4 GB
LFS
uploaded from nico1
14 days ago
