Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mradermacher
/
prometheus-8x7b-v2.0-i1-GGUF
like
2
Text2Text Generation
Transformers
GGUF
prometheus-eval/Feedback-Collection
prometheus-eval/Preference-Collection
English
Inference Endpoints
imatrix
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
6f3d283
prometheus-8x7b-v2.0-i1-GGUF
1 contributor
History:
16 commits
mradermacher
uploaded from nico1
6f3d283
verified
13 days ago
.gitattributes
2.5 kB
uploaded from nico1
13 days ago
README.md
244 Bytes
uploaded from nico1
14 days ago
imatrix.dat
25.7 MB
LFS
uploaded from nico1
14 days ago
prometheus-8x7b-v2.0.i1-IQ1_M.gguf
10.8 GB
LFS
uploaded from nico1
13 days ago
prometheus-8x7b-v2.0.i1-IQ2_M.gguf
15.5 GB
LFS
uploaded from nico1
13 days ago
prometheus-8x7b-v2.0.i1-IQ2_XXS.gguf
12.6 GB
LFS
uploaded from nico1
13 days ago
prometheus-8x7b-v2.0.i1-IQ3_M.gguf
21.4 GB
LFS
uploaded from nico1
13 days ago
prometheus-8x7b-v2.0.i1-IQ3_XXS.gguf
18.2 GB
LFS
uploaded from nico1
13 days ago
prometheus-8x7b-v2.0.i1-IQ4_XS.gguf
25.1 GB
LFS
uploaded from nico1
13 days ago
prometheus-8x7b-v2.0.i1-Q2_K.gguf
17.3 GB
LFS
uploaded from nico1
14 days ago
prometheus-8x7b-v2.0.i1-Q3_K_L.gguf
24.2 GB
LFS
uploaded from nico1
13 days ago
prometheus-8x7b-v2.0.i1-Q3_K_M.gguf
22.5 GB
LFS
uploaded from nico1
13 days ago
prometheus-8x7b-v2.0.i1-Q3_K_S.gguf
20.4 GB
LFS
uploaded from nico1
13 days ago
prometheus-8x7b-v2.0.i1-Q4_K_M.gguf
28.4 GB
LFS
uploaded from nico1
13 days ago
prometheus-8x7b-v2.0.i1-Q4_K_S.gguf
26.7 GB
LFS
uploaded from nico1
13 days ago
prometheus-8x7b-v2.0.i1-Q6_K.gguf
38.4 GB
LFS
uploaded from nico1
13 days ago
