Hugging Face's logo

MarsupialAI
/
Gemmasutra-Pro-27B-v1_iMatrix_GGUF

GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community
1
MarsupialAI commited on
Commit
bd06d8c
•
1 Parent(s): 4797695

Upload 3 files

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. Gemmasutra-Pro-27B-v1_Q4km.gguf +3 -0
  3. Gemmasutra-Pro-27B-v1_Q5km.gguf +3 -0
  4. Gemmasutra-Pro-27B-v1_Q5ks.gguf +3 -0
.gitattributes CHANGED
@@ -37,3 +37,6 @@ Gemmasutra-Pro-27B-v1_fp16.gguf-00001-of-00002.gguf filter=lfs diff=lfs merge=lf
37
  Gemmasutra-Pro-27B-v1_fp16.gguf-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
38
  Gemmasutra-Pro-27B-v1_Q3km.gguf filter=lfs diff=lfs merge=lfs -text
39
  Gemmasutra-Pro-27B-v1_Q4ks.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
37
  Gemmasutra-Pro-27B-v1_fp16.gguf-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
38
  Gemmasutra-Pro-27B-v1_Q3km.gguf filter=lfs diff=lfs merge=lfs -text
39
  Gemmasutra-Pro-27B-v1_Q4ks.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Gemmasutra-Pro-27B-v1_Q4km.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Gemmasutra-Pro-27B-v1_Q5km.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Gemmasutra-Pro-27B-v1_Q5ks.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Pro-27B-v1_Q4km.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17deae65d9ff7b432e5509bc45570767fb5e9755757b0896ae59c6b01b8ab244
3
+ size 16645381824
Gemmasutra-Pro-27B-v1_Q5km.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a029f6f7a10daa2d81464652703059ecab0b72dfa327b6a5f41f30a4b4b50db4
3
+ size 19408117440
Gemmasutra-Pro-27B-v1_Q5ks.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1caea676d64ac1c139d5f629a5e1b05c265900958e81aeadc587248ea557d321
3
+ size 18884206272