Hugging Face's logo

TheDrummer
/
Rocinante-12B-v1-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
2
TheDrummer commited on
Commit
ab05d8b
•
1 Parent(s): 6da0110

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. .gitattributes +7 -0
  2. Rocinante-12B-v1b-BF16.gguf +3 -0
  3. Rocinante-12B-v1b-F16.gguf +3 -0
  4. Rocinante-12B-v1b-Q2_K.gguf +3 -0
  5. Rocinante-12B-v1b-Q3_K_M.gguf +3 -0
  6. Rocinante-12B-v1b-Q4_K_M.gguf +3 -0
  7. Rocinante-12B-v1b-Q5_K_M.gguf +3 -0
  8. Rocinante-12B-v1b-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Rocinante-12B-v1b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Rocinante-12B-v1b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Rocinante-12B-v1b-BF16.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Rocinante-12B-v1b-F16.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Rocinante-12B-v1b-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Rocinante-12B-v1b-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Rocinante-12B-v1b-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Rocinante-12B-v1b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Rocinante-12B-v1b-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Rocinante-12B-v1b-BF16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d5062929b2bcc33c4f737bfe655a230e33a79e986f1e81e5079bd3bd9a00dee
3
+ size 24504279584
Rocinante-12B-v1b-F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1b7f15ce7d7cffef311fc5dd497988eebe09626d395715d819bfdbf91d4f9b3
3
+ size 24504279584
Rocinante-12B-v1b-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cdb838f6783e31d56e1465edf6ec8695f9c0946226658ee67adddefa90aa84b6
3
+ size 4791050784
Rocinante-12B-v1b-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43f6e871ce3d844cef101ea50a9f4d9a9115ccac8bd96a2ba4735dee5a47d790
3
+ size 6083093024
Rocinante-12B-v1b-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e65a4d6d0f1e7cd1373228c0a339979cf42c4595952a01b9f5ce9c36656a3e5
3
+ size 7477207584
Rocinante-12B-v1b-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e09a1f965b2fff923d21e5c528d6febf1cfedb858db6a648854d29367778563c
3
+ size 8727634464
Rocinante-12B-v1b-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:489c06a07534c5332f3ea47e5e4eda71673b64578e14ef4412c2cebfbd962c85
3
+ size 10056213024