Hugging Face's logo

unsloth
/
DeepSeek-V3-GGUF

Transformers
GGUF
English
deepseek_v3
deepseek
unsloth
Inference Endpoints
conversational
Model card Files Community
6
danielhanchen commited on
Commit
270f1e1
·
verified ·
1 Parent(s): 3b4e627

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00001-of-00009.gguf +3 -0
  3. DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00002-of-00009.gguf +3 -0
  4. DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00003-of-00009.gguf +3 -0
  5. DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00004-of-00009.gguf +3 -0
  6. DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00005-of-00009.gguf +3 -0
  7. DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00006-of-00009.gguf +3 -0
  8. DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00007-of-00009.gguf +3 -0
  9. DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00008-of-00009.gguf +3 -0
  10. DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00009-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -76,3 +76,12 @@ DeepSeek-V3-Q5_K_M/DeepSeek-V3-Q5_K_M-00007-of-00010.gguf filter=lfs diff=lfs me
76
  DeepSeek-V3-Q5_K_M/DeepSeek-V3-Q5_K_M-00008-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
77
  DeepSeek-V3-Q5_K_M/DeepSeek-V3-Q5_K_M-00009-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
78
  DeepSeek-V3-Q5_K_M/DeepSeek-V3-Q5_K_M-00010-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
76
  DeepSeek-V3-Q5_K_M/DeepSeek-V3-Q5_K_M-00008-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
77
  DeepSeek-V3-Q5_K_M/DeepSeek-V3-Q5_K_M-00009-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
78
  DeepSeek-V3-Q5_K_M/DeepSeek-V3-Q5_K_M-00010-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
79
+ DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
80
+ DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
81
+ DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
82
+ DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
83
+ DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
84
+ DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
85
+ DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
86
+ DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
87
+ DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b13f1c6c00ff33fb2cbb9fc920939d55f7abbe3111f1804af9aafbb6474a5419
3
+ size 45244923584
DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f11ed5f79af603444c4d6d1ad65121463d52e9491b711c21e4c2ccb3703b4331
3
+ size 46045037472
DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1644e9754ea79f162758c3b64c2dbb252d94f5c5ac87db61a8a56c708c31ad72
3
+ size 45170284896
DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3daa641b0f444456818f6d6d0888725ef14fcd9f562705c29e440ca76cf8814
3
+ size 45177653696
DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90999ed2228323d5b384fd2100b8fca6fa8502085f9780fee50a5c057115c6f7
3
+ size 45072368544
DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9326a7e28a0ba903d3ba7547d9685d0ccc33932398c5b4060bfd3dfc50f1d41f
3
+ size 46142953824
DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08368fa46c1d5e2354d77d91acc230f8f69bfc02a9f9d00ab9f32121970c6f5a
3
+ size 45177653696
DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c9b28e6234c040aef1adf2a1b35ee16a44a250c8979001a35d43bbf2fbdd9fd2
3
+ size 44888150688
DeepSeek-V3-Q4_K_M/DeepSeek-V3-Q4_K_M-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0651bdf062c75ca7ad79c5c1dff3ee92e393e9bec151b570af5246b5f3a2ff00
3
+ size 41511160672