Hugging Face's logo

gaianet
/
Phi-3-medium-4k-instruct-GGUF

Text Generation
Transformers
GGUF
multilingual
phi3
nlp
code
custom_code
Inference Endpoints
conversational
Model card Files Community
apepkuss79 commited on
Commit
1eed5e1
•
1 Parent(s): cec18f9

Upload models

Browse files
Files changed (14) hide show
  1. .gitattributes +13 -0
  2. Phi-3-medium-4k-instruct-Q2_K.gguf +3 -0
  3. Phi-3-medium-4k-instruct-Q3_K_L.gguf +3 -0
  4. Phi-3-medium-4k-instruct-Q3_K_M.gguf +3 -0
  5. Phi-3-medium-4k-instruct-Q3_K_S.gguf +3 -0
  6. Phi-3-medium-4k-instruct-Q4_0.gguf +3 -0
  7. Phi-3-medium-4k-instruct-Q4_K_M.gguf +3 -0
  8. Phi-3-medium-4k-instruct-Q4_K_S.gguf +3 -0
  9. Phi-3-medium-4k-instruct-Q5_0.gguf +3 -0
  10. Phi-3-medium-4k-instruct-Q5_K_M.gguf +3 -0
  11. Phi-3-medium-4k-instruct-Q5_K_S.gguf +3 -0
  12. Phi-3-medium-4k-instruct-Q6_K.gguf +3 -0
  13. Phi-3-medium-4k-instruct-Q8_0.gguf +3 -0
  14. Phi-3-medium-4k-instruct-f16.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,16 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Phi-3-medium-4k-instruct-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Phi-3-medium-4k-instruct-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Phi-3-medium-4k-instruct-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Phi-3-medium-4k-instruct-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Phi-3-medium-4k-instruct-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Phi-3-medium-4k-instruct-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Phi-3-medium-4k-instruct-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Phi-3-medium-4k-instruct-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Phi-3-medium-4k-instruct-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Phi-3-medium-4k-instruct-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Phi-3-medium-4k-instruct-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Phi-3-medium-4k-instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Phi-3-medium-4k-instruct-f16.gguf filter=lfs diff=lfs merge=lfs -text
Phi-3-medium-4k-instruct-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae5584d5e850801c4f32fee2b1171c05eaa1f9925889555b3c83eda9970a20c7
3
+ size 5142999648
Phi-3-medium-4k-instruct-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dfa511d6c9c7f29b6fccd2fa7c80374396fbd72fda096dcc551ac358b8d1d377
3
+ size 7490296928
Phi-3-medium-4k-instruct-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:314bce75c1425616d504fe1bb9a891a29541d56d11b2763aa50932d7b6ac1f00
3
+ size 6923410528
Phi-3-medium-4k-instruct-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d66067b17b01c6571de933bb34cfe6c99745c0495821119e0b6f4a47e6fbf6a8
3
+ size 6064888928
Phi-3-medium-4k-instruct-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cdeeec065542176eb30cfb3594faf069cddd93220d1faa23c39dac45d6debfef
3
+ size 7897124448
Phi-3-medium-4k-instruct-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f74f6ffa9b019f43f05677d73f357aa8bbebdb2b6ecc3e9f19443c6c4c654982
3
+ size 8566820448
Phi-3-medium-4k-instruct-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b7c37a6c54c6e36d90bff62b9da4dc339bcf9335585a1364cf361d74d742b6de
3
+ size 7954468448
Phi-3-medium-4k-instruct-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69f445433d2fd906728a55ef87a32bce680145a47f0f0a37dfd6d5964475507b
3
+ size 9621581408
Phi-3-medium-4k-instruct-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4a6cbc460f21a6d43ea4c21e177c24db566bff26206e012d700c91798819c21
3
+ size 10074189408
Phi-3-medium-4k-instruct-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f50b1c4d9fa3085a67d0d567f75a1dd8982389f733c7af2351ab18487697bd3
3
+ size 9621581408
Phi-3-medium-4k-instruct-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a77798707e52b68647f84675b3d7ba673d36616d19f7b5b5b3de65dff5c072da
3
+ size 11453816928
Phi-3-medium-4k-instruct-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27751464b5a6cccc2eae0efefd443aca688fc911fb9a52948798b83ad2c90150
3
+ size 14834711648
Phi-3-medium-4k-instruct-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51a8dedc7dfd08a58fb06d4066b9822f434d356681bd51dbe5c8c1489e892399
3
+ size 27922046048