Hugging Face's logo

SanctumAI
/
Phi-3-mini-4k-instruct-GGUF

Text Generation
Transformers
GGUF
English
phi3
nlp
code
Inference Endpoints
conversational
Model card Files Community
1
AndreyBest commited on
Commit
8a00a51
•
1 Parent(s): b561510

Uploading quants for the Phi-3-mini-4k-instruct-GGUF model

Browse files
Files changed (17) hide show
  1. phi-3-mini-4k-instruct.Q2_K.gguf +2 -2
  2. phi-3-mini-4k-instruct.Q3_K_L.gguf +2 -2
  3. phi-3-mini-4k-instruct.Q3_K_M.gguf +2 -2
  4. phi-3-mini-4k-instruct.Q3_K_S.gguf +2 -2
  5. phi-3-mini-4k-instruct.Q4_0.gguf +2 -2
  6. phi-3-mini-4k-instruct.Q4_1.gguf +2 -2
  7. phi-3-mini-4k-instruct.Q4_K.gguf +2 -2
  8. phi-3-mini-4k-instruct.Q4_K_M.gguf +2 -2
  9. phi-3-mini-4k-instruct.Q4_K_S.gguf +2 -2
  10. phi-3-mini-4k-instruct.Q5_0.gguf +2 -2
  11. phi-3-mini-4k-instruct.Q5_1.gguf +2 -2
  12. phi-3-mini-4k-instruct.Q5_K.gguf +2 -2
  13. phi-3-mini-4k-instruct.Q5_K_M.gguf +2 -2
  14. phi-3-mini-4k-instruct.Q5_K_S.gguf +2 -2
  15. phi-3-mini-4k-instruct.Q6_K.gguf +2 -2
  16. phi-3-mini-4k-instruct.Q8_0.gguf +2 -2
  17. phi-3-mini-4k-instruct.f16.gguf +2 -2
phi-3-mini-4k-instruct.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ec3222b970551b9585a5e055c5716cdbd082db9650f541b9e819e6b67f4088b9
3
- size 1416203232
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:932db794f22eeed4bacc43983554944765724a42ababe042a45b49d731bf703a
3
+ size 1416203712
phi-3-mini-4k-instruct.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:563109e4f75e3ad404379745b34b6d74e2dd0917081d900889251229123f95e0
3
- size 2087596512
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95e5ae184f5759578c540ef375d0314f7ae1ae61743dea15a6b7e9dd9b76e3fd
3
+ size 2087596992
phi-3-mini-4k-instruct.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dee51b139e14da108ade1bc6a3c85c03058e7fd1d9f05a3fc3e4c3397a578b72
3
- size 1955475936
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bbc1a1b59322ab814049acb3523ae8a9ab43b313167ec4352b13451981480635
3
+ size 1955476416
phi-3-mini-4k-instruct.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a55931712c41771ad9cce45b00aadf0579901e98ed84ea7d27713d26c0307147
3
- size 1681797600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4586c04b5f9c83768ee52006c9e60fad192c7c03baeac68e3486ad11328cd71b
3
+ size 1681798080
phi-3-mini-4k-instruct.Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e0c529653a4bdbea1fdc53d764ebbc43df8bb46b5a16f03c69b3cf0139e71e78
3
- size 2176176096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b3dc6cf0a413b4b87e42752bc0a8b6965e887a6cbdfd2109bb76661ebf03015
3
+ size 2176176576
phi-3-mini-4k-instruct.Q4_1.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:55f7bec6e16d57e914d57db88ffe5cc007ab3d73982646ce5ad6ee19857b05f4
3
- size 2408824800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:efa085d30bd534abdf81081a1b54cdc3b21bd7d8f1ec59565713d8cc179ebc84
3
+ size 2408825280
phi-3-mini-4k-instruct.Q4_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:63611604988e7b2b81916c5a44ea8b76d0df8aeb1990ce9bf97601d087d468ea
3
- size 2393231328
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60b93b5c4482e1af545a7c809f3ac06981aa987904cabc240ad021baf1ff505b
3
+ size 2393231808
phi-3-mini-4k-instruct.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:63611604988e7b2b81916c5a44ea8b76d0df8aeb1990ce9bf97601d087d468ea
3
- size 2393231328
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60b93b5c4482e1af545a7c809f3ac06981aa987904cabc240ad021baf1ff505b
3
+ size 2393231808
phi-3-mini-4k-instruct.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a97aede5074e2862af1c0ccfc0dcec1f0ceda0fa7332ce265c32065ae6d5866a
3
- size 2188759008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf9a966235e938b61ee33e41a9830963ffecbdbfb4a63c9dfa30407cd2e2a60d
3
+ size 2188759488
phi-3-mini-4k-instruct.Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b19ab888e7b94a7c55ec7e069436c0dbe8f88422c10f997a9b3e9bd9b3b3106d
3
- size 2641473504
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d748d6f1373bc6f6182d017876e30cc9cca83464fd08c4200b2c770a3ceb205
3
+ size 2641473984
phi-3-mini-4k-instruct.Q5_1.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:49da1b783ed68a903adb1777618e089e3a93994a1538625f63f25c349f914a1b
3
- size 2874122208
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:842fcfb24c4638d34c7b5b5e1e8613c2ad6f21bbce084c2b5b017b0ebf0e1809
3
+ size 2874122688
phi-3-mini-4k-instruct.Q5_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b805410ba3550c1eb28fabb8048162ad86070dda692ea90fb5020e1144980958
3
- size 2815274976
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d6aeaf84a4a9af51da2eab976c1d8e58e540f8133c6fe3a919ac5eda0d98414
3
+ size 2815275456
phi-3-mini-4k-instruct.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b805410ba3550c1eb28fabb8048162ad86070dda692ea90fb5020e1144980958
3
- size 2815274976
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d6aeaf84a4a9af51da2eab976c1d8e58e540f8133c6fe3a919ac5eda0d98414
3
+ size 2815275456
phi-3-mini-4k-instruct.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c2469cf3c6ec2f45a5b8f55ac4d6de948e2f33a6e322cdfe99c9ea1c28304986
3
- size 2641473504
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ba45f641b0d84567cba6e14a67e696032a1d9282fc76d49fa2cdffeeb3596ce
3
+ size 2641473984
phi-3-mini-4k-instruct.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f15b10529ed1ccb450816f30bd8c03b683a2b646df83438ba3e09e1799869d03
3
- size 3135852000
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9948eeaded1ca173372b98b78e59c24bbff0f980eaa2e74e1a21b987d27d9b4
3
+ size 3135852480
phi-3-mini-4k-instruct.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b1f053769c5a97d1a08570ed7d0ad63b825af1b7ce4ddf26e9596a59642aa6be
3
- size 4061221344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ed91b19c44c8c92f130aa922e05df1b76b709c5792788a24e7321945d100f75
3
+ size 4061221824
phi-3-mini-4k-instruct.f16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:09324c88a69a5037e8999d02181bbb067ed9a07646a9f87008be80bf64d39cd7
3
- size 7643296224
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe4c64522173db6b3dae84ae667f6a8ad9e6cbc767f37ef165addbed991b129d
3
+ size 7643296704