Hugging Face's logo

mradermacher
/
Llama-3.1-8B-Open-SFT-i1-GGUF

Transformers
GGUF
Safetensors
English
Chain-of-Thought Activation
Llama3.1
8B
CoT
SFT
text-generation-inference
Ollama
Question Answering
Math
Inference Endpoints
imatrix
conversational
Model card Files Community
mradermacher commited on
Commit
ee58f5a
•
1 Parent(s): e374491

uploaded from rich1

Browse files
Files changed (23) hide show
  1. .gitattributes +22 -0
  2. Llama-3.1-8B-Open-SFT.i1-IQ1_M.gguf +3 -0
  3. Llama-3.1-8B-Open-SFT.i1-IQ1_S.gguf +3 -0
  4. Llama-3.1-8B-Open-SFT.i1-IQ2_M.gguf +3 -0
  5. Llama-3.1-8B-Open-SFT.i1-IQ2_S.gguf +3 -0
  6. Llama-3.1-8B-Open-SFT.i1-IQ2_XS.gguf +3 -0
  7. Llama-3.1-8B-Open-SFT.i1-IQ2_XXS.gguf +3 -0
  8. Llama-3.1-8B-Open-SFT.i1-IQ3_M.gguf +3 -0
  9. Llama-3.1-8B-Open-SFT.i1-IQ3_S.gguf +3 -0
  10. Llama-3.1-8B-Open-SFT.i1-IQ3_XS.gguf +3 -0
  11. Llama-3.1-8B-Open-SFT.i1-IQ3_XXS.gguf +3 -0
  12. Llama-3.1-8B-Open-SFT.i1-IQ4_XS.gguf +3 -0
  13. Llama-3.1-8B-Open-SFT.i1-Q2_K.gguf +3 -0
  14. Llama-3.1-8B-Open-SFT.i1-Q2_K_S.gguf +3 -0
  15. Llama-3.1-8B-Open-SFT.i1-Q3_K_L.gguf +3 -0
  16. Llama-3.1-8B-Open-SFT.i1-Q3_K_M.gguf +3 -0
  17. Llama-3.1-8B-Open-SFT.i1-Q3_K_S.gguf +3 -0
  18. Llama-3.1-8B-Open-SFT.i1-Q4_0.gguf +3 -0
  19. Llama-3.1-8B-Open-SFT.i1-Q4_K_M.gguf +3 -0
  20. Llama-3.1-8B-Open-SFT.i1-Q4_K_S.gguf +3 -0
  21. Llama-3.1-8B-Open-SFT.i1-Q5_K_M.gguf +3 -0
  22. Llama-3.1-8B-Open-SFT.i1-Q5_K_S.gguf +3 -0
  23. Llama-3.1-8B-Open-SFT.i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,25 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ Llama-3.1-8B-Open-SFT.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Llama-3.1-8B-Open-SFT.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Llama-3.1-8B-Open-SFT.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Llama-3.1-8B-Open-SFT.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Llama-3.1-8B-Open-SFT.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Llama-3.1-8B-Open-SFT.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Llama-3.1-8B-Open-SFT.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Llama-3.1-8B-Open-SFT.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Llama-3.1-8B-Open-SFT.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Llama-3.1-8B-Open-SFT.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Llama-3.1-8B-Open-SFT.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Llama-3.1-8B-Open-SFT.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Llama-3.1-8B-Open-SFT.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Llama-3.1-8B-Open-SFT.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Llama-3.1-8B-Open-SFT.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Llama-3.1-8B-Open-SFT.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Llama-3.1-8B-Open-SFT.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Llama-3.1-8B-Open-SFT.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Llama-3.1-8B-Open-SFT.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Llama-3.1-8B-Open-SFT.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Llama-3.1-8B-Open-SFT.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Llama-3.1-8B-Open-SFT.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Open-SFT.i1-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39996663b175c5967a0ce00939f46d629c6806c405a116dd15fe906e2d9ed65b
3
+ size 2161982176
Llama-3.1-8B-Open-SFT.i1-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7457102158b5a8c8aac9df73fd7ee28cedffdfe8c60566563549fda63d44b315
3
+ size 2019637984
Llama-3.1-8B-Open-SFT.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:40f4e00c0b3c83a817c01bbf6b78eb07712711fe5110d711a0c9c5187414713a
3
+ size 2948291296
Llama-3.1-8B-Open-SFT.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28b6b4d98efea3d36c3fd2731693261fad76fd08f1fc0e72b827a20ab9e9103f
3
+ size 2758499040
Llama-3.1-8B-Open-SFT.i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e935b0638c93ab344b206ff4a08f6d79ca78ae2a143faccaf77edfe42663b3d
3
+ size 2605791968
Llama-3.1-8B-Open-SFT.i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a7fcacac87021a53bf17276b5e7fb38f4a1676b49502cf338ad298e3b538dce
3
+ size 2399222496
Llama-3.1-8B-Open-SFT.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9c56df880450740345e4e11b191172cbddcc9278724eca97748ea59a24a6281
3
+ size 3784833760
Llama-3.1-8B-Open-SFT.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d052d132c5509ccf3828bd21dc9b50f719db6717d85a79f4bbd92d9347ec303b
3
+ size 3682335456
Llama-3.1-8B-Open-SFT.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27ef842d941ea741f70eee0bf6ef9c9a507e0fe1bb3fa58af5a48d2da27bbf15
3
+ size 3518757600
Llama-3.1-8B-Open-SFT.i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f174bc4b6309b261e5fc7c920c85bbe9dbf4dfd4511ce9f6d4e1bca6808a7ae9
3
+ size 3274922720
Llama-3.1-8B-Open-SFT.i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86f71d52ac25ecadbd0bd451b3b2bf818ef5428b071777bd99df53b73e058ddb
3
+ size 4447673056
Llama-3.1-8B-Open-SFT.i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80236163c8f50a0f34e4eaa72ccc65e3fca5deb9f5d81b7b5e6fecbbe7b79e95
3
+ size 3179141856
Llama-3.1-8B-Open-SFT.i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9367679a4b9cf2acad486e6f0485596b43f49448b25fa5a537a54a3bd730d450
3
+ size 2988825312
Llama-3.1-8B-Open-SFT.i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78fbc1d16309d512e357039126f5ba3906badc0f65c1daf5e576345d917bf1c7
3
+ size 4321966816
Llama-3.1-8B-Open-SFT.i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b986873549a093c0408ae593cbd6ca482d701e74766b82afaa9b05d40d4f21d0
3
+ size 4018928352
Llama-3.1-8B-Open-SFT.i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac79778c0fda99a6a98bf3679d201965c260b9169693c52d9803c068d432c56e
3
+ size 3664509664
Llama-3.1-8B-Open-SFT.i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a23e695f202ad48193731fa5b0012175006d9205d54ab97291463f2f485d5ac2
3
+ size 4675902176
Llama-3.1-8B-Open-SFT.i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01e4ea613e69909b40ffb369f9ff1dd4b3698193dcab9db9f03c09e7a968bff4
3
+ size 4920744672
Llama-3.1-8B-Open-SFT.i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c3908d2645e1e5006af7f413ab0d289f505a6bd5611a5dbb27a7dfa22ea4bdd
3
+ size 4692679392
Llama-3.1-8B-Open-SFT.i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:269c0a3917fb4e6c2a0ddffebe76cd426fa0d035f04c64be2707d7f6a67f48b8
3
+ size 5732997856
Llama-3.1-8B-Open-SFT.i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27cae0e6d8562ccfc6eb9a7e28b3096bb60369d12b0fb051508b42a2d7ce44d1
3
+ size 5599304416
Llama-3.1-8B-Open-SFT.i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ce96424f5c3bb7f826589d506e31462dfaa36cdc3133c1af1669a438f0ce3cf
3
+ size 6596016864