Hugging Face's logo

l3utterfly
/
llama-3-Stheno-Mahou-8B-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community
l3utterfly commited on
Commit
b9f5209
·
1 Parent(s): 8ffa258

Add quantised GGUF files

Browse files
Files changed (9) hide show
  1. .gitattributes +1 -0
  2. llama-3-Stheno-Mahou-8B-Q2_K.gguf +3 -0
  3. llama-3-Stheno-Mahou-8B-Q4_0_4_4.gguf +3 -0
  4. llama-3-Stheno-Mahou-8B-Q4_0_4_8.gguf +3 -0
  5. llama-3-Stheno-Mahou-8B-Q4_0_8_8.gguf +3 -0
  6. llama-3-Stheno-Mahou-8B-Q4_K_M.gguf +3 -0
  7. llama-3-Stheno-Mahou-8B-Q6_K.gguf +3 -0
  8. llama-3-Stheno-Mahou-8B-Q8_0.gguf +3 -0
  9. llama-3-Stheno-Mahou-8B-f16.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
llama-3-Stheno-Mahou-8B-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ea42025189807efee8767859523aa1ac005b424bac78975b9f4db6f814a767b
3
+ size 3179132160
llama-3-Stheno-Mahou-8B-Q4_0_4_4.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73d318c8de2120873ed857937a339f1ddf098a31a58608955fe9a3b8e33b0428
3
+ size 4661212416
llama-3-Stheno-Mahou-8B-Q4_0_4_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70ca850fab8fd5cd901116fc1437a74f87f3eb1ce093081cd516c9d8e0625ea9
3
+ size 4661212416
llama-3-Stheno-Mahou-8B-Q4_0_8_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:65c354100f3f0adb26290b97defd745b6dea9dad1fb584b33e7967be408e10dc
3
+ size 4661212416
llama-3-Stheno-Mahou-8B-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dea68cd26b301bb7c893a401b05a56ca36d06cd750fc78a9a6fbaa92855defd8
3
+ size 4920734976
llama-3-Stheno-Mahou-8B-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3623f6a093651d04e26269d41049883b792675c0056440d3367bd89a081608f4
3
+ size 6596007168
llama-3-Stheno-Mahou-8B-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15317a11639e7f5b933a4371d557469c43bbf22af5b6d01bfb7fc9495d1c9b64
3
+ size 8540771584
llama-3-Stheno-Mahou-8B-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee95715de93a37fd45b3b087c4766ad8cb197938de451121ede6130b7fa51908
3
+ size 16068891904