Hugging Face's logo

Lewdiculous
/
Layris_9B-GGUF-IQ-Imatrix

Text Generation
Transformers
GGUF
mistral
quantized
text-generation-inference
roleplay
Model card Files Community
2
Lewdiculous commited on
Commit
85f2d09
•
1 Parent(s): 1e84432

Upload 4 files

Browse files
Files changed (5) hide show
  1. .gitattributes +4 -0
  2. Layris_9B-IQ4_XS-imat.gguf +3 -0
  3. Layris_9B-Q4_K_M-imat.gguf +3 -0
  4. Layris_9B-Q4_K_S-imat.gguf +3 -0
  5. imatrix.dat +3 -0
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ Layris_9B-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Layris_9B-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Layris_9B-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
Layris_9B-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e803b83adf6227ef05d3ee066e791053b9ebbf0e5104bba9e715acfc89ed7758
3
+ size 4840138688
Layris_9B-Q4_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2aa01995c48654d50cc36f6c0ede8f8c79d614442356a069066ea6b61b55a9a
3
+ size 5415053248
Layris_9B-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dcf01d4354d9a2ed1942dcfbea0a135cbb7dc9c0b0d0832ccf6a4dd5aee52c65
3
+ size 5129447360
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:708cdc2452de406998506bd4efa922b78698cef974125f2e5aad5f9e21f6c0b9
3
+ size 6235174