Hugging Face's logo

koesn
/
NeuralHermes-2.5-Mistral-7B-GGUF

GGUF
English
mistral
instruct
finetune
chatml
gpt4
synthetic data
distillation
dpo
rlhf
Eval Results
Inference Endpoints
conversational
Model card Files Community
koesn commited on
Commit
83750e2
•
1 Parent(s): 116716c

Upload 8 files

Browse files
Files changed (9) hide show
  1. .gitattributes +8 -0
  2. neuralhermes-2.5-mistral-7b.IQ3_M.gguf +3 -0
  3. neuralhermes-2.5-mistral-7b.IQ3_S.gguf +3 -0
  4. neuralhermes-2.5-mistral-7b.IQ4_NL.gguf +3 -0
  5. neuralhermes-2.5-mistral-7b.Q4_0.gguf +3 -0
  6. neuralhermes-2.5-mistral-7b.Q4_K_M.gguf +3 -0
  7. neuralhermes-2.5-mistral-7b.Q5_K_M.gguf +3 -0
  8. neuralhermes-2.5-mistral-7b.Q6_K.gguf +3 -0
  9. neuralhermes-2.5-mistral-7b.Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,11 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ neuralhermes-2.5-mistral-7b.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
37
+ neuralhermes-2.5-mistral-7b.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
38
+ neuralhermes-2.5-mistral-7b.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
39
+ neuralhermes-2.5-mistral-7b.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
40
+ neuralhermes-2.5-mistral-7b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ neuralhermes-2.5-mistral-7b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ neuralhermes-2.5-mistral-7b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
43
+ neuralhermes-2.5-mistral-7b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
neuralhermes-2.5-mistral-7b.IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f342bd53bea7bf6c1a2e364d108bcf23918b0c9e8bd7ec852c797718cfd128f
3
+ size 3284901856
neuralhermes-2.5-mistral-7b.IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8c3a876119128459f35e77c974cc4bf39dec7c154a79914f25cb543e513f679
3
+ size 3182403552
neuralhermes-2.5-mistral-7b.IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:102ae9e68c63f38530dbf87f424aa45008405bce63d3f18aaa95bfa361131602
3
+ size 4155065376
neuralhermes-2.5-mistral-7b.Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:414e58fd29ab80a5c3d5634579a5a8cc6ba0890bfab3320cbcc9c27997b6650e
3
+ size 4108928032
neuralhermes-2.5-mistral-7b.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a778666711112ce73c387a92c4b32f641a9b0cde678caaec97673176c6197bd9
3
+ size 4368450592
neuralhermes-2.5-mistral-7b.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8367bd7fd5065d2989aaab7afa625bb2d714a49b393c2970379fa14bbd110c6c
3
+ size 5131421728
neuralhermes-2.5-mistral-7b.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:443e741c9d8cd6c3760eda365cb6873bbf884d861c253e6a282d89d5bfefa052
3
+ size 5942078560
neuralhermes-2.5-mistral-7b.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b71c2e784649c88d3ff7a1226ffc1096db5734be4cd7639470f656aad189915
3
+ size 7695875040