Hugging Face's logo

NeuralNet-Hub
/
openchat-3.6-8b-20240522-GGUF

Text Generation
Transformers
GGUF
openchat
llama3
C-RLFT
Inference Endpoints
conversational
Model card Files Community
hdnh2006 commited on
Commit
ac6951e
•
1 Parent(s): 1dce553

All models pushed

Browse files
Files changed (14) hide show
  1. ggml-openchat-3.6-8b-20240522-fp16.gguf +3 -0
  2. openchat-3.6-8b-20240522-q3_K_L.gguf +3 -0
  3. openchat-3.6-8b-20240522-q3_K_M.gguf +3 -0
  4. openchat-3.6-8b-20240522-q3_K_S.gguf +3 -0
  5. openchat-3.6-8b-20240522-q4_0.gguf +3 -0
  6. openchat-3.6-8b-20240522-q4_1.gguf +3 -0
  7. openchat-3.6-8b-20240522-q4_K_M.gguf +3 -0
  8. openchat-3.6-8b-20240522-q4_K_S.gguf +3 -0
  9. openchat-3.6-8b-20240522-q5_0.gguf +3 -0
  10. openchat-3.6-8b-20240522-q5_1.gguf +3 -0
  11. openchat-3.6-8b-20240522-q5_K_M.gguf +3 -0
  12. openchat-3.6-8b-20240522-q5_K_S.gguf +3 -0
  13. openchat-3.6-8b-20240522-q6_K.gguf +3 -0
  14. openchat-3.6-8b-20240522-q8_0.gguf +3 -0
ggml-openchat-3.6-8b-20240522-fp16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:972a2b22563d804a86aabc5e88b42174b7e169a35d60ba983ece0cd8a927d263
3
+ size 16068891136
openchat-3.6-8b-20240522-q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:23a572a44ea5f2883c8ac39dff2cad94c190970d8fee38a514ebd1613d1b9f27
3
+ size 4321956352
openchat-3.6-8b-20240522-q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c72258a6fa669c9998def587e99ed02c344a583f1c7536e9a70299613bb20661
3
+ size 4018917888
openchat-3.6-8b-20240522-q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5536f578d548bb276f3080c0bba9c60785b50da4e75b32041b73473e617a4dd8
3
+ size 3664499200
openchat-3.6-8b-20240522-q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7812e862ab10037bfc3dd8253271b7d4429572faee4d1aec8aa6826ae7b470ec
3
+ size 4661211648
openchat-3.6-8b-20240522-q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4d4582dff17f4cc46fe8ce93910c24d3ef9afa8d90d2ea2719ff99a90d309de
3
+ size 5130252800
openchat-3.6-8b-20240522-q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:097dca9eae0f44b17859a8aa75cb16cae63bfe981da141aa8ec166f9a801ca73
3
+ size 4920734208
openchat-3.6-8b-20240522-q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ca87f5c94b9b5d4c07303bf8b31a02c1a573952618d7088fce1f2326aaf01ea
3
+ size 4692668928
openchat-3.6-8b-20240522-q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a7314cfb43fe1190a64fa485d6599db13bbecc6c492015f22012efb4f4a7a67
3
+ size 5599293952
openchat-3.6-8b-20240522-q5_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08843f08cca1565794258a5833670de7eb7f87a300f92fd0da17186779bd0a1d
3
+ size 6068335104
openchat-3.6-8b-20240522-q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c0706288d7a8085698eef63455a5c06bd803dc1e2befce6a81a210058b2ac5e
3
+ size 5732987392
openchat-3.6-8b-20240522-q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:282eaaeacdc1b71785ee594832099c8a49f78362c1d3a8bf8539bda24dec197c
3
+ size 5599293952
openchat-3.6-8b-20240522-q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83c4ab6e1880c6cdf0ee9a739f0f05ef7436c62ba47964324e621926af84f573
3
+ size 6596006400
openchat-3.6-8b-20240522-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba8b98f426fa8ef262ec9c2127080fbe22201fd7fa25fb907a7067761025528b
3
+ size 8540770816