Upload folder using huggingface_hub

Hermes-3-Llama-3.1-8B-Q2_K.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5e648fdcf2bcb11fa02edd0550421a3bcd3cb3d4e6b9bc30be8192b29f8eca5c
-size 3179136768
+oid sha256:bd2ca6a5145cd9a708584dcae016e1203e2799e8767f722c289d348c408ac847
+size 3179136160

Hermes-3-Llama-3.1-8B-Q3_K_L.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d835e018a32c5a289b6148ef03d16aa057a1e4df6ac508d2e1a2c555658d7d92
-size 4321961728
+oid sha256:ae93ed7514f78f36a444b38591eed203f55a56b7114928a6f96e1d84ab2b4fb6
+size 4321961120

Hermes-3-Llama-3.1-8B-Q3_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:78fa8e4a7f001ceb9c8e593df0197ecbb45c5e5f3dd287bee87e1a010cf2d08b
-size 4018923264
+oid sha256:c5313cf8cd516a8b4e76ab1ca7689a22bf3445b9af933d5fa00dff9863cdfb6d
+size 4018922656

Hermes-3-Llama-3.1-8B-Q3_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:84f20c2330eeacdcba6a0a6a2a0c0d65660fc3de3f9199f22b04099ff053c208
-size 3664504576
+oid sha256:75500b9efa9ce256456d28c37a715a0f821ffeccc8663868704f2a0bc567a922
+size 3664503968

Hermes-3-Llama-3.1-8B-Q4_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1e8e81c3a18252011116b34dcbc09afd371f789b5dbe4b63d311d4a5353151ba
-size 4661217024
+oid sha256:735b0de83ba06889762067b0eff5f5cf3470158633b2439a457df9dcbc89902e
+size 4661216416

Hermes-3-Llama-3.1-8B-Q4_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d8aed365ef1dff18eef624ccc7b5ff256a6d5734962d93e4336eade836312938
-size 4920739584
+oid sha256:624d42dc436d442a204b5134a04c6d62961e64f6bb6dbefdbc57d78b01c13f60
+size 4920738976

Hermes-3-Llama-3.1-8B-Q4_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:df4cf5ced89570d6f569bc6fcf0d4b857362f5b4e40830dc1c6770c10e811033
-size 4692674304
+oid sha256:0453450fdbb56f5c90a1305472fbccb92dea79824e6867088c97aa66243acfde
+size 4692673696

Hermes-3-Llama-3.1-8B-Q5_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d26beedb96977c88e428f83ba70ec73e6f9ca45bc04badf54ffd21aef73b6018
-size 5599299328
+oid sha256:c104300f78476ecb5ae32e617e3dffc31243230ff4f040425a5113294990a5a5
+size 5599298720

Hermes-3-Llama-3.1-8B-Q5_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8406d9edcb2018b3fd806e94b948b4273cee612d1ba942a6e7a3ceb772d1fd61
-size 5732992768
+oid sha256:f5fd387ca55eb1434a64e0ce58c413e6879ff9d835191f2058672b13fb8228b8
+size 5732992160

Hermes-3-Llama-3.1-8B-Q5_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f6f8e573618db3378bfc80ed2cd2855d3958d9513e49c9aa68b2bdb9210878b9
-size 5599299328
+oid sha256:02491b031a8c816d3cf6f8712736e0bb4f194e5d5673aaccb1b2369e933aa002
+size 5599298720

Hermes-3-Llama-3.1-8B-Q6_K.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e4049b988cb5375bd5bc8dc0394d64d45a547738aa81f9de296510cd9f90d87c
-size 6596011776
+oid sha256:920c20583c6d1524e0fa63fb01cf3da1c2931bfcaa2fb7fcd0c76674aed05233
+size 6596011168

Hermes-3-Llama-3.1-8B-Q8_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:40f3c8088d2ea4f38ddefe88acceab2a60cc49fa6978ea0f21d1e500b31b99d0
-size 8540776192
+oid sha256:254641593d650175c484cbcfab2e48c97d42ad4b466613303d6f9c168b4e6ca6
+size 8540775584

README.md

@@ -1,34 +1,9 @@
 ---
-language:
-- en
-license: llama3
+library_name: transformers
 tags:
-- Llama-3
-- instruct
-- finetune
-- chatml
-- gpt4
-- synthetic data
-- distillation
-- function calling
-- json mode
-- axolotl
-- roleplaying
-- chat
 - TensorBlock
 - GGUF
-base_model: NousResearch/Hermes-3-Llama-3.1-8B
-widget:
-- example_title: Hermes 3
-  messages:
-  - role: system
-    content: You are a sentient, superintelligent artificial general intelligence,
-      here to teach and assist me.
-  - role: user
-    content: What is the meaning of life?
-model-index:
-- name: Hermes-3-Llama-3.1-70B
-  results: []
+base_model: unsloth/Hermes-3-Llama-3.1-8B
 ---
 
 <div style="width: auto; margin-left: auto; margin-right: auto">
@@ -42,13 +17,12 @@ model-index:
     </div>
 </div>
 
-## NousResearch/Hermes-3-Llama-3.1-8B - GGUF
+## unsloth/Hermes-3-Llama-3.1-8B - GGUF
 
-This repo contains GGUF format model files for [NousResearch/Hermes-3-Llama-3.1-8B](https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B).
+This repo contains GGUF format model files for [unsloth/Hermes-3-Llama-3.1-8B](https://huggingface.co/unsloth/Hermes-3-Llama-3.1-8B).
 
 The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
 
-
 <div style="text-align: left; margin: 20px 0;">
     <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
         Run them on the TensorBlock client using your local machine ↗
@@ -57,7 +31,6 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
 
 ## Prompt template
 
-
 ```
 <|begin_of_text|><|im_start|>system
 {system_prompt}<|im_end|>
@@ -70,18 +43,18 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
 
 | Filename | Quant type | File Size | Description |
 | -------- | ---------- | --------- | ----------- |
-| [Hermes-3-Llama-3.1-8B-Q2_K.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q2_K.gguf) | Q2_K | 2.961 GB | smallest, significant quality loss - not recommended for most purposes |
-| [Hermes-3-Llama-3.1-8B-Q3_K_S.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q3_K_S.gguf) | Q3_K_S | 3.413 GB | very small, high quality loss |
-| [Hermes-3-Llama-3.1-8B-Q3_K_M.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q3_K_M.gguf) | Q3_K_M | 3.743 GB | very small, high quality loss |
-| [Hermes-3-Llama-3.1-8B-Q3_K_L.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q3_K_L.gguf) | Q3_K_L | 4.025 GB | small, substantial quality loss |
-| [Hermes-3-Llama-3.1-8B-Q4_0.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q4_0.gguf) | Q4_0 | 4.341 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
-| [Hermes-3-Llama-3.1-8B-Q4_K_S.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q4_K_S.gguf) | Q4_K_S | 4.370 GB | small, greater quality loss |
-| [Hermes-3-Llama-3.1-8B-Q4_K_M.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q4_K_M.gguf) | Q4_K_M | 4.583 GB | medium, balanced quality - recommended |
-| [Hermes-3-Llama-3.1-8B-Q5_0.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q5_0.gguf) | Q5_0 | 5.215 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
-| [Hermes-3-Llama-3.1-8B-Q5_K_S.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q5_K_S.gguf) | Q5_K_S | 5.215 GB | large, low quality loss - recommended |
-| [Hermes-3-Llama-3.1-8B-Q5_K_M.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q5_K_M.gguf) | Q5_K_M | 5.339 GB | large, very low quality loss - recommended |
-| [Hermes-3-Llama-3.1-8B-Q6_K.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q6_K.gguf) | Q6_K | 6.143 GB | very large, extremely low quality loss |
-| [Hermes-3-Llama-3.1-8B-Q8_0.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q8_0.gguf) | Q8_0 | 7.954 GB | very large, extremely low quality loss - not recommended |
+| [Hermes-3-Llama-3.1-8B-Q2_K.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q2_K.gguf) | Q2_K | 3.179 GB | smallest, significant quality loss - not recommended for most purposes |
+| [Hermes-3-Llama-3.1-8B-Q3_K_S.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q3_K_S.gguf) | Q3_K_S | 3.665 GB | very small, high quality loss |
+| [Hermes-3-Llama-3.1-8B-Q3_K_M.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q3_K_M.gguf) | Q3_K_M | 4.019 GB | very small, high quality loss |
+| [Hermes-3-Llama-3.1-8B-Q3_K_L.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q3_K_L.gguf) | Q3_K_L | 4.322 GB | small, substantial quality loss |
+| [Hermes-3-Llama-3.1-8B-Q4_0.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q4_0.gguf) | Q4_0 | 4.661 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [Hermes-3-Llama-3.1-8B-Q4_K_S.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q4_K_S.gguf) | Q4_K_S | 4.693 GB | small, greater quality loss |
+| [Hermes-3-Llama-3.1-8B-Q4_K_M.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q4_K_M.gguf) | Q4_K_M | 4.921 GB | medium, balanced quality - recommended |
+| [Hermes-3-Llama-3.1-8B-Q5_0.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q5_0.gguf) | Q5_0 | 5.599 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [Hermes-3-Llama-3.1-8B-Q5_K_S.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q5_K_S.gguf) | Q5_K_S | 5.599 GB | large, low quality loss - recommended |
+| [Hermes-3-Llama-3.1-8B-Q5_K_M.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q5_K_M.gguf) | Q5_K_M | 5.733 GB | large, very low quality loss - recommended |
+| [Hermes-3-Llama-3.1-8B-Q6_K.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q6_K.gguf) | Q6_K | 6.596 GB | very large, extremely low quality loss |
+| [Hermes-3-Llama-3.1-8B-Q8_0.gguf](https://huggingface.co/tensorblock/Hermes-3-Llama-3.1-8B-GGUF/blob/main/Hermes-3-Llama-3.1-8B-Q8_0.gguf) | Q8_0 | 8.541 GB | very large, extremely low quality loss - not recommended |
 
 
 ## Downloading instruction