End of training

README.md

@@ -102,7 +102,7 @@ xformers_attention: true
 
 This model is a fine-tuned version of [unsloth/mistral-7b-v0.3](https://huggingface.co/unsloth/mistral-7b-v0.3) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0981
+- Loss: 0.0959
 
 ## Model description
 
@@ -140,8 +140,8 @@ The following hyperparameters were used during training:
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
 | 1.103         | 0.0143 | 1    | 1.0215          |
-| 0.1835        | 0.3581 | 25   | 0.1234          |
-| 0.1237        | 0.7162 | 50   | 0.0981          |
+| 0.1759        | 0.3581 | 25   | 0.1228          |
+| 0.1183        | 0.7162 | 50   | 0.0959          |
 
 
 ### Framework versions

adapter_config.json

@@ -21,12 +21,12 @@
   "revision": null,
   "target_modules": [
     "k_proj",
+    "o_proj",
     "gate_proj",
     "q_proj",
-    "o_proj",
+    "down_proj",
     "up_proj",
-    "v_proj",
-    "down_proj"
+    "v_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0fc87989c17103fe6cd9b6c343c86f4a605c69c2df9cbc468d4a6bdbe97e7967
+oid sha256:8745f00e8704e5bc43f0d664d2e2e2adfa5f9b19157ebe83cf57ef72d3a96429
 size 335706186

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:32ea58307de55053fa70874bed7cc545719689fffef23d9a2520ebcebcc0f5bc
+oid sha256:723dc0fd63da6a0f0b2ad932f140da691037bf20f10e46cf36c1ecee2883ae04
 size 335604696

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:50c156758b7161ecf7152ecb6ee0bd178ac38c2c00fe8d346bc6f3885c57edf2
+oid sha256:dd9b7c798852b4ea78872275e113bb8f2ff03ff3197007bb28c49e8e7cdb9d7d
 size 6776