Luispark2025 commited on
Commit
60e5b1f
1 Parent(s): e1b49a2

luis_model

Browse files
README.md CHANGED
@@ -20,7 +20,7 @@ should probably proofread and complete it, then remove this comment. -->
20
 
21
  This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the generator dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 1.1467
24
 
25
  ## Model description
26
 
@@ -54,8 +54,8 @@ The following hyperparameters were used during training:
54
 
55
  | Training Loss | Epoch | Step | Validation Loss |
56
  |:-------------:|:------:|:----:|:---------------:|
57
- | No log | 0.8955 | 4 | 1.1497 |
58
- | 1.1263 | 1.7910 | 8 | 1.1467 |
59
 
60
 
61
  ### Framework versions
 
20
 
21
  This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the generator dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 1.1463
24
 
25
  ## Model description
26
 
 
54
 
55
  | Training Loss | Epoch | Step | Validation Loss |
56
  |:-------------:|:------:|:----:|:---------------:|
57
+ | 1.2094 | 0.8955 | 4 | 1.1494 |
58
+ | 1.0733 | 1.7910 | 8 | 1.1463 |
59
 
60
 
61
  ### Framework versions
adapter_config.json CHANGED
@@ -21,9 +21,9 @@
21
  "revision": null,
22
  "target_modules": [
23
  "q_proj",
24
- "k_proj",
25
  "o_proj",
26
- "v_proj"
27
  ],
28
  "task_type": "CAUSAL_LM",
29
  "use_dora": false,
 
21
  "revision": null,
22
  "target_modules": [
23
  "q_proj",
24
+ "v_proj",
25
  "o_proj",
26
+ "k_proj"
27
  ],
28
  "task_type": "CAUSAL_LM",
29
  "use_dora": false,
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f6c2172d04e3bd263af8b57092464288d05e3332fd3bb2ccc4aa4c9698140bc7
3
  size 218138576
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80d5da37b07f9f4cbc3ad46753bcce10a31abb9898be3b87c39af3b48d5d7340
3
  size 218138576
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5ff2b9be92f95c47ef86e28e6c9c7ef50aa5bce1ed608c77768a9bdb0eb3c66c
3
  size 5112
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:401ab336b195ce9b4029e8176abfdec0312056a09767e7dfe6b52c9afe276229
3
  size 5112