Hugging Face's logo

tsavage68
/
Na_M2_1000steps_1e7_SFT

Text Generation
Transformers
Safetensors
mistral
trl
sft
Generated from Trainer
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
tsavage68 commited on
Commit
edcc3d3
•
1 Parent(s): f6a516c

End of training

Browse files
Files changed (9) hide show
  1. README.md +22 -22
  2. final_checkpoint/model-00001-of-00003.safetensors +1 -1
  3. final_checkpoint/model-00002-of-00003.safetensors +1 -1
  4. final_checkpoint/model-00003-of-00003.safetensors +1 -1
  5. model-00001-of-00003.safetensors +1 -1
  6. model-00002-of-00003.safetensors +1 -1
  7. model-00003-of-00003.safetensors +1 -1
  8. tokenizer.json +1 -6
  9. training_args.bin +1 -1
README.md CHANGED
@@ -18,7 +18,7 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.1550
22
 
23
  ## Model description
24
 
@@ -37,7 +37,7 @@ More information needed
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
40
- - learning_rate: 1e-06
41
  - train_batch_size: 2
42
  - eval_batch_size: 1
43
  - seed: 42
@@ -52,26 +52,26 @@ The following hyperparameters were used during training:
52
 
53
  | Training Loss | Epoch | Step | Validation Loss |
54
  |:-------------:|:------:|:----:|:---------------:|
55
- | 0.349 | 0.2667 | 50 | 0.3425 |
56
- | 0.2797 | 0.5333 | 100 | 0.2671 |
57
- | 0.1882 | 0.8 | 150 | 0.1831 |
58
- | 0.1593 | 1.0667 | 200 | 0.1748 |
59
- | 0.1609 | 1.3333 | 250 | 0.1586 |
60
- | 0.1544 | 1.6 | 300 | 0.1575 |
61
- | 0.1558 | 1.8667 | 350 | 0.1564 |
62
- | 0.1524 | 2.1333 | 400 | 0.1574 |
63
- | 0.1527 | 2.4 | 450 | 0.1568 |
64
- | 0.1564 | 2.6667 | 500 | 0.1554 |
65
- | 0.1523 | 2.9333 | 550 | 0.1563 |
66
- | 0.1519 | 3.2 | 600 | 0.1558 |
67
- | 0.1532 | 3.4667 | 650 | 0.1555 |
68
- | 0.1508 | 3.7333 | 700 | 0.1549 |
69
- | 0.1518 | 4.0 | 750 | 0.1550 |
70
- | 0.1507 | 4.2667 | 800 | 0.1551 |
71
- | 0.1501 | 4.5333 | 850 | 0.1550 |
72
- | 0.1477 | 4.8 | 900 | 0.1549 |
73
- | 0.1464 | 5.0667 | 950 | 0.1550 |
74
- | 0.1488 | 5.3333 | 1000 | 0.1550 |
75
 
76
 
77
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.3111
22
 
23
  ## Model description
24
 
 
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
40
+ - learning_rate: 1e-07
41
  - train_batch_size: 2
42
  - eval_batch_size: 1
43
  - seed: 42
 
52
 
53
  | Training Loss | Epoch | Step | Validation Loss |
54
  |:-------------:|:------:|:----:|:---------------:|
55
+ | 1.9785 | 0.2667 | 50 | 1.8984 |
56
+ | 0.815 | 0.5333 | 100 | 0.6662 |
57
+ | 0.4371 | 0.8 | 150 | 0.4306 |
58
+ | 0.3721 | 1.0667 | 200 | 0.3807 |
59
+ | 0.3439 | 1.3333 | 250 | 0.3367 |
60
+ | 0.3251 | 1.6 | 300 | 0.3266 |
61
+ | 0.3215 | 1.8667 | 350 | 0.3233 |
62
+ | 0.3156 | 2.1333 | 400 | 0.3205 |
63
+ | 0.3124 | 2.4 | 450 | 0.3183 |
64
+ | 0.3165 | 2.6667 | 500 | 0.3161 |
65
+ | 0.3128 | 2.9333 | 550 | 0.3130 |
66
+ | 0.3093 | 3.2 | 600 | 0.3120 |
67
+ | 0.311 | 3.4667 | 650 | 0.3109 |
68
+ | 0.3073 | 3.7333 | 700 | 0.3112 |
69
+ | 0.306 | 4.0 | 750 | 0.3115 |
70
+ | 0.307 | 4.2667 | 800 | 0.3112 |
71
+ | 0.3052 | 4.5333 | 850 | 0.3111 |
72
+ | 0.3048 | 4.8 | 900 | 0.3105 |
73
+ | 0.3034 | 5.0667 | 950 | 0.3111 |
74
+ | 0.3057 | 5.3333 | 1000 | 0.3111 |
75
 
76
 
77
  ### Framework versions
final_checkpoint/model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5f0bd44b0aec034352c8f82114fed8acaae95d3058bfaf443a30be0eb4ca0ffe
3
  size 4943162240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73cb93187755724d5577a051be4e5fef74b778d7afdbe51f40c8b679ed3fa99b
3
  size 4943162240
final_checkpoint/model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5168598622d24b96342b1732a9a8f0c3906f8abf0ded1b9c8fec445a1ae5e563
3
  size 4999819232
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c10f2f5904b01fc07c410cf56f4819a5c3c36d6f87523459cf506653fdc7d41
3
  size 4999819232
final_checkpoint/model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0597ec2e730048ec58afbdb17653d22f33989d255e8fa8e1c8f6071f49026128
3
  size 4540516256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60a9b3c738d1e2d459799366526aae561a83de324fac79ca05058a8c5932c654
3
  size 4540516256
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5f0bd44b0aec034352c8f82114fed8acaae95d3058bfaf443a30be0eb4ca0ffe
3
  size 4943162240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73cb93187755724d5577a051be4e5fef74b778d7afdbe51f40c8b679ed3fa99b
3
  size 4943162240
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5168598622d24b96342b1732a9a8f0c3906f8abf0ded1b9c8fec445a1ae5e563
3
  size 4999819232
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c10f2f5904b01fc07c410cf56f4819a5c3c36d6f87523459cf506653fdc7d41
3
  size 4999819232
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0597ec2e730048ec58afbdb17653d22f33989d255e8fa8e1c8f6071f49026128
3
  size 4540516256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60a9b3c738d1e2d459799366526aae561a83de324fac79ca05058a8c5932c654
3
  size 4540516256
tokenizer.json CHANGED
@@ -1,11 +1,6 @@
1
  {
2
  "version": "1.0",
3
- "truncation": {
4
- "direction": "Right",
5
- "max_length": 50,
6
- "strategy": "LongestFirst",
7
- "stride": 0
8
- },
9
  "padding": null,
10
  "added_tokens": [
11
  {
 
1
  {
2
  "version": "1.0",
3
+ "truncation": null,
 
 
 
 
 
4
  "padding": null,
5
  "added_tokens": [
6
  {
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3a0c76bc3fcd9269cf01f28b413e67acd85fed7194692ddbee11008ef00db1b3
3
  size 5176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bfec2f3deb1c823a48fc54f00cc972a71911c44148d2bd29a8372728e26edf5b
3
  size 5176