Hugging Face's logo

imdatta0
/
Mistral-7B-v0.3_pct_ortho

PEFT
Safetensors
unsloth
Generated from Trainer
Model card Files Community
imdatta0 commited on
Commit
5eeb08a
•
1 Parent(s): b68ff6c

End of training

Browse files
Files changed (2) hide show
  1. README.md +51 -51
  2. adapter_model.safetensors +1 -1
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- base_model: unsloth/mistral-7b-v0.3-bnb-4bit
3
  library_name: peft
4
  license: apache-2.0
5
  tags:
@@ -15,9 +15,9 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  # Mistral-7B-v0.3_pct_ortho
17
 
18
- This model is a fine-tuned version of [unsloth/mistral-7b-v0.3-bnb-4bit](https://huggingface.co/unsloth/mistral-7b-v0.3-bnb-4bit) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 7.1305
21
 
22
  ## Model description
23
 
@@ -51,54 +51,54 @@ The following hyperparameters were used during training:
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:------:|:----:|:---------------:|
54
- | 2.145 | 0.0206 | 8 | 2.3112 |
55
- | 10.5488 | 0.0413 | 16 | 9.3681 |
56
- | 7.9067 | 0.0619 | 24 | 7.7434 |
57
- | 7.8557 | 0.0825 | 32 | 7.7804 |
58
- | 7.7959 | 0.1032 | 40 | 7.6185 |
59
- | 7.6599 | 0.1238 | 48 | 7.6087 |
60
- | 7.6244 | 0.1444 | 56 | 7.6251 |
61
- | 7.5899 | 0.1651 | 64 | 7.7005 |
62
- | 7.7052 | 0.1857 | 72 | 7.6484 |
63
- | 7.713 | 0.2063 | 80 | 7.6468 |
64
- | 7.7653 | 0.2270 | 88 | 7.7124 |
65
- | 7.7345 | 0.2476 | 96 | 7.6673 |
66
- | 7.7397 | 0.2682 | 104 | 7.6182 |
67
- | 7.6695 | 0.2888 | 112 | 7.6591 |
68
- | 7.6495 | 0.3095 | 120 | 7.6658 |
69
- | 7.7849 | 0.3301 | 128 | 7.7384 |
70
- | 7.6106 | 0.3507 | 136 | 7.5564 |
71
- | 7.6111 | 0.3714 | 144 | 7.6163 |
72
- | 7.7065 | 0.3920 | 152 | 7.6644 |
73
- | 7.6184 | 0.4126 | 160 | 7.5686 |
74
- | 7.616 | 0.4333 | 168 | 7.5656 |
75
- | 7.5454 | 0.4539 | 176 | 7.5597 |
76
- | 7.6258 | 0.4745 | 184 | 7.5779 |
77
- | 7.5473 | 0.4952 | 192 | 7.4016 |
78
- | 7.2947 | 0.5158 | 200 | 7.2932 |
79
- | 7.2767 | 0.5364 | 208 | 7.2147 |
80
- | 7.3113 | 0.5571 | 216 | 7.2121 |
81
- | 7.259 | 0.5777 | 224 | 7.1758 |
82
- | 7.0926 | 0.5983 | 232 | 7.1164 |
83
- | 7.1931 | 0.6190 | 240 | 7.1261 |
84
- | 7.2239 | 0.6396 | 248 | 7.3268 |
85
- | 7.3554 | 0.6602 | 256 | 7.1475 |
86
- | 7.1835 | 0.6809 | 264 | 7.3103 |
87
- | 7.2527 | 0.7015 | 272 | 7.3083 |
88
- | 7.2578 | 0.7221 | 280 | 7.0611 |
89
- | 7.3073 | 0.7427 | 288 | 7.2281 |
90
- | 7.0778 | 0.7634 | 296 | 7.0481 |
91
- | 7.196 | 0.7840 | 304 | 7.0595 |
92
- | 7.194 | 0.8046 | 312 | 7.1102 |
93
- | 7.1961 | 0.8253 | 320 | 7.1123 |
94
- | 7.1855 | 0.8459 | 328 | 7.1000 |
95
- | 7.263 | 0.8665 | 336 | 7.1072 |
96
- | 7.1925 | 0.8872 | 344 | 7.1302 |
97
- | 7.1506 | 0.9078 | 352 | 7.1543 |
98
- | 7.2592 | 0.9284 | 360 | 7.1034 |
99
- | 7.1493 | 0.9491 | 368 | 7.1163 |
100
- | 7.2687 | 0.9697 | 376 | 7.1285 |
101
- | 7.2225 | 0.9903 | 384 | 7.1305 |
102
 
103
 
104
  ### Framework versions
 
1
  ---
2
+ base_model: unsloth/mistral-7b-v0.3
3
  library_name: peft
4
  license: apache-2.0
5
  tags:
 
15
 
16
  # Mistral-7B-v0.3_pct_ortho
17
 
18
+ This model is a fine-tuned version of [unsloth/mistral-7b-v0.3](https://huggingface.co/unsloth/mistral-7b-v0.3) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 7.0729
21
 
22
  ## Model description
23
 
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:------:|:----:|:---------------:|
54
+ | 2.1243 | 0.0206 | 8 | 2.2855 |
55
+ | 9.1803 | 0.0413 | 16 | 12.8133 |
56
+ | 9.137 | 0.0619 | 24 | 8.4567 |
57
+ | 8.3645 | 0.0825 | 32 | 8.2606 |
58
+ | 8.5251 | 0.1032 | 40 | 7.7564 |
59
+ | 9.4881 | 0.1238 | 48 | 9.3070 |
60
+ | 7.7111 | 0.1444 | 56 | 7.7363 |
61
+ | 7.6126 | 0.1651 | 64 | 7.5948 |
62
+ | 7.6789 | 0.1857 | 72 | 7.6147 |
63
+ | 7.7404 | 0.2063 | 80 | 7.6322 |
64
+ | 7.7173 | 0.2270 | 88 | 7.6740 |
65
+ | 7.7113 | 0.2476 | 96 | 7.6742 |
66
+ | 7.6961 | 0.2682 | 104 | 7.6422 |
67
+ | 7.6729 | 0.2888 | 112 | 7.6076 |
68
+ | 7.7225 | 0.3095 | 120 | 7.7171 |
69
+ | 7.8259 | 0.3301 | 128 | 7.7724 |
70
+ | 7.6611 | 0.3507 | 136 | 7.5974 |
71
+ | 7.5696 | 0.3714 | 144 | 7.6032 |
72
+ | 7.6786 | 0.3920 | 152 | 7.6163 |
73
+ | 7.4746 | 0.4126 | 160 | 7.4268 |
74
+ | 7.4383 | 0.4333 | 168 | 7.4069 |
75
+ | 7.4469 | 0.4539 | 176 | 7.5225 |
76
+ | 7.6465 | 0.4745 | 184 | 7.4849 |
77
+ | 7.4025 | 0.4952 | 192 | 7.3099 |
78
+ | 7.3473 | 0.5158 | 200 | 7.2623 |
79
+ | 7.2821 | 0.5364 | 208 | 7.2484 |
80
+ | 7.389 | 0.5571 | 216 | 7.7177 |
81
+ | 7.2912 | 0.5777 | 224 | 7.1141 |
82
+ | 7.1847 | 0.5983 | 232 | 7.1145 |
83
+ | 7.2121 | 0.6190 | 240 | 7.1465 |
84
+ | 7.1216 | 0.6396 | 248 | 7.1479 |
85
+ | 7.2503 | 0.6602 | 256 | 7.1105 |
86
+ | 7.1416 | 0.6809 | 264 | 7.1730 |
87
+ | 7.2288 | 0.7015 | 272 | 7.1491 |
88
+ | 7.3502 | 0.7221 | 280 | 7.1991 |
89
+ | 7.2648 | 0.7427 | 288 | 7.1406 |
90
+ | 7.1647 | 0.7634 | 296 | 7.1226 |
91
+ | 7.1678 | 0.7840 | 304 | 7.0843 |
92
+ | 7.1879 | 0.8046 | 312 | 7.1045 |
93
+ | 7.2384 | 0.8253 | 320 | 7.1137 |
94
+ | 7.2301 | 0.8459 | 328 | 7.0949 |
95
+ | 7.2897 | 0.8665 | 336 | 7.1273 |
96
+ | 7.1483 | 0.8872 | 344 | 7.1084 |
97
+ | 7.1119 | 0.9078 | 352 | 7.0984 |
98
+ | 7.2202 | 0.9284 | 360 | 7.0766 |
99
+ | 7.1149 | 0.9491 | 368 | 7.0738 |
100
+ | 7.1986 | 0.9697 | 376 | 7.0749 |
101
+ | 7.155 | 0.9903 | 384 | 7.0729 |
102
 
103
 
104
  ### Framework versions
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f6eb39a896f15ecc7d7bfdf3495e636bfc1c2fc8a78a2422d5dcf39b2dde1d25
3
  size 83945296
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0693022bc4524f7b86ba794d85d4a5829574a69cc6d76dfc1eb86cd48073969
3
  size 83945296