Hugging Face's logo

jkazdan
/
gemma-2-2b_hs2_iter1_sftsd1

Safetensors
gemma2
trl
sft
Generated from Trainer
Model card Files Community
jkazdan commited on
Commit
7d50402
·
verified ·
1 Parent(s): 5621b1c

End of training

Browse files
Files changed (4) hide show
  1. README.md +33 -20
  2. model-00001-of-00002.safetensors +1 -1
  3. model-00002-of-00002.safetensors +1 -1
  4. training_args.bin +1 -1
README.md CHANGED
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [google/gemma-2-2b](https://huggingface.co/google/gemma-2-2b) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 1.4374
21
- - Num Input Tokens Seen: 5219176
22
 
23
  ## Model description
24
 
@@ -53,24 +53,37 @@ The following hyperparameters were used during training:
53
  | Training Loss | Epoch | Step | Validation Loss | Input Tokens Seen |
54
  |:-------------:|:------:|:----:|:---------------:|:-----------------:|
55
  | No log | 0 | 0 | 1.3956 | 0 |
56
- | 1.7668 | 0.0533 | 5 | 1.3663 | 278592 |
57
- | 1.5612 | 0.1065 | 10 | 1.2589 | 555472 |
58
- | 1.3399 | 0.1598 | 15 | 1.1962 | 837344 |
59
- | 1.1995 | 0.2130 | 20 | 1.2034 | 1118136 |
60
- | 0.902 | 0.2663 | 25 | 1.2406 | 1401192 |
61
- | 0.7229 | 0.3196 | 30 | 1.3380 | 1684336 |
62
- | 0.4769 | 0.3728 | 35 | 1.4243 | 1969096 |
63
- | 0.4301 | 0.4261 | 40 | 1.4694 | 2250056 |
64
- | 0.3838 | 0.4794 | 45 | 1.4889 | 2523440 |
65
- | 0.3293 | 0.5326 | 50 | 1.4766 | 2802544 |
66
- | 0.2194 | 0.5859 | 55 | 1.4711 | 3086432 |
67
- | 0.2283 | 0.6391 | 60 | 1.4290 | 3359744 |
68
- | 0.1524 | 0.6924 | 65 | 1.4481 | 3638328 |
69
- | 0.2296 | 0.7457 | 70 | 1.4577 | 3917992 |
70
- | 0.1773 | 0.7989 | 75 | 1.4764 | 4199640 |
71
- | 0.1202 | 0.8522 | 80 | 1.4139 | 4486008 |
72
- | 0.178 | 0.9055 | 85 | 1.4641 | 4764120 |
73
- | 0.1187 | 0.9587 | 90 | 1.4421 | 5045664 |
 
 
 
 
 
 
 
 
 
 
 
 
 
74
 
75
 
76
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [google/gemma-2-2b](https://huggingface.co/google/gemma-2-2b) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 1.4676
21
+ - Num Input Tokens Seen: 8712000
22
 
23
  ## Model description
24
 
 
53
  | Training Loss | Epoch | Step | Validation Loss | Input Tokens Seen |
54
  |:-------------:|:------:|:----:|:---------------:|:-----------------:|
55
  | No log | 0 | 0 | 1.3956 | 0 |
56
+ | 1.7677 | 0.0320 | 5 | 1.3656 | 271360 |
57
+ | 1.5854 | 0.0639 | 10 | 1.2596 | 545792 |
58
+ | 1.4739 | 0.0959 | 15 | 1.1954 | 825128 |
59
+ | 1.2857 | 0.1279 | 20 | 1.1738 | 1108408 |
60
+ | 1.184 | 0.1599 | 25 | 1.1751 | 1388256 |
61
+ | 0.9207 | 0.1918 | 30 | 1.2445 | 1667528 |
62
+ | 0.8665 | 0.2238 | 35 | 1.2921 | 1949712 |
63
+ | 0.7163 | 0.2558 | 40 | 1.4105 | 2223872 |
64
+ | 0.5853 | 0.2878 | 45 | 1.4211 | 2497184 |
65
+ | 0.5139 | 0.3197 | 50 | 1.5440 | 2777320 |
66
+ | 0.4299 | 0.3517 | 55 | 1.5069 | 3057528 |
67
+ | 0.3458 | 0.3837 | 60 | 1.5679 | 3331488 |
68
+ | 0.2913 | 0.4157 | 65 | 1.5084 | 3611304 |
69
+ | 0.2654 | 0.4476 | 70 | 1.5051 | 3897800 |
70
+ | 0.2249 | 0.4796 | 75 | 1.5396 | 4174176 |
71
+ | 0.3085 | 0.5116 | 80 | 1.5069 | 4450528 |
72
+ | 0.1601 | 0.5436 | 85 | 1.5507 | 4732680 |
73
+ | 0.1126 | 0.5755 | 90 | 1.4520 | 5015288 |
74
+ | 0.1922 | 0.6075 | 95 | 1.4548 | 5296336 |
75
+ | 0.1709 | 0.6395 | 100 | 1.4422 | 5578672 |
76
+ | 0.1558 | 0.6715 | 105 | 1.4477 | 5860328 |
77
+ | 0.0981 | 0.7034 | 110 | 1.4791 | 6141568 |
78
+ | 0.1635 | 0.7354 | 115 | 1.4351 | 6424480 |
79
+ | 0.1061 | 0.7674 | 120 | 1.4498 | 6706048 |
80
+ | 0.159 | 0.7994 | 125 | 1.4220 | 6990040 |
81
+ | 0.0759 | 0.8313 | 130 | 1.4819 | 7264776 |
82
+ | 0.0897 | 0.8633 | 135 | 1.4187 | 7543304 |
83
+ | 0.1316 | 0.8953 | 140 | 1.4371 | 7823792 |
84
+ | 0.1955 | 0.9273 | 145 | 1.4277 | 8101728 |
85
+ | 0.1215 | 0.9592 | 150 | 1.4345 | 8378768 |
86
+ | 0.1174 | 0.9912 | 155 | 1.4765 | 8659448 |
87
 
88
 
89
  ### Framework versions
model-00001-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bd6a415e8ad7afdec23196036e9e4d520a081e7cb33aab93e52b647068a3e32d
3
  size 4988025760
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e6c4d25bc4e37af3bae671f585b8dc8a4ff1f5d3a2bdea13fac8aeec9a3aba4
3
  size 4988025760
model-00002-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d9d4b2ce53e6d37c9d9c438a6d19c511ff58a653bed78fabb8a8cbb7b35d3c6f
3
  size 240691728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b67992ea47fef38394cb295f440d4763ffdbcf74405e9b2ffbe52429c1fabc2
3
  size 240691728
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3db2d0637a474da96b24158284fa06930ec866026fbff2b760b39c8d6be77d95
3
  size 5560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f41a663f3774ba9b39866fd95fbe45544b1c6dd175c57fd4e1620747b82b0e8
3
  size 5560