Hugging Face's logo

TerryHenrickson
/
t5-small-finetuned-xsum

Text2Text Generation
Transformers
PyTorch
TensorBoard
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
TerryHenrickson commited on
Commit
b14cee8
•
1 Parent(s): 65576db

End of training

Browse files
Files changed (4) hide show
  1. README.md +31 -30
  2. generation_config.json +1 -1
  3. model.safetensors +1 -1
  4. runs/Feb17_10-29-30_14108e8fd457/events.out.tfevents.1708165771.14108e8fd457.1689.1 +2 -2
README.md CHANGED
@@ -15,13 +15,13 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  # t5-small-finetuned-xsum
17
 
18
- This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.0078
21
- - Rouge1: 48.0041
22
- - Rouge2: 41.1108
23
- - Rougel: 48.0417
24
- - Rougelsum: 48.0048
25
  - Gen Len: 19.0
26
 
27
  ## Model description
@@ -48,36 +48,37 @@ The following hyperparameters were used during training:
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
  - num_epochs: 20
 
51
 
52
  ### Training results
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
55
  |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
56
- | No log | 1.0 | 125 | 0.8794 | 6.6951 | 0.2224 | 5.4261 | 5.4191 | 18.59 |
57
- | No log | 2.0 | 250 | 0.1755 | 41.0386 | 32.7852 | 41.06 | 41.0268 | 19.0 |
58
- | No log | 3.0 | 375 | 0.0702 | 38.8519 | 30.7641 | 38.8569 | 38.8409 | 19.0 |
59
- | 0.9138 | 4.0 | 500 | 0.0436 | 42.2193 | 34.4917 | 42.2304 | 42.2051 | 19.0 |
60
- | 0.9138 | 5.0 | 625 | 0.0315 | 42.069 | 34.3637 | 42.1018 | 42.0801 | 19.0 |
61
- | 0.9138 | 6.0 | 750 | 0.0233 | 45.9645 | 38.6498 | 45.9851 | 45.958 | 19.0 |
62
- | 0.9138 | 7.0 | 875 | 0.0198 | 45.9049 | 38.6707 | 45.9519 | 45.9069 | 19.0 |
63
- | 0.0769 | 8.0 | 1000 | 0.0175 | 45.8588 | 38.5195 | 45.8955 | 45.8691 | 19.0 |
64
- | 0.0769 | 9.0 | 1125 | 0.0148 | 46.487 | 39.3562 | 46.5325 | 46.4933 | 19.0 |
65
- | 0.0769 | 10.0 | 1250 | 0.0131 | 46.8666 | 39.7413 | 46.9032 | 46.8584 | 19.0 |
66
- | 0.0769 | 11.0 | 1375 | 0.0117 | 47.1968 | 40.1561 | 47.2436 | 47.1913 | 19.0 |
67
- | 0.0444 | 12.0 | 1500 | 0.0106 | 47.4808 | 40.4857 | 47.5092 | 47.4752 | 19.0 |
68
- | 0.0444 | 13.0 | 1625 | 0.0098 | 47.4893 | 40.4966 | 47.5301 | 47.5073 | 19.0 |
69
- | 0.0444 | 14.0 | 1750 | 0.0092 | 47.5574 | 40.573 | 47.5867 | 47.5567 | 19.0 |
70
- | 0.0444 | 15.0 | 1875 | 0.0088 | 47.7141 | 40.7683 | 47.753 | 47.7052 | 19.0 |
71
- | 0.0333 | 16.0 | 2000 | 0.0084 | 47.7701 | 40.8465 | 47.8078 | 47.7729 | 19.0 |
72
- | 0.0333 | 17.0 | 2125 | 0.0081 | 47.8671 | 40.9538 | 47.9002 | 47.8609 | 19.0 |
73
- | 0.0333 | 18.0 | 2250 | 0.0079 | 47.8993 | 40.993 | 47.9353 | 47.8973 | 19.0 |
74
- | 0.0333 | 19.0 | 2375 | 0.0079 | 48.01 | 41.1113 | 48.0419 | 48.0021 | 19.0 |
75
- | 0.029 | 20.0 | 2500 | 0.0078 | 48.0041 | 41.1108 | 48.0417 | 48.0048 | 19.0 |
76
 
77
 
78
  ### Framework versions
79
 
80
- - Transformers 4.33.1
81
- - Pytorch 2.0.1+cu118
82
- - Datasets 2.14.5
83
- - Tokenizers 0.13.3
 
15
 
16
  # t5-small-finetuned-xsum
17
 
18
+ This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.0132
21
+ - Rouge1: 40.4629
22
+ - Rouge2: 33.5142
23
+ - Rougel: 40.5236
24
+ - Rougelsum: 40.4694
25
  - Gen Len: 19.0
26
 
27
  ## Model description
 
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
  - num_epochs: 20
51
+ - mixed_precision_training: Native AMP
52
 
53
  ### Training results
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
56
  |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
57
+ | No log | 1.0 | 90 | 1.4437 | 3.409 | 0.0278 | 3.2292 | 3.2588 | 18.8778 |
58
+ | No log | 2.0 | 180 | 0.4633 | 29.0615 | 15.3025 | 28.5887 | 28.5901 | 19.0 |
59
+ | No log | 3.0 | 270 | 0.1471 | 34.8437 | 27.1133 | 34.8804 | 34.8086 | 19.0 |
60
+ | No log | 4.0 | 360 | 0.0804 | 36.2826 | 28.8247 | 36.3903 | 36.2919 | 19.0 |
61
+ | No log | 5.0 | 450 | 0.0560 | 38.0894 | 30.8296 | 38.1225 | 38.0653 | 19.0 |
62
+ | 0.9484 | 6.0 | 540 | 0.0405 | 38.6546 | 31.46 | 38.6946 | 38.6762 | 19.0 |
63
+ | 0.9484 | 7.0 | 630 | 0.0330 | 38.6806 | 31.4919 | 38.7179 | 38.6776 | 19.0 |
64
+ | 0.9484 | 8.0 | 720 | 0.0278 | 38.9384 | 31.7996 | 38.9948 | 38.9326 | 19.0 |
65
+ | 0.9484 | 9.0 | 810 | 0.0245 | 39.0178 | 31.8694 | 39.0251 | 38.9688 | 19.0 |
66
+ | 0.9484 | 10.0 | 900 | 0.0225 | 38.9387 | 31.7885 | 38.9521 | 38.8996 | 19.0 |
67
+ | 0.9484 | 11.0 | 990 | 0.0208 | 39.0065 | 31.8571 | 39.0144 | 38.9648 | 19.0 |
68
+ | 0.0962 | 12.0 | 1080 | 0.0190 | 39.1211 | 31.9815 | 39.1221 | 39.0636 | 19.0 |
69
+ | 0.0962 | 13.0 | 1170 | 0.0174 | 39.2014 | 32.0646 | 39.2159 | 39.1578 | 19.0 |
70
+ | 0.0962 | 14.0 | 1260 | 0.0162 | 39.6979 | 32.622 | 39.7226 | 39.665 | 19.0 |
71
+ | 0.0962 | 15.0 | 1350 | 0.0153 | 39.7289 | 32.6701 | 39.7675 | 39.7043 | 19.0 |
72
+ | 0.0962 | 16.0 | 1440 | 0.0146 | 39.8797 | 32.8485 | 39.9267 | 39.8524 | 19.0 |
73
+ | 0.0586 | 17.0 | 1530 | 0.0139 | 40.1872 | 33.1702 | 40.2273 | 40.1698 | 19.0 |
74
+ | 0.0586 | 18.0 | 1620 | 0.0136 | 40.1872 | 33.1702 | 40.2273 | 40.1698 | 19.0 |
75
+ | 0.0586 | 19.0 | 1710 | 0.0133 | 40.4629 | 33.5142 | 40.5236 | 40.4694 | 19.0 |
76
+ | 0.0586 | 20.0 | 1800 | 0.0132 | 40.4629 | 33.5142 | 40.5236 | 40.4694 | 19.0 |
77
 
78
 
79
  ### Framework versions
80
 
81
+ - Transformers 4.35.2
82
+ - Pytorch 2.1.0+cu121
83
+ - Datasets 2.17.0
84
+ - Tokenizers 0.15.2
generation_config.json CHANGED
@@ -2,5 +2,5 @@
2
  "decoder_start_token_id": 0,
3
  "eos_token_id": 1,
4
  "pad_token_id": 0,
5
- "transformers_version": "4.33.1"
6
  }
 
2
  "decoder_start_token_id": 0,
3
  "eos_token_id": 1,
4
  "pad_token_id": 0,
5
+ "transformers_version": "4.35.2"
6
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fd03c0fb22cd3b26662636a34b6a6766f5e35e18187bbd59f19d3ed9258a66e7
3
  size 242041896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7037e16b7d57f92375f4ccf67c7f45f583009acb233e15102feb73da8abcd6cc
3
  size 242041896
runs/Feb17_10-29-30_14108e8fd457/events.out.tfevents.1708165771.14108e8fd457.1689.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:313cc66b45f17586e45c43061353eafc5633496d8b7c1a2e05eb77b3b23c72eb
3
- size 14075
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2bf1710be4448c4928358082f635f9cc7de8bedb7aa18c4e934da53260340539
3
+ size 16529