Hugging Face's logo

ldos
/
text_shortening_model_v8

Text2Text Generation
Transformers
PyTorch
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Community
ldos commited on
Commit
18fae5a
•
1 Parent(s): 7e7f07a

End of training

Browse files
Files changed (2) hide show
  1. README.md +119 -0
  2. generation_config.json +6 -0
README.md ADDED
@@ -0,0 +1,119 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: t5-small
4
+ tags:
5
+ - generated_from_trainer
6
+ metrics:
7
+ - rouge
8
+ model-index:
9
+ - name: text_shortening_model_v8
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # text_shortening_model_v8
17
+
18
+ This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the None dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 2.3248
21
+ - Rouge1: 0.43
22
+ - Rouge2: 0.2172
23
+ - Rougel: 0.3684
24
+ - Rougelsum: 0.3674
25
+ - Bert precision: 0.8551
26
+ - Bert recall: 0.8369
27
+ - Average word count: 9.8214
28
+ - Max word count: 17
29
+ - Min word count: 5
30
+ - Average token count: 15.5857
31
+ - % shortened texts with length > 12: 17.1429
32
+
33
+ ## Model description
34
+
35
+ More information needed
36
+
37
+ ## Intended uses & limitations
38
+
39
+ More information needed
40
+
41
+ ## Training and evaluation data
42
+
43
+ More information needed
44
+
45
+ ## Training procedure
46
+
47
+ ### Training hyperparameters
48
+
49
+ The following hyperparameters were used during training:
50
+ - learning_rate: 0.0001
51
+ - train_batch_size: 64
52
+ - eval_batch_size: 64
53
+ - seed: 42
54
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
55
+ - lr_scheduler_type: linear
56
+ - num_epochs: 50
57
+
58
+ ### Training results
59
+
60
+ | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Bert precision | Bert recall | Average word count | Max word count | Min word count | Average token count | % shortened texts with length > 12 |
61
+ |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:--------------:|:-----------:|:------------------:|:--------------:|:--------------:|:-------------------:|:----------------------------------:|
62
+ | 0.2688 | 1.0 | 8 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
63
+ | 0.284 | 2.0 | 16 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
64
+ | 0.264 | 3.0 | 24 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
65
+ | 0.2564 | 4.0 | 32 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
66
+ | 0.2727 | 5.0 | 40 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
67
+ | 0.2924 | 6.0 | 48 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
68
+ | 0.2666 | 7.0 | 56 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
69
+ | 0.2662 | 8.0 | 64 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
70
+ | 0.2631 | 9.0 | 72 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
71
+ | 0.2844 | 10.0 | 80 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
72
+ | 0.2653 | 11.0 | 88 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
73
+ | 0.2649 | 12.0 | 96 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
74
+ | 0.2972 | 13.0 | 104 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
75
+ | 0.2553 | 14.0 | 112 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
76
+ | 0.261 | 15.0 | 120 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
77
+ | 0.2832 | 16.0 | 128 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
78
+ | 0.2635 | 17.0 | 136 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
79
+ | 0.2484 | 18.0 | 144 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
80
+ | 0.2612 | 19.0 | 152 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
81
+ | 0.2996 | 20.0 | 160 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
82
+ | 0.2562 | 21.0 | 168 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
83
+ | 0.2503 | 22.0 | 176 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
84
+ | 0.2763 | 23.0 | 184 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
85
+ | 0.2692 | 24.0 | 192 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
86
+ | 0.284 | 25.0 | 200 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
87
+ | 0.2838 | 26.0 | 208 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
88
+ | 0.2729 | 27.0 | 216 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
89
+ | 0.2685 | 28.0 | 224 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
90
+ | 0.2599 | 29.0 | 232 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
91
+ | 0.2829 | 30.0 | 240 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
92
+ | 0.2275 | 31.0 | 248 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
93
+ | 0.2605 | 32.0 | 256 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
94
+ | 0.2855 | 33.0 | 264 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
95
+ | 0.251 | 34.0 | 272 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
96
+ | 0.2629 | 35.0 | 280 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
97
+ | 0.2679 | 36.0 | 288 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
98
+ | 0.2453 | 37.0 | 296 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
99
+ | 0.2853 | 38.0 | 304 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
100
+ | 0.2542 | 39.0 | 312 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
101
+ | 0.2627 | 40.0 | 320 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
102
+ | 0.2668 | 41.0 | 328 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
103
+ | 0.2742 | 42.0 | 336 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
104
+ | 0.2746 | 43.0 | 344 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
105
+ | 0.2768 | 44.0 | 352 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
106
+ | 0.2729 | 45.0 | 360 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
107
+ | 0.2729 | 46.0 | 368 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
108
+ | 0.2788 | 47.0 | 376 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
109
+ | 0.286 | 48.0 | 384 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
110
+ | 0.2484 | 49.0 | 392 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
111
+ | 0.2679 | 50.0 | 400 | 2.3248 | 0.43 | 0.2172 | 0.3684 | 0.3674 | 0.8551 | 0.8369 | 9.8214 | 17 | 5 | 15.5857 | 17.1429 |
112
+
113
+
114
+ ### Framework versions
115
+
116
+ - Transformers 4.32.1
117
+ - Pytorch 2.0.1+cu118
118
+ - Datasets 2.14.4
119
+ - Tokenizers 0.13.3
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "decoder_start_token_id": 0,
3
+ "eos_token_id": 1,
4
+ "pad_token_id": 0,
5
+ "transformers_version": "4.32.1"
6
+ }