Commit
·
3142ac2
1
Parent(s):
cb60ed2
update model card README.md
Browse files
README.md
CHANGED
@@ -16,12 +16,12 @@ should probably proofread and complete it, then remove this comment. -->
|
|
16 |
|
17 |
This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on an unknown dataset.
|
18 |
It achieves the following results on the evaluation set:
|
19 |
-
- Loss: 2.
|
20 |
-
- Rouge1: 17.
|
21 |
-
- Rouge2: 10.
|
22 |
-
- Rougel: 17.
|
23 |
-
- Rougelsum: 17.
|
24 |
-
- Gen Len: 16.
|
25 |
|
26 |
## Model description
|
27 |
|
@@ -46,22 +46,21 @@ The following hyperparameters were used during training:
|
|
46 |
- seed: 42
|
47 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
48 |
- lr_scheduler_type: linear
|
49 |
-
- num_epochs:
|
50 |
|
51 |
### Training results
|
52 |
|
53 |
| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
|
54 |
|:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
|
55 |
-
| 2.
|
56 |
-
| 2.
|
57 |
-
| 2.
|
58 |
-
| 2.
|
59 |
-
| 2.1944 | 5.0 | 9000 | 2.1549 | 17.5468 | 10.1476 | 17.4231 | 17.4344 | 16.6461 |
|
60 |
|
61 |
|
62 |
### Framework versions
|
63 |
|
64 |
- Transformers 4.29.1
|
65 |
-
- Pytorch 2.0.0
|
66 |
- Datasets 2.12.0
|
67 |
- Tokenizers 0.13.3
|
|
|
16 |
|
17 |
This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on an unknown dataset.
|
18 |
It achieves the following results on the evaluation set:
|
19 |
+
- Loss: 2.1738
|
20 |
+
- Rouge1: 17.6332
|
21 |
+
- Rouge2: 10.2475
|
22 |
+
- Rougel: 17.5233
|
23 |
+
- Rougelsum: 17.5252
|
24 |
+
- Gen Len: 16.59
|
25 |
|
26 |
## Model description
|
27 |
|
|
|
46 |
- seed: 42
|
47 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
48 |
- lr_scheduler_type: linear
|
49 |
+
- num_epochs: 4
|
50 |
|
51 |
### Training results
|
52 |
|
53 |
| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
|
54 |
|:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
|
55 |
+
| 2.469 | 1.0 | 1800 | 2.2623 | 19.2526 | 13.4607 | 19.2285 | 19.2089 | 10.9481 |
|
56 |
+
| 2.3176 | 2.0 | 3600 | 2.2014 | 17.1109 | 10.2435 | 17.0312 | 17.0412 | 15.6308 |
|
57 |
+
| 2.264 | 3.0 | 5400 | 2.1789 | 17.5631 | 10.4188 | 17.428 | 17.4439 | 16.7186 |
|
58 |
+
| 2.231 | 4.0 | 7200 | 2.1738 | 17.6332 | 10.2475 | 17.5233 | 17.5252 | 16.59 |
|
|
|
59 |
|
60 |
|
61 |
### Framework versions
|
62 |
|
63 |
- Transformers 4.29.1
|
64 |
+
- Pytorch 2.0.0
|
65 |
- Datasets 2.12.0
|
66 |
- Tokenizers 0.13.3
|