nozagleh commited on
Commit
8c4e0db
·
1 Parent(s): 6928b7b

Training complete

Browse files
README.md ADDED
@@ -0,0 +1,75 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: nozagleh/mt5-small-finetuned-icelandic-summary
4
+ tags:
5
+ - summarization
6
+ - generated_from_trainer
7
+ metrics:
8
+ - rouge
9
+ model-index:
10
+ - name: mt5-small-finetuned-icelandic-summary-finetuned-icelandic-summary
11
+ results: []
12
+ ---
13
+
14
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
+ should probably proofread and complete it, then remove this comment. -->
16
+
17
+ # mt5-small-finetuned-icelandic-summary-finetuned-icelandic-summary
18
+
19
+ This model is a fine-tuned version of [nozagleh/mt5-small-finetuned-icelandic-summary](https://huggingface.co/nozagleh/mt5-small-finetuned-icelandic-summary) on an unknown dataset.
20
+ It achieves the following results on the evaluation set:
21
+ - Loss: 2.0847
22
+ - Rouge1: 24.7758
23
+ - Rouge2: 13.6541
24
+ - Rougel: 22.0304
25
+ - Rougelsum: 22.8727
26
+
27
+ ## Model description
28
+
29
+ More information needed
30
+
31
+ ## Intended uses & limitations
32
+
33
+ More information needed
34
+
35
+ ## Training and evaluation data
36
+
37
+ More information needed
38
+
39
+ ## Training procedure
40
+
41
+ ### Training hyperparameters
42
+
43
+ The following hyperparameters were used during training:
44
+ - learning_rate: 5.6e-05
45
+ - train_batch_size: 6
46
+ - eval_batch_size: 6
47
+ - seed: 42
48
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
+ - lr_scheduler_type: linear
50
+ - num_epochs: 12
51
+
52
+ ### Training results
53
+
54
+ | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum |
55
+ |:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:-------:|:---------:|
56
+ | 2.6294 | 1.0 | 2552 | 2.1826 | 23.9594 | 13.1502 | 21.2044 | 22.1031 |
57
+ | 2.5328 | 2.0 | 5104 | 2.1888 | 24.0688 | 13.178 | 21.3606 | 22.1735 |
58
+ | 2.4571 | 3.0 | 7656 | 2.1371 | 24.1003 | 13.3883 | 21.4866 | 22.3277 |
59
+ | 2.4024 | 4.0 | 10208 | 2.1331 | 24.2949 | 13.2282 | 21.5826 | 22.4117 |
60
+ | 2.3513 | 5.0 | 12760 | 2.1198 | 24.1912 | 13.2633 | 21.5876 | 22.3797 |
61
+ | 2.3141 | 6.0 | 15312 | 2.1283 | 24.3672 | 13.2826 | 21.5934 | 22.472 |
62
+ | 2.2853 | 7.0 | 17864 | 2.0878 | 24.5056 | 13.3639 | 21.7807 | 22.6229 |
63
+ | 2.2567 | 8.0 | 20416 | 2.0952 | 24.4647 | 13.428 | 21.7303 | 22.6027 |
64
+ | 2.2373 | 9.0 | 22968 | 2.0908 | 24.5012 | 13.3905 | 21.7448 | 22.6278 |
65
+ | 2.2203 | 10.0 | 25520 | 2.0889 | 24.5345 | 13.4032 | 21.7559 | 22.6362 |
66
+ | 2.2033 | 11.0 | 28072 | 2.0857 | 24.7518 | 13.5923 | 21.9905 | 22.8425 |
67
+ | 2.199 | 12.0 | 30624 | 2.0847 | 24.7758 | 13.6541 | 22.0304 | 22.8727 |
68
+
69
+
70
+ ### Framework versions
71
+
72
+ - Transformers 4.35.2
73
+ - Pytorch 2.1.0+cu118
74
+ - Datasets 2.15.0
75
+ - Tokenizers 0.15.0
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "decoder_start_token_id": 0,
3
+ "eos_token_id": 1,
4
+ "pad_token_id": 0,
5
+ "transformers_version": "4.35.2"
6
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fa614006839d3a811ca5860e66eddb1f5edba14300130af6c2cd33045b656006
3
  size 1200729512
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e46fda08c1aa473871a861ffb7ac38bb4ee4dee467837be4d7818ceaf1e49838
3
  size 1200729512
runs/Dec10_11-17-02_ae8739333077/events.out.tfevents.1702207030.ae8739333077.1453.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:412bacab121eff9b90ec03a0e0571af2562e9791c769f25f59a5c0b9bf049f0b
3
- size 11701
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8bfe4b1a9dbe5085397cd33a1a42d0ddb2d88405f4be49f195e31bb1ae98c98b
3
+ size 12704
runs/Dec10_11-17-02_ae8739333077/events.out.tfevents.1702219454.ae8739333077.1453.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ffffef5c21ffe686edf8e4f2cd5707709cc59b097953c0b45e3f9af66fa349b
3
+ size 571