Hugging Face's logo

salbatarni
/
arabert_cross_development_task1_fold5

Safetensors
bert
Generated from Trainer
Model card Files Community
salbatarni commited on
Commit
9dd94d6
•
1 Parent(s): 70afa55

End of training

Browse files
Files changed (1) hide show
  1. README.md +82 -87
README.md CHANGED
@@ -3,20 +3,20 @@ base_model: aubmindlab/bert-base-arabertv02
3
  tags:
4
  - generated_from_trainer
5
  model-index:
6
- - name: arabert_cross_development_task1_fold4
7
  results: []
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
  should probably proofread and complete it, then remove this comment. -->
12
 
13
- # arabert_cross_development_task1_fold4
14
 
15
  This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 0.3891
18
- - Qwk: 0.7487
19
- - Mse: 0.3891
20
 
21
  ## Model description
22
 
@@ -45,88 +45,83 @@ The following hyperparameters were used during training:
45
 
46
  ### Training results
47
 
48
- | Training Loss | Epoch | Step | Validation Loss | Qwk | Mse |
49
- |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|
50
- | No log | 0.125 | 2 | 2.7046 | 0.0134 | 2.7046 |
51
- | No log | 0.25 | 4 | 1.3006 | 0.1103 | 1.3006 |
52
- | No log | 0.375 | 6 | 0.7355 | 0.3354 | 0.7355 |
53
- | No log | 0.5 | 8 | 0.8932 | 0.3820 | 0.8932 |
54
- | No log | 0.625 | 10 | 0.5839 | 0.4676 | 0.5839 |
55
- | No log | 0.75 | 12 | 0.4634 | 0.5294 | 0.4634 |
56
- | No log | 0.875 | 14 | 0.4578 | 0.5335 | 0.4578 |
57
- | No log | 1.0 | 16 | 0.5111 | 0.5160 | 0.5111 |
58
- | No log | 1.125 | 18 | 0.4822 | 0.6507 | 0.4822 |
59
- | No log | 1.25 | 20 | 0.4309 | 0.6257 | 0.4309 |
60
- | No log | 1.375 | 22 | 0.4637 | 0.6422 | 0.4637 |
61
- | No log | 1.5 | 24 | 0.5888 | 0.7264 | 0.5888 |
62
- | No log | 1.625 | 26 | 0.5751 | 0.7173 | 0.5751 |
63
- | No log | 1.75 | 28 | 0.4309 | 0.6445 | 0.4309 |
64
- | No log | 1.875 | 30 | 0.3977 | 0.6113 | 0.3977 |
65
- | No log | 2.0 | 32 | 0.4095 | 0.6330 | 0.4095 |
66
- | No log | 2.125 | 34 | 0.4861 | 0.7147 | 0.4861 |
67
- | No log | 2.25 | 36 | 0.5155 | 0.7516 | 0.5155 |
68
- | No log | 2.375 | 38 | 0.4703 | 0.7321 | 0.4703 |
69
- | No log | 2.5 | 40 | 0.3861 | 0.6978 | 0.3861 |
70
- | No log | 2.625 | 42 | 0.3964 | 0.7189 | 0.3964 |
71
- | No log | 2.75 | 44 | 0.5105 | 0.7660 | 0.5105 |
72
- | No log | 2.875 | 46 | 0.5630 | 0.7439 | 0.5630 |
73
- | No log | 3.0 | 48 | 0.4666 | 0.7758 | 0.4666 |
74
- | No log | 3.125 | 50 | 0.4033 | 0.7314 | 0.4033 |
75
- | No log | 3.25 | 52 | 0.3886 | 0.7225 | 0.3886 |
76
- | No log | 3.375 | 54 | 0.4264 | 0.7369 | 0.4264 |
77
- | No log | 3.5 | 56 | 0.4681 | 0.7538 | 0.4681 |
78
- | No log | 3.625 | 58 | 0.4255 | 0.7357 | 0.4255 |
79
- | No log | 3.75 | 60 | 0.3784 | 0.7381 | 0.3784 |
80
- | No log | 3.875 | 62 | 0.3835 | 0.7261 | 0.3835 |
81
- | No log | 4.0 | 64 | 0.3863 | 0.7091 | 0.3863 |
82
- | No log | 4.125 | 66 | 0.3964 | 0.7022 | 0.3964 |
83
- | No log | 4.25 | 68 | 0.4674 | 0.7519 | 0.4674 |
84
- | No log | 4.375 | 70 | 0.5670 | 0.7310 | 0.5670 |
85
- | No log | 4.5 | 72 | 0.5082 | 0.7265 | 0.5082 |
86
- | No log | 4.625 | 74 | 0.3989 | 0.7387 | 0.3989 |
87
- | No log | 4.75 | 76 | 0.3568 | 0.7218 | 0.3568 |
88
- | No log | 4.875 | 78 | 0.3670 | 0.7343 | 0.3670 |
89
- | No log | 5.0 | 80 | 0.4147 | 0.7453 | 0.4147 |
90
- | No log | 5.125 | 82 | 0.4613 | 0.7583 | 0.4613 |
91
- | No log | 5.25 | 84 | 0.4365 | 0.7493 | 0.4365 |
92
- | No log | 5.375 | 86 | 0.3787 | 0.7383 | 0.3787 |
93
- | No log | 5.5 | 88 | 0.3637 | 0.7327 | 0.3637 |
94
- | No log | 5.625 | 90 | 0.3896 | 0.7461 | 0.3896 |
95
- | No log | 5.75 | 92 | 0.4827 | 0.7585 | 0.4827 |
96
- | No log | 5.875 | 94 | 0.5207 | 0.7560 | 0.5207 |
97
- | No log | 6.0 | 96 | 0.4771 | 0.7622 | 0.4771 |
98
- | No log | 6.125 | 98 | 0.4131 | 0.7595 | 0.4131 |
99
- | No log | 6.25 | 100 | 0.3861 | 0.7447 | 0.3861 |
100
- | No log | 6.375 | 102 | 0.3770 | 0.7473 | 0.3770 |
101
- | No log | 6.5 | 104 | 0.4030 | 0.7421 | 0.4030 |
102
- | No log | 6.625 | 106 | 0.4334 | 0.7447 | 0.4334 |
103
- | No log | 6.75 | 108 | 0.4677 | 0.7616 | 0.4677 |
104
- | No log | 6.875 | 110 | 0.4931 | 0.7670 | 0.4931 |
105
- | No log | 7.0 | 112 | 0.4703 | 0.7622 | 0.4703 |
106
- | No log | 7.125 | 114 | 0.4736 | 0.7622 | 0.4736 |
107
- | No log | 7.25 | 116 | 0.4565 | 0.7580 | 0.4565 |
108
- | No log | 7.375 | 118 | 0.4114 | 0.7521 | 0.4114 |
109
- | No log | 7.5 | 120 | 0.3925 | 0.7534 | 0.3925 |
110
- | No log | 7.625 | 122 | 0.3937 | 0.7441 | 0.3937 |
111
- | No log | 7.75 | 124 | 0.3906 | 0.7441 | 0.3906 |
112
- | No log | 7.875 | 126 | 0.3958 | 0.7488 | 0.3958 |
113
- | No log | 8.0 | 128 | 0.4005 | 0.7481 | 0.4005 |
114
- | No log | 8.125 | 130 | 0.4095 | 0.7399 | 0.4095 |
115
- | No log | 8.25 | 132 | 0.4044 | 0.7426 | 0.4044 |
116
- | No log | 8.375 | 134 | 0.3885 | 0.7487 | 0.3885 |
117
- | No log | 8.5 | 136 | 0.3727 | 0.7455 | 0.3727 |
118
- | No log | 8.625 | 138 | 0.3751 | 0.7428 | 0.3751 |
119
- | No log | 8.75 | 140 | 0.3851 | 0.7477 | 0.3851 |
120
- | No log | 8.875 | 142 | 0.4024 | 0.7472 | 0.4024 |
121
- | No log | 9.0 | 144 | 0.4118 | 0.7505 | 0.4118 |
122
- | No log | 9.125 | 146 | 0.4171 | 0.7505 | 0.4171 |
123
- | No log | 9.25 | 148 | 0.4179 | 0.7495 | 0.4179 |
124
- | No log | 9.375 | 150 | 0.4096 | 0.7483 | 0.4096 |
125
- | No log | 9.5 | 152 | 0.4015 | 0.7555 | 0.4015 |
126
- | No log | 9.625 | 154 | 0.3949 | 0.7508 | 0.3949 |
127
- | No log | 9.75 | 156 | 0.3905 | 0.7487 | 0.3905 |
128
- | No log | 9.875 | 158 | 0.3894 | 0.7487 | 0.3894 |
129
- | No log | 10.0 | 160 | 0.3891 | 0.7487 | 0.3891 |
130
 
131
 
132
  ### Framework versions
 
3
  tags:
4
  - generated_from_trainer
5
  model-index:
6
+ - name: arabert_cross_development_task1_fold5
7
  results: []
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
  should probably proofread and complete it, then remove this comment. -->
12
 
13
+ # arabert_cross_development_task1_fold5
14
 
15
  This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 0.3225
18
+ - Qwk: 0.7089
19
+ - Mse: 0.3218
20
 
21
  ## Model description
22
 
 
45
 
46
  ### Training results
47
 
48
+ | Training Loss | Epoch | Step | Validation Loss | Qwk | Mse |
49
+ |:-------------:|:------:|:----:|:---------------:|:------:|:------:|
50
+ | No log | 0.1333 | 2 | 1.6054 | 0.1118 | 1.6042 |
51
+ | No log | 0.2667 | 4 | 0.7796 | 0.3420 | 0.7792 |
52
+ | No log | 0.4 | 6 | 0.8606 | 0.4875 | 0.8600 |
53
+ | No log | 0.5333 | 8 | 0.7185 | 0.6145 | 0.7176 |
54
+ | No log | 0.6667 | 10 | 0.4960 | 0.5784 | 0.4951 |
55
+ | No log | 0.8 | 12 | 0.4504 | 0.5814 | 0.4497 |
56
+ | No log | 0.9333 | 14 | 0.4103 | 0.6104 | 0.4096 |
57
+ | No log | 1.0667 | 16 | 0.3725 | 0.6808 | 0.3715 |
58
+ | No log | 1.2 | 18 | 0.4101 | 0.8013 | 0.4091 |
59
+ | No log | 1.3333 | 20 | 0.3292 | 0.7235 | 0.3286 |
60
+ | No log | 1.4667 | 22 | 0.3212 | 0.6809 | 0.3206 |
61
+ | No log | 1.6 | 24 | 0.3406 | 0.7512 | 0.3398 |
62
+ | No log | 1.7333 | 26 | 0.3852 | 0.7534 | 0.3842 |
63
+ | No log | 1.8667 | 28 | 0.3920 | 0.7341 | 0.3909 |
64
+ | No log | 2.0 | 30 | 0.4486 | 0.7835 | 0.4475 |
65
+ | No log | 2.1333 | 32 | 0.4015 | 0.7929 | 0.4005 |
66
+ | No log | 2.2667 | 34 | 0.2966 | 0.7228 | 0.2959 |
67
+ | No log | 2.4 | 36 | 0.3163 | 0.6675 | 0.3156 |
68
+ | No log | 2.5333 | 38 | 0.2965 | 0.7270 | 0.2958 |
69
+ | No log | 2.6667 | 40 | 0.3334 | 0.7868 | 0.3325 |
70
+ | No log | 2.8 | 42 | 0.3892 | 0.7967 | 0.3882 |
71
+ | No log | 2.9333 | 44 | 0.3635 | 0.7640 | 0.3626 |
72
+ | No log | 3.0667 | 46 | 0.3415 | 0.7020 | 0.3408 |
73
+ | No log | 3.2 | 48 | 0.3452 | 0.6985 | 0.3445 |
74
+ | No log | 3.3333 | 50 | 0.3467 | 0.7485 | 0.3460 |
75
+ | No log | 3.4667 | 52 | 0.3606 | 0.7778 | 0.3598 |
76
+ | No log | 3.6 | 54 | 0.3419 | 0.7735 | 0.3412 |
77
+ | No log | 3.7333 | 56 | 0.3217 | 0.7477 | 0.3210 |
78
+ | No log | 3.8667 | 58 | 0.3254 | 0.6951 | 0.3248 |
79
+ | No log | 4.0 | 60 | 0.3366 | 0.6811 | 0.3360 |
80
+ | No log | 4.1333 | 62 | 0.3255 | 0.7328 | 0.3248 |
81
+ | No log | 4.2667 | 64 | 0.3255 | 0.7574 | 0.3248 |
82
+ | No log | 4.4 | 66 | 0.3264 | 0.7713 | 0.3257 |
83
+ | No log | 4.5333 | 68 | 0.3260 | 0.7538 | 0.3253 |
84
+ | No log | 4.6667 | 70 | 0.3303 | 0.7599 | 0.3295 |
85
+ | No log | 4.8 | 72 | 0.3278 | 0.7285 | 0.3270 |
86
+ | No log | 4.9333 | 74 | 0.3399 | 0.7039 | 0.3391 |
87
+ | No log | 5.0667 | 76 | 0.3696 | 0.6751 | 0.3689 |
88
+ | No log | 5.2 | 78 | 0.3565 | 0.6740 | 0.3558 |
89
+ | No log | 5.3333 | 80 | 0.3177 | 0.7247 | 0.3171 |
90
+ | No log | 5.4667 | 82 | 0.3107 | 0.7637 | 0.3100 |
91
+ | No log | 5.6 | 84 | 0.3037 | 0.7643 | 0.3031 |
92
+ | No log | 5.7333 | 86 | 0.2968 | 0.7380 | 0.2962 |
93
+ | No log | 5.8667 | 88 | 0.3026 | 0.6895 | 0.3020 |
94
+ | No log | 6.0 | 90 | 0.2948 | 0.7283 | 0.2942 |
95
+ | No log | 6.1333 | 92 | 0.2968 | 0.7351 | 0.2962 |
96
+ | No log | 6.2667 | 94 | 0.3054 | 0.6898 | 0.3048 |
97
+ | No log | 6.4 | 96 | 0.3335 | 0.6564 | 0.3329 |
98
+ | No log | 6.5333 | 98 | 0.3257 | 0.6723 | 0.3250 |
99
+ | No log | 6.6667 | 100 | 0.3148 | 0.7398 | 0.3141 |
100
+ | No log | 6.8 | 102 | 0.3244 | 0.7519 | 0.3237 |
101
+ | No log | 6.9333 | 104 | 0.3201 | 0.7549 | 0.3194 |
102
+ | No log | 7.0667 | 106 | 0.3197 | 0.7204 | 0.3190 |
103
+ | No log | 7.2 | 108 | 0.3241 | 0.7042 | 0.3234 |
104
+ | No log | 7.3333 | 110 | 0.3257 | 0.7232 | 0.3250 |
105
+ | No log | 7.4667 | 112 | 0.3300 | 0.7399 | 0.3293 |
106
+ | No log | 7.6 | 114 | 0.3300 | 0.7379 | 0.3292 |
107
+ | No log | 7.7333 | 116 | 0.3299 | 0.7286 | 0.3292 |
108
+ | No log | 7.8667 | 118 | 0.3273 | 0.7096 | 0.3266 |
109
+ | No log | 8.0 | 120 | 0.3291 | 0.6958 | 0.3284 |
110
+ | No log | 8.1333 | 122 | 0.3265 | 0.6826 | 0.3258 |
111
+ | No log | 8.2667 | 124 | 0.3190 | 0.7007 | 0.3182 |
112
+ | No log | 8.4 | 126 | 0.3131 | 0.7151 | 0.3123 |
113
+ | No log | 8.5333 | 128 | 0.3135 | 0.7284 | 0.3127 |
114
+ | No log | 8.6667 | 130 | 0.3156 | 0.7284 | 0.3148 |
115
+ | No log | 8.8 | 132 | 0.3172 | 0.7253 | 0.3164 |
116
+ | No log | 8.9333 | 134 | 0.3198 | 0.7157 | 0.3190 |
117
+ | No log | 9.0667 | 136 | 0.3222 | 0.7034 | 0.3214 |
118
+ | No log | 9.2 | 138 | 0.3213 | 0.7089 | 0.3205 |
119
+ | No log | 9.3333 | 140 | 0.3194 | 0.7170 | 0.3186 |
120
+ | No log | 9.4667 | 142 | 0.3189 | 0.7241 | 0.3181 |
121
+ | No log | 9.6 | 144 | 0.3199 | 0.7239 | 0.3191 |
122
+ | No log | 9.7333 | 146 | 0.3215 | 0.7103 | 0.3207 |
123
+ | No log | 9.8667 | 148 | 0.3223 | 0.7089 | 0.3215 |
124
+ | No log | 10.0 | 150 | 0.3225 | 0.7089 | 0.3218 |
 
 
 
 
 
125
 
126
 
127
  ### Framework versions