Hugging Face's logo

salbatarni
/
arabert_cross_vocabulary_task7_fold2

TensorBoard
Safetensors
bert
Generated from Trainer
Model card Files Metrics Community
salbatarni commited on
Commit
43e92b1
•
1 Parent(s): bf05bd5

End of training

Browse files
Files changed (1) hide show
  1. README.md +38 -35
README.md CHANGED
@@ -3,20 +3,20 @@ base_model: aubmindlab/bert-base-arabertv02
3
  tags:
4
  - generated_from_trainer
5
  model-index:
6
- - name: arabert_cross_vocabulary_task7_fold1
7
  results: []
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
  should probably proofread and complete it, then remove this comment. -->
12
 
13
- # arabert_cross_vocabulary_task7_fold1
14
 
15
  This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 0.8627
18
- - Qwk: 0.3143
19
- - Mse: 0.8627
20
 
21
  ## Model description
22
 
@@ -45,36 +45,39 @@ The following hyperparameters were used during training:
45
 
46
  ### Training results
47
 
48
- | Training Loss | Epoch | Step | Validation Loss | Qwk | Mse |
49
- |:-------------:|:------:|:----:|:---------------:|:------:|:------:|
50
- | No log | 0.0351 | 2 | 3.8189 | 0.0193 | 3.8189 |
51
- | No log | 0.0702 | 4 | 1.7985 | 0.0716 | 1.7985 |
52
- | No log | 0.1053 | 6 | 1.6094 | 0.1126 | 1.6094 |
53
- | No log | 0.1404 | 8 | 1.2553 | 0.1291 | 1.2553 |
54
- | No log | 0.1754 | 10 | 0.8065 | 0.1674 | 0.8065 |
55
- | No log | 0.2105 | 12 | 0.7741 | 0.2489 | 0.7741 |
56
- | No log | 0.2456 | 14 | 1.1045 | 0.2614 | 1.1045 |
57
- | No log | 0.2807 | 16 | 1.1978 | 0.2692 | 1.1978 |
58
- | No log | 0.3158 | 18 | 1.0983 | 0.2938 | 1.0983 |
59
- | No log | 0.3509 | 20 | 1.0710 | 0.3026 | 1.0710 |
60
- | No log | 0.3860 | 22 | 0.6682 | 0.3670 | 0.6682 |
61
- | No log | 0.4211 | 24 | 0.5966 | 0.4097 | 0.5966 |
62
- | No log | 0.4561 | 26 | 0.6833 | 0.3683 | 0.6833 |
63
- | No log | 0.4912 | 28 | 0.9987 | 0.2985 | 0.9987 |
64
- | No log | 0.5263 | 30 | 1.2852 | 0.2523 | 1.2852 |
65
- | No log | 0.5614 | 32 | 1.0778 | 0.2737 | 1.0778 |
66
- | No log | 0.5965 | 34 | 0.7230 | 0.3317 | 0.7230 |
67
- | No log | 0.6316 | 36 | 0.6062 | 0.4082 | 0.6062 |
68
- | No log | 0.6667 | 38 | 0.5822 | 0.4172 | 0.5822 |
69
- | No log | 0.7018 | 40 | 0.6112 | 0.4001 | 0.6112 |
70
- | No log | 0.7368 | 42 | 0.6913 | 0.3542 | 0.6913 |
71
- | No log | 0.7719 | 44 | 0.8003 | 0.3063 | 0.8003 |
72
- | No log | 0.8070 | 46 | 0.8430 | 0.3051 | 0.8430 |
73
- | No log | 0.8421 | 48 | 0.8930 | 0.3029 | 0.8930 |
74
- | No log | 0.8772 | 50 | 0.8887 | 0.3031 | 0.8887 |
75
- | No log | 0.9123 | 52 | 0.8824 | 0.2971 | 0.8824 |
76
- | No log | 0.9474 | 54 | 0.8755 | 0.2971 | 0.8755 |
77
- | No log | 0.9825 | 56 | 0.8627 | 0.3143 | 0.8627 |
 
 
 
78
 
79
 
80
  ### Framework versions
 
3
  tags:
4
  - generated_from_trainer
5
  model-index:
6
+ - name: arabert_cross_vocabulary_task7_fold2
7
  results: []
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
  should probably proofread and complete it, then remove this comment. -->
12
 
13
+ # arabert_cross_vocabulary_task7_fold2
14
 
15
  This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 0.7372
18
+ - Qwk: 0.0
19
+ - Mse: 0.7250
20
 
21
  ## Model description
22
 
 
45
 
46
  ### Training results
47
 
48
+ | Training Loss | Epoch | Step | Validation Loss | Qwk | Mse |
49
+ |:-------------:|:------:|:----:|:---------------:|:-------:|:------:|
50
+ | No log | 0.0317 | 2 | 3.4222 | 0.0005 | 3.4448 |
51
+ | No log | 0.0635 | 4 | 0.8344 | -0.0075 | 0.8385 |
52
+ | No log | 0.0952 | 6 | 0.6004 | 0.0456 | 0.5963 |
53
+ | No log | 0.1270 | 8 | 0.5812 | -0.0227 | 0.5744 |
54
+ | No log | 0.1587 | 10 | 0.6585 | 0.0 | 0.6498 |
55
+ | No log | 0.1905 | 12 | 0.6873 | 0.0 | 0.6781 |
56
+ | No log | 0.2222 | 14 | 0.6603 | 0.0 | 0.6514 |
57
+ | No log | 0.2540 | 16 | 0.5985 | -0.0496 | 0.5919 |
58
+ | No log | 0.2857 | 18 | 0.5749 | -0.0344 | 0.5697 |
59
+ | No log | 0.3175 | 20 | 0.5691 | -0.0546 | 0.5649 |
60
+ | No log | 0.3492 | 22 | 0.5753 | -0.0344 | 0.5700 |
61
+ | No log | 0.3810 | 24 | 0.6027 | -0.0886 | 0.5953 |
62
+ | No log | 0.4127 | 26 | 0.6013 | -0.0886 | 0.5936 |
63
+ | No log | 0.4444 | 28 | 0.6360 | -0.0252 | 0.6265 |
64
+ | No log | 0.4762 | 30 | 0.6499 | -0.0252 | 0.6399 |
65
+ | No log | 0.5079 | 32 | 0.7649 | 0.0 | 0.7525 |
66
+ | No log | 0.5397 | 34 | 0.8350 | 0.0 | 0.8221 |
67
+ | No log | 0.5714 | 36 | 0.8330 | 0.0 | 0.8214 |
68
+ | No log | 0.6032 | 38 | 0.7620 | 0.0 | 0.7524 |
69
+ | No log | 0.6349 | 40 | 0.7292 | 0.0 | 0.7198 |
70
+ | No log | 0.6667 | 42 | 0.6967 | 0.0 | 0.6875 |
71
+ | No log | 0.6984 | 44 | 0.7020 | 0.0 | 0.6922 |
72
+ | No log | 0.7302 | 46 | 0.7157 | 0.0 | 0.7048 |
73
+ | No log | 0.7619 | 48 | 0.7198 | 0.0 | 0.7083 |
74
+ | No log | 0.7937 | 50 | 0.6970 | 0.0 | 0.6856 |
75
+ | No log | 0.8254 | 52 | 0.6743 | 0.0 | 0.6632 |
76
+ | No log | 0.8571 | 54 | 0.6647 | 0.0 | 0.6537 |
77
+ | No log | 0.8889 | 56 | 0.6819 | 0.0 | 0.6706 |
78
+ | No log | 0.9206 | 58 | 0.7064 | 0.0 | 0.6946 |
79
+ | No log | 0.9524 | 60 | 0.7251 | 0.0 | 0.7130 |
80
+ | No log | 0.9841 | 62 | 0.7372 | 0.0 | 0.7250 |
81
 
82
 
83
  ### Framework versions