docs: final touces
Browse files
README.md
CHANGED
@@ -72,11 +72,11 @@ Ablation 3 is using the proposed hyper-parameters from the "[Don't Stop Pretrain
|
|
72 |
|
73 |
Now we report the MLM accuracy and loss for the training, including the downstream task performance on the [BarNER](https://arxiv.org/abs/2403.12749) dataset. For fine-tuning, we use the last checkpoint and the hyper-parameters as specified in the [GERTuraX Fine-Tuner](https://github.com/stefan-it/gerturax-fine-tuner) repo:
|
74 |
|
75 |
-
| Metric | Ablation 1 | Ablation 2
|
76 |
-
|:--------------- | ------------:|
|
77 |
-
| MLM Accuracy | 72.24 |
|
78 |
-
| Train Loss | 2.9175 |
|
79 |
-
| BarNER F1-Score | 80.21 ± 0.31 | 80.83 ± 0.28 | 80.59 ± 0.35 | 80.06 ± 0.41 |
|
80 |
|
81 |
# Results
|
82 |
|
|
|
72 |
|
73 |
Now we report the MLM accuracy and loss for the training, including the downstream task performance on the [BarNER](https://arxiv.org/abs/2403.12749) dataset. For fine-tuning, we use the last checkpoint and the hyper-parameters as specified in the [GERTuraX Fine-Tuner](https://github.com/stefan-it/gerturax-fine-tuner) repo:
|
74 |
|
75 |
+
| Metric | Ablation 1 | Ablation 2 | Ablation 3 | Ablation 4 |
|
76 |
+
|:--------------- | ------------:| ----------------:| ------------:| ------------:|
|
77 |
+
| MLM Accuracy | 72.24 | 72.17 | 72.99 | 71.61 |
|
78 |
+
| Train Loss | 2.9175 | 2.9248 | 2.8785 | 2.9689 |
|
79 |
+
| BarNER F1-Score | 80.21 ± 0.31 | **80.83** ± 0.28 | 80.59 ± 0.35 | 80.06 ± 0.41 |
|
80 |
|
81 |
# Results
|
82 |
|