PyTorch
TensorBoard
Safetensors
Bavarian
electra
stefan-it commited on
Commit
30daa68
·
verified ·
1 Parent(s): 3f027ec

docs: final touces

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -72,11 +72,11 @@ Ablation 3 is using the proposed hyper-parameters from the "[Don't Stop Pretrain
72
 
73
  Now we report the MLM accuracy and loss for the training, including the downstream task performance on the [BarNER](https://arxiv.org/abs/2403.12749) dataset. For fine-tuning, we use the last checkpoint and the hyper-parameters as specified in the [GERTuraX Fine-Tuner](https://github.com/stefan-it/gerturax-fine-tuner) repo:
74
 
75
- | Metric | Ablation 1 | Ablation 2 | Ablation 3 | Ablation 4 |
76
- |:--------------- | ------------:| ------------:| ------------:| ------------:|
77
- | MLM Accuracy | 72.24 | 72.17 | 72.99 | 71.61 |
78
- | Train Loss | 2.9175 | 2.9248 | 2.8785 | 2.9689 |
79
- | BarNER F1-Score | 80.21 ± 0.31 | 80.83 ± 0.28 | 80.59 ± 0.35 | 80.06 ± 0.41 |
80
 
81
  # Results
82
 
 
72
 
73
  Now we report the MLM accuracy and loss for the training, including the downstream task performance on the [BarNER](https://arxiv.org/abs/2403.12749) dataset. For fine-tuning, we use the last checkpoint and the hyper-parameters as specified in the [GERTuraX Fine-Tuner](https://github.com/stefan-it/gerturax-fine-tuner) repo:
74
 
75
+ | Metric | Ablation 1 | Ablation 2 | Ablation 3 | Ablation 4 |
76
+ |:--------------- | ------------:| ----------------:| ------------:| ------------:|
77
+ | MLM Accuracy | 72.24 | 72.17 | 72.99 | 71.61 |
78
+ | Train Loss | 2.9175 | 2.9248 | 2.8785 | 2.9689 |
79
+ | BarNER F1-Score | 80.21 ± 0.31 | **80.83** ± 0.28 | 80.59 ± 0.35 | 80.06 ± 0.41 |
80
 
81
  # Results
82