lcampillos commited on
Commit
3017bc1
1 Parent(s): adee3ee

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -11
README.md CHANGED
@@ -14,7 +14,6 @@ widget:
14
  - text: "Pacientes sanos, sin ninguna enfermedad, que no tomen ningún medicamento"
15
  - text: "Sujetos adultos con cáncer de próstata asintomáticos y no tratados previamente"
16
  - text: "Probable infección por SARS-CoV-2 y sospecha de enfermedad autoinmune"
17
-
18
  ---
19
 
20
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -29,10 +28,11 @@ This named entity recognition model detects negation and speculation entities, a
29
  - Speculated: speculated entity or event (e.g. *posiblemente **sobreviva***)
30
 
31
  The model achieves the following results on the test set (when trained with the training and development set; results are averaged over 5 evaluation rounds):
32
- - Precision: 0.840 (±0.003)
33
- - Recall: 0.866 (±0.005)
34
- - F1: 0.853 (±0.004)
35
- - Accuracy: 0.985 (±0.001)
 
36
 
37
  ## Model description
38
 
@@ -99,24 +99,24 @@ The following hyperparameters were used during training:
99
  - seed: we used different seeds for 5 evaluation rounds, and uploaded the model with the best results
100
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
101
  - lr_scheduler_type: linear
102
- - num_epochs: average 10.5 epochs (±1.9); trained with early stopping if no improvement after 5 epochs (early stopping patience: 5)
103
 
104
 
105
  ### Training results (test set; average and standard deviation of 5 rounds with different seeds)
106
 
107
  | Precision | Recall | F1 | Accuracy |
108
  |:--------------:|:--------------:|:--------------:|:--------------:|
109
- | 0.840 (±0.003) | 0.866 (±0.005) | 0.853 (±0.004) | 0.985 (±0.001) |
110
 
111
 
112
  **Results per class (test set; average and standard deviation of 5 rounds with different seeds)**
113
 
114
  | Class | Precision | Recall | F1 | Support |
115
  |:-----------:|:--------------:|:--------------:|:--------------:|:---------:|
116
- | Neg_cue | 0.938 (±0.004) | 0.963 (±0.003) | 0.950 (±0.002) | 2436 |
117
- | Negated | 0.799 (±0.018) | 0.843 (±0.008) | 0.820 (±0.010) | 3086 |
118
- | Spec_cue | 0.821 (±0.021) | 0.852 (±0.015) | 0.836 (±0.008) | 749 |
119
- | Speculated | 0.710 (±0.002) | 0.721 (±0.010) | 0.715 (±0.005) | 996 |
120
 
121
 
122
  ### Framework versions
 
14
  - text: "Pacientes sanos, sin ninguna enfermedad, que no tomen ningún medicamento"
15
  - text: "Sujetos adultos con cáncer de próstata asintomáticos y no tratados previamente"
16
  - text: "Probable infección por SARS-CoV-2 y sospecha de enfermedad autoinmune"
 
17
  ---
18
 
19
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
28
  - Speculated: speculated entity or event (e.g. *posiblemente **sobreviva***)
29
 
30
  The model achieves the following results on the test set (when trained with the training and development set; results are averaged over 5 evaluation rounds):
31
+ - Precision: 0.855 (±0.005)
32
+ - Recall: 0.864 (±0.008)
33
+ - F1: 0.859 (±0.006)
34
+ - Accuracy: 0.986 (±0.001)
35
+
36
 
37
  ## Model description
38
 
 
99
  - seed: we used different seeds for 5 evaluation rounds, and uploaded the model with the best results
100
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
101
  - lr_scheduler_type: linear
102
+ - num_epochs: average 10.8 epochs (±1.9); trained with early stopping if no improvement after 5 epochs (early stopping patience: 5)
103
 
104
 
105
  ### Training results (test set; average and standard deviation of 5 rounds with different seeds)
106
 
107
  | Precision | Recall | F1 | Accuracy |
108
  |:--------------:|:--------------:|:--------------:|:--------------:|
109
+ | 0.855 (±0.005) | 0.864 (±0.008) | 0.859 (±0.006) | 0.986 (±0.001) |
110
 
111
 
112
  **Results per class (test set; average and standard deviation of 5 rounds with different seeds)**
113
 
114
  | Class | Precision | Recall | F1 | Support |
115
  |:-----------:|:--------------:|:--------------:|:--------------:|:---------:|
116
+ | Neg_cue | 0.955 (±0.006) | 0.958 (±0.006) | 0.957 (±0.005) | 2484 |
117
+ | Negated | 0.829 (±0.005) | 0.837 (±0.014) | 0.833 (±0.008) | 3160 |
118
+ | Spec_cue | 0.834 (±0.021) | 0.859 (±0.017) | 0.846 (±0.007) | 756 |
119
+ | Speculated | 0.708 (±0.019) | 0.719 (±0.016) | 0.713 (±0.016) | 1008 |
120
 
121
 
122
  ### Framework versions