lcampillos
commited on
Commit
•
3017bc1
1
Parent(s):
adee3ee
Update README.md
Browse files
README.md
CHANGED
@@ -14,7 +14,6 @@ widget:
|
|
14 |
- text: "Pacientes sanos, sin ninguna enfermedad, que no tomen ningún medicamento"
|
15 |
- text: "Sujetos adultos con cáncer de próstata asintomáticos y no tratados previamente"
|
16 |
- text: "Probable infección por SARS-CoV-2 y sospecha de enfermedad autoinmune"
|
17 |
-
|
18 |
---
|
19 |
|
20 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
@@ -29,10 +28,11 @@ This named entity recognition model detects negation and speculation entities, a
|
|
29 |
- Speculated: speculated entity or event (e.g. *posiblemente **sobreviva***)
|
30 |
|
31 |
The model achieves the following results on the test set (when trained with the training and development set; results are averaged over 5 evaluation rounds):
|
32 |
-
- Precision: 0.
|
33 |
-
- Recall: 0.
|
34 |
-
- F1: 0.
|
35 |
-
- Accuracy: 0.
|
|
|
36 |
|
37 |
## Model description
|
38 |
|
@@ -99,24 +99,24 @@ The following hyperparameters were used during training:
|
|
99 |
- seed: we used different seeds for 5 evaluation rounds, and uploaded the model with the best results
|
100 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
101 |
- lr_scheduler_type: linear
|
102 |
-
- num_epochs: average 10.
|
103 |
|
104 |
|
105 |
### Training results (test set; average and standard deviation of 5 rounds with different seeds)
|
106 |
|
107 |
| Precision | Recall | F1 | Accuracy |
|
108 |
|:--------------:|:--------------:|:--------------:|:--------------:|
|
109 |
-
| 0.
|
110 |
|
111 |
|
112 |
**Results per class (test set; average and standard deviation of 5 rounds with different seeds)**
|
113 |
|
114 |
| Class | Precision | Recall | F1 | Support |
|
115 |
|:-----------:|:--------------:|:--------------:|:--------------:|:---------:|
|
116 |
-
| Neg_cue | 0.
|
117 |
-
| Negated | 0.
|
118 |
-
| Spec_cue | 0.
|
119 |
-
| Speculated | 0.
|
120 |
|
121 |
|
122 |
### Framework versions
|
|
|
14 |
- text: "Pacientes sanos, sin ninguna enfermedad, que no tomen ningún medicamento"
|
15 |
- text: "Sujetos adultos con cáncer de próstata asintomáticos y no tratados previamente"
|
16 |
- text: "Probable infección por SARS-CoV-2 y sospecha de enfermedad autoinmune"
|
|
|
17 |
---
|
18 |
|
19 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
|
|
28 |
- Speculated: speculated entity or event (e.g. *posiblemente **sobreviva***)
|
29 |
|
30 |
The model achieves the following results on the test set (when trained with the training and development set; results are averaged over 5 evaluation rounds):
|
31 |
+
- Precision: 0.855 (±0.005)
|
32 |
+
- Recall: 0.864 (±0.008)
|
33 |
+
- F1: 0.859 (±0.006)
|
34 |
+
- Accuracy: 0.986 (±0.001)
|
35 |
+
|
36 |
|
37 |
## Model description
|
38 |
|
|
|
99 |
- seed: we used different seeds for 5 evaluation rounds, and uploaded the model with the best results
|
100 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
101 |
- lr_scheduler_type: linear
|
102 |
+
- num_epochs: average 10.8 epochs (±1.9); trained with early stopping if no improvement after 5 epochs (early stopping patience: 5)
|
103 |
|
104 |
|
105 |
### Training results (test set; average and standard deviation of 5 rounds with different seeds)
|
106 |
|
107 |
| Precision | Recall | F1 | Accuracy |
|
108 |
|:--------------:|:--------------:|:--------------:|:--------------:|
|
109 |
+
| 0.855 (±0.005) | 0.864 (±0.008) | 0.859 (±0.006) | 0.986 (±0.001) |
|
110 |
|
111 |
|
112 |
**Results per class (test set; average and standard deviation of 5 rounds with different seeds)**
|
113 |
|
114 |
| Class | Precision | Recall | F1 | Support |
|
115 |
|:-----------:|:--------------:|:--------------:|:--------------:|:---------:|
|
116 |
+
| Neg_cue | 0.955 (±0.006) | 0.958 (±0.006) | 0.957 (±0.005) | 2484 |
|
117 |
+
| Negated | 0.829 (±0.005) | 0.837 (±0.014) | 0.833 (±0.008) | 3160 |
|
118 |
+
| Spec_cue | 0.834 (±0.021) | 0.859 (±0.017) | 0.846 (±0.007) | 756 |
|
119 |
+
| Speculated | 0.708 (±0.019) | 0.719 (±0.016) | 0.713 (±0.016) | 1008 |
|
120 |
|
121 |
|
122 |
### Framework versions
|