Hugging Face's logo

dl-ru
/
rubert-tiny2-srl

Token Classification
Transformers
PyTorch
bert
Generated from Trainer
Model card Files
xet
 Community
2
dl-ru commited on
Commit
a1f365b
·
1 Parent(s): d9506dc

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +41 -37
README.md CHANGED
@@ -14,43 +14,47 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [cointegrated/rubert-tiny2](https://huggingface.co/cointegrated/rubert-tiny2) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 0.2182
 
 
 
 
18
  - Benefactive Precision: 0.0
19
  - Benefactive Recall: 0.0
20
  - Benefactive F1: 0.0
21
- - Benefactive Number: 2
22
- - Causator Precision: 0.7333
23
- - Causator Recall: 0.9167
24
- - Causator F1: 0.8148
25
- - Causator Number: 12
26
- - Cause Precision: 0.5
27
- - Cause Recall: 0.2
28
- - Cause F1: 0.2857
29
- - Cause Number: 5
30
- - Contrsubject Precision: 1.0
31
- - Contrsubject Recall: 0.2222
32
- - Contrsubject F1: 0.3636
33
- - Contrsubject Number: 9
34
  - Deliberative Precision: 1.0
35
- - Deliberative Recall: 0.25
36
- - Deliberative F1: 0.4
37
- - Deliberative Number: 4
38
- - Experiencer Precision: 0.7108
39
- - Experiencer Recall: 0.7468
40
- - Experiencer F1: 0.7284
41
- - Experiencer Number: 79
42
- - Object Precision: 0.6966
43
- - Object Recall: 0.6779
44
- - Object F1: 0.6871
45
- - Object Number: 149
46
- - Predicate Precision: 0.9847
47
- - Predicate Recall: 0.9923
48
- - Predicate F1: 0.9885
49
- - Predicate Number: 260
50
- - Overall Precision: 0.8490
51
- - Overall Recall: 0.8327
52
- - Overall F1: 0.8408
53
- - Overall Accuracy: 0.9274
54
 
55
  ## Model description
56
 
@@ -83,10 +87,10 @@ The following hyperparameters were used during training:
83
 
84
  ### Training results
85
 
86
- | Training Loss | Epoch | Step | Validation Loss | Benefactive Precision | Benefactive Recall | Benefactive F1 | Benefactive Number | Causator Precision | Causator Recall | Causator F1 | Causator Number | Cause Precision | Cause Recall | Cause F1 | Cause Number | Contrsubject Precision | Contrsubject Recall | Contrsubject F1 | Contrsubject Number | Deliberative Precision | Deliberative Recall | Deliberative F1 | Deliberative Number | Experiencer Precision | Experiencer Recall | Experiencer F1 | Experiencer Number | Object Precision | Object Recall | Object F1 | Object Number | Predicate Precision | Predicate Recall | Predicate F1 | Predicate Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
87
- |:-------------:|:-----:|:----:|:---------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:------------------:|:---------------:|:-----------:|:---------------:|:---------------:|:------------:|:--------:|:------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:----------------:|:-------------:|:---------:|:-------------:|:-------------------:|:----------------:|:------------:|:----------------:|:-----------------:|:--------------:|:----------:|:----------------:|
88
- | 0.2886 | 1.0 | 152 | 0.2507 | 0.0 | 0.0 | 0.0 | 2 | 0.6667 | 0.8333 | 0.7407 | 12 | 1.0 | 0.2 | 0.3333 | 5 | 1.0 | 0.1111 | 0.2000 | 9 | 0.0 | 0.0 | 0.0 | 4 | 0.6596 | 0.7848 | 0.7168 | 79 | 0.7232 | 0.5436 | 0.6207 | 149 | 0.9847 | 0.9885 | 0.9866 | 260 | 0.8512 | 0.7923 | 0.8207 | 0.9203 |
89
- | 0.1911 | 2.0 | 304 | 0.2182 | 0.0 | 0.0 | 0.0 | 2 | 0.7333 | 0.9167 | 0.8148 | 12 | 0.5 | 0.2 | 0.2857 | 5 | 1.0 | 0.2222 | 0.3636 | 9 | 1.0 | 0.25 | 0.4 | 4 | 0.7108 | 0.7468 | 0.7284 | 79 | 0.6966 | 0.6779 | 0.6871 | 149 | 0.9847 | 0.9923 | 0.9885 | 260 | 0.8490 | 0.8327 | 0.8408 | 0.9274 |
90
 
91
 
92
  ### Framework versions
 
14
 
15
  This model is a fine-tuned version of [cointegrated/rubert-tiny2](https://huggingface.co/cointegrated/rubert-tiny2) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 0.2041
18
+ - Addressee Precision: 0.7273
19
+ - Addressee Recall: 0.8
20
+ - Addressee F1: 0.7619
21
+ - Addressee Number: 10
22
  - Benefactive Precision: 0.0
23
  - Benefactive Recall: 0.0
24
  - Benefactive F1: 0.0
25
+ - Benefactive Number: 1
26
+ - Causator Precision: 0.8824
27
+ - Causator Recall: 0.8333
28
+ - Causator F1: 0.8571
29
+ - Causator Number: 18
30
+ - Cause Precision: 0.6667
31
+ - Cause Recall: 0.1538
32
+ - Cause F1: 0.25
33
+ - Cause Number: 13
34
+ - Contrsubject Precision: 0.6667
35
+ - Contrsubject Recall: 0.3333
36
+ - Contrsubject F1: 0.4444
37
+ - Contrsubject Number: 6
38
  - Deliberative Precision: 1.0
39
+ - Deliberative Recall: 0.4
40
+ - Deliberative F1: 0.5714
41
+ - Deliberative Number: 5
42
+ - Experiencer Precision: 0.7660
43
+ - Experiencer Recall: 0.8
44
+ - Experiencer F1: 0.7826
45
+ - Experiencer Number: 90
46
+ - Object Precision: 0.7576
47
+ - Object Recall: 0.6868
48
+ - Object F1: 0.7205
49
+ - Object Number: 182
50
+ - Predicate Precision: 0.9713
51
+ - Predicate Recall: 0.9967
52
+ - Predicate F1: 0.9839
53
+ - Predicate Number: 306
54
+ - Overall Precision: 0.8719
55
+ - Overall Recall: 0.8415
56
+ - Overall F1: 0.8565
57
+ - Overall Accuracy: 0.9429
58
 
59
  ## Model description
60
 
 
87
 
88
  ### Training results
89
 
90
+ | Training Loss | Epoch | Step | Validation Loss | Addressee Precision | Addressee Recall | Addressee F1 | Addressee Number | Benefactive Precision | Benefactive Recall | Benefactive F1 | Benefactive Number | Causator Precision | Causator Recall | Causator F1 | Causator Number | Cause Precision | Cause Recall | Cause F1 | Cause Number | Contrsubject Precision | Contrsubject Recall | Contrsubject F1 | Contrsubject Number | Deliberative Precision | Deliberative Recall | Deliberative F1 | Deliberative Number | Experiencer Precision | Experiencer Recall | Experiencer F1 | Experiencer Number | Object Precision | Object Recall | Object F1 | Object Number | Predicate Precision | Predicate Recall | Predicate F1 | Predicate Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
91
+ |:-------------:|:-----:|:----:|:---------------:|:-------------------:|:----------------:|:------------:|:----------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:------------------:|:---------------:|:-----------:|:---------------:|:---------------:|:------------:|:--------:|:------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:----------------:|:-------------:|:---------:|:-------------:|:-------------------:|:----------------:|:------------:|:----------------:|:-----------------:|:--------------:|:----------:|:----------------:|
92
+ | 0.2845 | 1.0 | 181 | 0.2356 | 0.8 | 0.8 | 0.8000 | 10 | 0.0 | 0.0 | 0.0 | 1 | 0.7895 | 0.8333 | 0.8108 | 18 | 0.0 | 0.0 | 0.0 | 13 | 0.0 | 0.0 | 0.0 | 6 | 0.0 | 0.0 | 0.0 | 5 | 0.7320 | 0.7889 | 0.7594 | 90 | 0.7740 | 0.6209 | 0.6890 | 182 | 0.9744 | 0.9935 | 0.9838 | 306 | 0.875 | 0.8098 | 0.8412 | 0.9376 |
93
+ | 0.1875 | 1.99 | 362 | 0.2041 | 0.7273 | 0.8 | 0.7619 | 10 | 0.0 | 0.0 | 0.0 | 1 | 0.8824 | 0.8333 | 0.8571 | 18 | 0.6667 | 0.1538 | 0.25 | 13 | 0.6667 | 0.3333 | 0.4444 | 6 | 1.0 | 0.4 | 0.5714 | 5 | 0.7660 | 0.8 | 0.7826 | 90 | 0.7576 | 0.6868 | 0.7205 | 182 | 0.9713 | 0.9967 | 0.9839 | 306 | 0.8719 | 0.8415 | 0.8565 | 0.9429 |
94
 
95
 
96
  ### Framework versions