| 2022-04-25 00:28:46,333 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:28:46,337 Model: "SequenceTagger( | |
| (embeddings): TransformerWordEmbeddings( | |
| (model): XLMRobertaModel( | |
| (embeddings): RobertaEmbeddings( | |
| (word_embeddings): Embedding(250002, 1024, padding_idx=1) | |
| (position_embeddings): Embedding(514, 1024, padding_idx=1) | |
| (token_type_embeddings): Embedding(1, 1024) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (encoder): RobertaEncoder( | |
| (layer): ModuleList( | |
| (0): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (1): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (2): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (3): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (4): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (5): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (6): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (7): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (8): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (9): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (10): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (11): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (12): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (13): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (14): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (15): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (16): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (17): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (18): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (19): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (20): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (21): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (22): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (23): RobertaLayer( | |
| (attention): RobertaAttention( | |
| (self): RobertaSelfAttention( | |
| (query): Linear(in_features=1024, out_features=1024, bias=True) | |
| (key): Linear(in_features=1024, out_features=1024, bias=True) | |
| (value): Linear(in_features=1024, out_features=1024, bias=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| (output): RobertaSelfOutput( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| (intermediate): RobertaIntermediate( | |
| (dense): Linear(in_features=1024, out_features=4096, bias=True) | |
| (intermediate_act_fn): GELUActivation() | |
| ) | |
| (output): RobertaOutput( | |
| (dense): Linear(in_features=4096, out_features=1024, bias=True) | |
| (LayerNorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) | |
| (dropout): Dropout(p=0.1, inplace=False) | |
| ) | |
| ) | |
| ) | |
| ) | |
| (pooler): RobertaPooler( | |
| (dense): Linear(in_features=1024, out_features=1024, bias=True) | |
| (activation): Tanh() | |
| ) | |
| ) | |
| ) | |
| (word_dropout): WordDropout(p=0.05) | |
| (locked_dropout): LockedDropout(p=0.5) | |
| (linear): Linear(in_features=1024, out_features=20, bias=True) | |
| (loss_function): CrossEntropyLoss() | |
| )" | |
| 2022-04-25 00:28:46,337 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:28:46,338 Corpus: "Corpus: 352 train + 50 dev + 67 test sentences" | |
| 2022-04-25 00:28:46,338 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:28:46,339 Parameters: | |
| 2022-04-25 00:28:46,339 - learning_rate: "0.000005" | |
| 2022-04-25 00:28:46,340 - mini_batch_size: "4" | |
| 2022-04-25 00:28:46,340 - patience: "3" | |
| 2022-04-25 00:28:46,340 - anneal_factor: "0.5" | |
| 2022-04-25 00:28:46,341 - max_epochs: "10" | |
| 2022-04-25 00:28:46,341 - shuffle: "True" | |
| 2022-04-25 00:28:46,342 - train_with_dev: "False" | |
| 2022-04-25 00:28:46,342 - batch_growth_annealing: "False" | |
| 2022-04-25 00:28:46,343 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:28:46,343 Model training base path: "resources/taggers/ner_xlm_finedtuned_ck1" | |
| 2022-04-25 00:28:46,344 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:28:46,345 Device: cuda:0 | |
| 2022-04-25 00:28:46,345 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:28:46,346 Embeddings storage mode: none | |
| 2022-04-25 00:28:46,346 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:28:55,605 epoch 1 - iter 8/88 - loss 1.25822871 - samples/sec: 3.46 - lr: 0.000000 | |
| 2022-04-25 00:29:03,857 epoch 1 - iter 16/88 - loss 1.22365524 - samples/sec: 3.88 - lr: 0.000001 | |
| 2022-04-25 00:29:13,839 epoch 1 - iter 24/88 - loss 1.18822646 - samples/sec: 3.21 - lr: 0.000001 | |
| 2022-04-25 00:29:23,244 epoch 1 - iter 32/88 - loss 1.12798044 - samples/sec: 3.40 - lr: 0.000002 | |
| 2022-04-25 00:29:31,472 epoch 1 - iter 40/88 - loss 1.05740151 - samples/sec: 3.89 - lr: 0.000002 | |
| 2022-04-25 00:29:38,751 epoch 1 - iter 48/88 - loss 0.99049744 - samples/sec: 4.40 - lr: 0.000003 | |
| 2022-04-25 00:29:46,982 epoch 1 - iter 56/88 - loss 0.92466364 - samples/sec: 3.89 - lr: 0.000003 | |
| 2022-04-25 00:29:54,849 epoch 1 - iter 64/88 - loss 0.87012404 - samples/sec: 4.07 - lr: 0.000004 | |
| 2022-04-25 00:30:04,123 epoch 1 - iter 72/88 - loss 0.80738819 - samples/sec: 3.45 - lr: 0.000004 | |
| 2022-04-25 00:30:13,985 epoch 1 - iter 80/88 - loss 0.76049921 - samples/sec: 3.25 - lr: 0.000005 | |
| 2022-04-25 00:30:23,710 epoch 1 - iter 88/88 - loss 0.72027292 - samples/sec: 3.29 - lr: 0.000005 | |
| 2022-04-25 00:30:23,712 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:30:23,713 EPOCH 1 done: loss 0.7203 - lr 0.000005 | |
| 2022-04-25 00:30:30,732 Evaluating as a multi-label problem: False | |
| 2022-04-25 00:30:30,742 DEV : loss 0.20562097430229187 - f1-score (micro avg) 0.0027 | |
| 2022-04-25 00:30:30,751 BAD EPOCHS (no improvement): 4 | |
| 2022-04-25 00:30:30,753 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:30:39,284 epoch 2 - iter 8/88 - loss 0.32586993 - samples/sec: 3.75 - lr: 0.000005 | |
| 2022-04-25 00:30:47,933 epoch 2 - iter 16/88 - loss 0.33892041 - samples/sec: 3.70 - lr: 0.000005 | |
| 2022-04-25 00:30:56,990 epoch 2 - iter 24/88 - loss 0.33672071 - samples/sec: 3.53 - lr: 0.000005 | |
| 2022-04-25 00:31:05,736 epoch 2 - iter 32/88 - loss 0.33060665 - samples/sec: 3.66 - lr: 0.000005 | |
| 2022-04-25 00:31:13,937 epoch 2 - iter 40/88 - loss 0.33045049 - samples/sec: 3.90 - lr: 0.000005 | |
| 2022-04-25 00:31:23,091 epoch 2 - iter 48/88 - loss 0.32851558 - samples/sec: 3.50 - lr: 0.000005 | |
| 2022-04-25 00:31:31,313 epoch 2 - iter 56/88 - loss 0.32679558 - samples/sec: 3.89 - lr: 0.000005 | |
| 2022-04-25 00:31:41,184 epoch 2 - iter 64/88 - loss 0.32379177 - samples/sec: 3.24 - lr: 0.000005 | |
| 2022-04-25 00:31:49,757 epoch 2 - iter 72/88 - loss 0.32124627 - samples/sec: 3.73 - lr: 0.000005 | |
| 2022-04-25 00:31:57,768 epoch 2 - iter 80/88 - loss 0.32825760 - samples/sec: 4.00 - lr: 0.000004 | |
| 2022-04-25 00:32:08,014 epoch 2 - iter 88/88 - loss 0.32124062 - samples/sec: 3.12 - lr: 0.000004 | |
| 2022-04-25 00:32:08,017 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:32:08,018 EPOCH 2 done: loss 0.3212 - lr 0.000004 | |
| 2022-04-25 00:32:15,400 Evaluating as a multi-label problem: False | |
| 2022-04-25 00:32:15,415 DEV : loss 0.15934991836547852 - f1-score (micro avg) 0.0082 | |
| 2022-04-25 00:32:15,428 BAD EPOCHS (no improvement): 4 | |
| 2022-04-25 00:32:15,431 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:32:25,133 epoch 3 - iter 8/88 - loss 0.26548392 - samples/sec: 3.30 - lr: 0.000004 | |
| 2022-04-25 00:32:33,272 epoch 3 - iter 16/88 - loss 0.28651787 - samples/sec: 3.93 - lr: 0.000004 | |
| 2022-04-25 00:32:41,433 epoch 3 - iter 24/88 - loss 0.29010948 - samples/sec: 3.92 - lr: 0.000004 | |
| 2022-04-25 00:32:50,243 epoch 3 - iter 32/88 - loss 0.29681501 - samples/sec: 3.63 - lr: 0.000004 | |
| 2022-04-25 00:32:59,007 epoch 3 - iter 40/88 - loss 0.29554105 - samples/sec: 3.65 - lr: 0.000004 | |
| 2022-04-25 00:33:07,692 epoch 3 - iter 48/88 - loss 0.29343573 - samples/sec: 3.69 - lr: 0.000004 | |
| 2022-04-25 00:33:16,189 epoch 3 - iter 56/88 - loss 0.29547981 - samples/sec: 3.77 - lr: 0.000004 | |
| 2022-04-25 00:33:25,763 epoch 3 - iter 64/88 - loss 0.28997972 - samples/sec: 3.34 - lr: 0.000004 | |
| 2022-04-25 00:33:36,471 epoch 3 - iter 72/88 - loss 0.29000464 - samples/sec: 2.99 - lr: 0.000004 | |
| 2022-04-25 00:33:45,481 epoch 3 - iter 80/88 - loss 0.29344732 - samples/sec: 3.55 - lr: 0.000004 | |
| 2022-04-25 00:33:53,793 epoch 3 - iter 88/88 - loss 0.29232563 - samples/sec: 3.85 - lr: 0.000004 | |
| 2022-04-25 00:33:53,797 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:33:53,798 EPOCH 3 done: loss 0.2923 - lr 0.000004 | |
| 2022-04-25 00:34:00,978 Evaluating as a multi-label problem: False | |
| 2022-04-25 00:34:00,991 DEV : loss 0.14386053383350372 - f1-score (micro avg) 0.0664 | |
| 2022-04-25 00:34:00,999 BAD EPOCHS (no improvement): 4 | |
| 2022-04-25 00:34:01,000 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:34:09,617 epoch 4 - iter 8/88 - loss 0.32142401 - samples/sec: 3.72 - lr: 0.000004 | |
| 2022-04-25 00:34:17,886 epoch 4 - iter 16/88 - loss 0.30301646 - samples/sec: 3.87 - lr: 0.000004 | |
| 2022-04-25 00:34:27,850 epoch 4 - iter 24/88 - loss 0.28913590 - samples/sec: 3.21 - lr: 0.000004 | |
| 2022-04-25 00:34:35,703 epoch 4 - iter 32/88 - loss 0.29200045 - samples/sec: 4.08 - lr: 0.000004 | |
| 2022-04-25 00:34:44,383 epoch 4 - iter 40/88 - loss 0.28601870 - samples/sec: 3.69 - lr: 0.000004 | |
| 2022-04-25 00:34:53,597 epoch 4 - iter 48/88 - loss 0.28333016 - samples/sec: 3.47 - lr: 0.000004 | |
| 2022-04-25 00:35:02,237 epoch 4 - iter 56/88 - loss 0.28101070 - samples/sec: 3.70 - lr: 0.000004 | |
| 2022-04-25 00:35:11,887 epoch 4 - iter 64/88 - loss 0.27725419 - samples/sec: 3.32 - lr: 0.000003 | |
| 2022-04-25 00:35:20,971 epoch 4 - iter 72/88 - loss 0.27522330 - samples/sec: 3.52 - lr: 0.000003 | |
| 2022-04-25 00:35:29,993 epoch 4 - iter 80/88 - loss 0.27767522 - samples/sec: 3.55 - lr: 0.000003 | |
| 2022-04-25 00:35:38,121 epoch 4 - iter 88/88 - loss 0.27780342 - samples/sec: 3.94 - lr: 0.000003 | |
| 2022-04-25 00:35:38,125 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:35:38,126 EPOCH 4 done: loss 0.2778 - lr 0.000003 | |
| 2022-04-25 00:35:45,523 Evaluating as a multi-label problem: False | |
| 2022-04-25 00:35:45,536 DEV : loss 0.13249367475509644 - f1-score (micro avg) 0.1099 | |
| 2022-04-25 00:35:45,545 BAD EPOCHS (no improvement): 4 | |
| 2022-04-25 00:35:45,547 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:35:55,215 epoch 5 - iter 8/88 - loss 0.26147172 - samples/sec: 3.31 - lr: 0.000003 | |
| 2022-04-25 00:36:05,160 epoch 5 - iter 16/88 - loss 0.26559845 - samples/sec: 3.22 - lr: 0.000003 | |
| 2022-04-25 00:36:13,857 epoch 5 - iter 24/88 - loss 0.26674131 - samples/sec: 3.68 - lr: 0.000003 | |
| 2022-04-25 00:36:22,022 epoch 5 - iter 32/88 - loss 0.26445641 - samples/sec: 3.92 - lr: 0.000003 | |
| 2022-04-25 00:36:29,834 epoch 5 - iter 40/88 - loss 0.26849622 - samples/sec: 4.10 - lr: 0.000003 | |
| 2022-04-25 00:36:38,499 epoch 5 - iter 48/88 - loss 0.26495720 - samples/sec: 3.69 - lr: 0.000003 | |
| 2022-04-25 00:36:46,651 epoch 5 - iter 56/88 - loss 0.26747065 - samples/sec: 3.93 - lr: 0.000003 | |
| 2022-04-25 00:36:56,479 epoch 5 - iter 64/88 - loss 0.26716735 - samples/sec: 3.26 - lr: 0.000003 | |
| 2022-04-25 00:37:05,247 epoch 5 - iter 72/88 - loss 0.26323866 - samples/sec: 3.65 - lr: 0.000003 | |
| 2022-04-25 00:37:14,099 epoch 5 - iter 80/88 - loss 0.26763434 - samples/sec: 3.62 - lr: 0.000003 | |
| 2022-04-25 00:37:23,612 epoch 5 - iter 88/88 - loss 0.26510194 - samples/sec: 3.36 - lr: 0.000003 | |
| 2022-04-25 00:37:23,615 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:37:23,615 EPOCH 5 done: loss 0.2651 - lr 0.000003 | |
| 2022-04-25 00:37:30,711 Evaluating as a multi-label problem: False | |
| 2022-04-25 00:37:30,723 DEV : loss 0.1335981786251068 - f1-score (micro avg) 0.1516 | |
| 2022-04-25 00:37:30,734 BAD EPOCHS (no improvement): 4 | |
| 2022-04-25 00:37:30,735 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:37:39,100 epoch 6 - iter 8/88 - loss 0.25254979 - samples/sec: 3.83 - lr: 0.000003 | |
| 2022-04-25 00:37:48,489 epoch 6 - iter 16/88 - loss 0.24629379 - samples/sec: 3.41 - lr: 0.000003 | |
| 2022-04-25 00:37:56,856 epoch 6 - iter 24/88 - loss 0.25016090 - samples/sec: 3.83 - lr: 0.000003 | |
| 2022-04-25 00:38:06,647 epoch 6 - iter 32/88 - loss 0.25646469 - samples/sec: 3.27 - lr: 0.000003 | |
| 2022-04-25 00:38:14,700 epoch 6 - iter 40/88 - loss 0.25909943 - samples/sec: 3.97 - lr: 0.000003 | |
| 2022-04-25 00:38:23,772 epoch 6 - iter 48/88 - loss 0.25850607 - samples/sec: 3.53 - lr: 0.000002 | |
| 2022-04-25 00:38:32,983 epoch 6 - iter 56/88 - loss 0.25417190 - samples/sec: 3.48 - lr: 0.000002 | |
| 2022-04-25 00:38:42,014 epoch 6 - iter 64/88 - loss 0.25534730 - samples/sec: 3.54 - lr: 0.000002 | |
| 2022-04-25 00:38:49,968 epoch 6 - iter 72/88 - loss 0.25617877 - samples/sec: 4.02 - lr: 0.000002 | |
| 2022-04-25 00:38:58,183 epoch 6 - iter 80/88 - loss 0.25537613 - samples/sec: 3.90 - lr: 0.000002 | |
| 2022-04-25 00:39:07,930 epoch 6 - iter 88/88 - loss 0.25729809 - samples/sec: 3.28 - lr: 0.000002 | |
| 2022-04-25 00:39:07,933 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:39:07,934 EPOCH 6 done: loss 0.2573 - lr 0.000002 | |
| 2022-04-25 00:39:15,220 Evaluating as a multi-label problem: False | |
| 2022-04-25 00:39:15,238 DEV : loss 0.12874221801757812 - f1-score (micro avg) 0.215 | |
| 2022-04-25 00:39:15,250 BAD EPOCHS (no improvement): 4 | |
| 2022-04-25 00:39:15,252 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:39:23,920 epoch 7 - iter 8/88 - loss 0.25032306 - samples/sec: 3.69 - lr: 0.000002 | |
| 2022-04-25 00:39:32,341 epoch 7 - iter 16/88 - loss 0.24173648 - samples/sec: 3.80 - lr: 0.000002 | |
| 2022-04-25 00:39:42,283 epoch 7 - iter 24/88 - loss 0.25674155 - samples/sec: 3.22 - lr: 0.000002 | |
| 2022-04-25 00:39:50,287 epoch 7 - iter 32/88 - loss 0.25221355 - samples/sec: 4.00 - lr: 0.000002 | |
| 2022-04-25 00:39:58,742 epoch 7 - iter 40/88 - loss 0.25534056 - samples/sec: 3.79 - lr: 0.000002 | |
| 2022-04-25 00:40:07,531 epoch 7 - iter 48/88 - loss 0.25396630 - samples/sec: 3.64 - lr: 0.000002 | |
| 2022-04-25 00:40:16,857 epoch 7 - iter 56/88 - loss 0.25506091 - samples/sec: 3.43 - lr: 0.000002 | |
| 2022-04-25 00:40:26,056 epoch 7 - iter 64/88 - loss 0.25606985 - samples/sec: 3.48 - lr: 0.000002 | |
| 2022-04-25 00:40:34,742 epoch 7 - iter 72/88 - loss 0.25690660 - samples/sec: 3.68 - lr: 0.000002 | |
| 2022-04-25 00:40:43,201 epoch 7 - iter 80/88 - loss 0.25644415 - samples/sec: 3.78 - lr: 0.000002 | |
| 2022-04-25 00:40:53,512 epoch 7 - iter 88/88 - loss 0.25640539 - samples/sec: 3.10 - lr: 0.000002 | |
| 2022-04-25 00:40:53,515 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:40:53,516 EPOCH 7 done: loss 0.2564 - lr 0.000002 | |
| 2022-04-25 00:40:59,919 Evaluating as a multi-label problem: False | |
| 2022-04-25 00:40:59,934 DEV : loss 0.12849482893943787 - f1-score (micro avg) 0.2546 | |
| 2022-04-25 00:40:59,943 BAD EPOCHS (no improvement): 4 | |
| 2022-04-25 00:40:59,944 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:41:09,917 epoch 8 - iter 8/88 - loss 0.26072190 - samples/sec: 3.21 - lr: 0.000002 | |
| 2022-04-25 00:41:18,102 epoch 8 - iter 16/88 - loss 0.27005318 - samples/sec: 3.91 - lr: 0.000002 | |
| 2022-04-25 00:41:26,730 epoch 8 - iter 24/88 - loss 0.26735720 - samples/sec: 3.71 - lr: 0.000002 | |
| 2022-04-25 00:41:35,802 epoch 8 - iter 32/88 - loss 0.25981810 - samples/sec: 3.53 - lr: 0.000001 | |
| 2022-04-25 00:41:45,065 epoch 8 - iter 40/88 - loss 0.25497924 - samples/sec: 3.46 - lr: 0.000001 | |
| 2022-04-25 00:41:53,266 epoch 8 - iter 48/88 - loss 0.25297761 - samples/sec: 3.90 - lr: 0.000001 | |
| 2022-04-25 00:42:01,654 epoch 8 - iter 56/88 - loss 0.25588829 - samples/sec: 3.82 - lr: 0.000001 | |
| 2022-04-25 00:42:10,833 epoch 8 - iter 64/88 - loss 0.25234574 - samples/sec: 3.49 - lr: 0.000001 | |
| 2022-04-25 00:42:20,767 epoch 8 - iter 72/88 - loss 0.25437752 - samples/sec: 3.22 - lr: 0.000001 | |
| 2022-04-25 00:42:29,555 epoch 8 - iter 80/88 - loss 0.25358380 - samples/sec: 3.64 - lr: 0.000001 | |
| 2022-04-25 00:42:38,444 epoch 8 - iter 88/88 - loss 0.25159043 - samples/sec: 3.60 - lr: 0.000001 | |
| 2022-04-25 00:42:38,447 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:42:38,447 EPOCH 8 done: loss 0.2516 - lr 0.000001 | |
| 2022-04-25 00:42:45,466 Evaluating as a multi-label problem: False | |
| 2022-04-25 00:42:45,478 DEV : loss 0.13098381459712982 - f1-score (micro avg) 0.2535 | |
| 2022-04-25 00:42:45,486 BAD EPOCHS (no improvement): 4 | |
| 2022-04-25 00:42:45,488 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:42:55,033 epoch 9 - iter 8/88 - loss 0.22931718 - samples/sec: 3.35 - lr: 0.000001 | |
| 2022-04-25 00:43:03,513 epoch 9 - iter 16/88 - loss 0.25355650 - samples/sec: 3.77 - lr: 0.000001 | |
| 2022-04-25 00:43:13,870 epoch 9 - iter 24/88 - loss 0.25289254 - samples/sec: 3.09 - lr: 0.000001 | |
| 2022-04-25 00:43:22,935 epoch 9 - iter 32/88 - loss 0.24994442 - samples/sec: 3.53 - lr: 0.000001 | |
| 2022-04-25 00:43:30,905 epoch 9 - iter 40/88 - loss 0.24795011 - samples/sec: 4.02 - lr: 0.000001 | |
| 2022-04-25 00:43:39,312 epoch 9 - iter 48/88 - loss 0.24733180 - samples/sec: 3.81 - lr: 0.000001 | |
| 2022-04-25 00:43:47,522 epoch 9 - iter 56/88 - loss 0.24885510 - samples/sec: 3.90 - lr: 0.000001 | |
| 2022-04-25 00:43:55,856 epoch 9 - iter 64/88 - loss 0.25085127 - samples/sec: 3.84 - lr: 0.000001 | |
| 2022-04-25 00:44:04,511 epoch 9 - iter 72/88 - loss 0.25141658 - samples/sec: 3.70 - lr: 0.000001 | |
| 2022-04-25 00:44:13,473 epoch 9 - iter 80/88 - loss 0.25114253 - samples/sec: 3.57 - lr: 0.000001 | |
| 2022-04-25 00:44:23,065 epoch 9 - iter 88/88 - loss 0.25032100 - samples/sec: 3.34 - lr: 0.000001 | |
| 2022-04-25 00:44:23,068 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:44:23,069 EPOCH 9 done: loss 0.2503 - lr 0.000001 | |
| 2022-04-25 00:44:30,828 Evaluating as a multi-label problem: False | |
| 2022-04-25 00:44:30,844 DEV : loss 0.1269032210111618 - f1-score (micro avg) 0.2445 | |
| 2022-04-25 00:44:30,854 BAD EPOCHS (no improvement): 4 | |
| 2022-04-25 00:44:30,855 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:44:38,190 epoch 10 - iter 8/88 - loss 0.25877504 - samples/sec: 4.36 - lr: 0.000001 | |
| 2022-04-25 00:44:47,141 epoch 10 - iter 16/88 - loss 0.26538309 - samples/sec: 3.58 - lr: 0.000000 | |
| 2022-04-25 00:44:56,357 epoch 10 - iter 24/88 - loss 0.25992814 - samples/sec: 3.47 - lr: 0.000000 | |
| 2022-04-25 00:45:04,805 epoch 10 - iter 32/88 - loss 0.25024608 - samples/sec: 3.79 - lr: 0.000000 | |
| 2022-04-25 00:45:12,966 epoch 10 - iter 40/88 - loss 0.25450198 - samples/sec: 3.92 - lr: 0.000000 | |
| 2022-04-25 00:45:23,081 epoch 10 - iter 48/88 - loss 0.25508489 - samples/sec: 3.16 - lr: 0.000000 | |
| 2022-04-25 00:45:32,191 epoch 10 - iter 56/88 - loss 0.25273411 - samples/sec: 3.51 - lr: 0.000000 | |
| 2022-04-25 00:45:40,798 epoch 10 - iter 64/88 - loss 0.25090079 - samples/sec: 3.72 - lr: 0.000000 | |
| 2022-04-25 00:45:49,572 epoch 10 - iter 72/88 - loss 0.24954558 - samples/sec: 3.65 - lr: 0.000000 | |
| 2022-04-25 00:45:59,254 epoch 10 - iter 80/88 - loss 0.24933938 - samples/sec: 3.31 - lr: 0.000000 | |
| 2022-04-25 00:46:08,852 epoch 10 - iter 88/88 - loss 0.24774755 - samples/sec: 3.33 - lr: 0.000000 | |
| 2022-04-25 00:46:08,856 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:46:08,857 EPOCH 10 done: loss 0.2477 - lr 0.000000 | |
| 2022-04-25 00:46:15,919 Evaluating as a multi-label problem: False | |
| 2022-04-25 00:46:15,935 DEV : loss 0.12706945836544037 - f1-score (micro avg) 0.2495 | |
| 2022-04-25 00:46:15,947 BAD EPOCHS (no improvement): 4 | |
| 2022-04-25 00:46:19,590 ---------------------------------------------------------------------------------------------------- | |
| 2022-04-25 00:46:19,592 Testing using last state of model ... | |
| 2022-04-25 00:46:29,219 Evaluating as a multi-label problem: False | |
| 2022-04-25 00:46:29,232 0.4412 0.2257 0.2986 0.1758 | |
| 2022-04-25 00:46:29,232 | |
| Results: | |
| - F-score (micro) 0.2986 | |
| - F-score (macro) 0.147 | |
| - Accuracy 0.1758 | |
| By class: | |
| precision recall f1-score support | |
| ORG 0.4718 0.2314 0.3105 687 | |
| LOC 0.3837 0.2171 0.2773 304 | |
| PENT 0.0000 0.0000 0.0000 6 | |
| MISC 0.0000 0.0000 0.0000 0 | |
| micro avg 0.4412 0.2257 0.2986 997 | |
| macro avg 0.2139 0.1121 0.1470 997 | |
| weighted avg 0.4421 0.2257 0.2985 997 | |
| 2022-04-25 00:46:29,233 ---------------------------------------------------------------------------------------------------- | |