bert-base-multilingual-cased-iob2-20240817212230

This model is a fine-tuned version of bert-base-multilingual-cased on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.2170
Overall Strict Precision: 0.7734
Overall Strict Recall: 0.7134
Overall Strict F1: 0.7422
Overall Ent Type Precision: 0.8606
Overall Ent Type Recall: 0.7938
Overall Ent Type F1: 0.8258
Overall Partial Precision: 0.8306
Overall Partial Recall: 0.7662
Overall Partial F1: 0.7971
Overall Exact Precision: 0.7842
Overall Exact Recall: 0.7234
Overall Exact F1: 0.7525
Hotelvatnumber Strict Precision: 0.1410
Hotelvatnumber Strict Recall: 0.6508
Hotelvatnumber Strict F1: 0.2318
Hotelvatnumber Ent Type Precision: 0.1518
Hotelvatnumber Ent Type Recall: 0.7003
Hotelvatnumber Ent Type F1: 0.2495
Hotelvatnumber Partial Precision: 0.1550
Hotelvatnumber Partial Recall: 0.7154
Hotelvatnumber Partial F1: 0.2549
Hotelvatnumber Exact Precision: 0.1489
Hotelvatnumber Exact Recall: 0.6870
Hotelvatnumber Exact F1: 0.2447
Hotelphonenumber Strict Precision: 0.1768
Hotelphonenumber Strict Recall: 0.7636
Hotelphonenumber Strict F1: 0.2871
Hotelphonenumber Ent Type Precision: 0.2112
Hotelphonenumber Ent Type Recall: 0.9120
Hotelphonenumber Ent Type F1: 0.3429
Hotelphonenumber Partial Precision: 0.1943
Hotelphonenumber Partial Recall: 0.8391
Hotelphonenumber Partial F1: 0.3155
Hotelphonenumber Exact Precision: 0.1770
Hotelphonenumber Exact Recall: 0.7646
Hotelphonenumber Exact F1: 0.2875
Hotelemail Strict Precision: 0.1865
Hotelemail Strict Recall: 0.8702
Hotelemail Strict F1: 0.3071
Hotelemail Ent Type Precision: 0.1946
Hotelemail Ent Type Recall: 0.9081
Hotelemail Ent Type F1: 0.3205
Hotelemail Partial Precision: 0.1906
Hotelemail Partial Recall: 0.8894
Hotelemail Partial F1: 0.3139
Hotelemail Exact Precision: 0.1865
Hotelemail Exact Recall: 0.8705
Hotelemail Exact F1: 0.3072
Companyaddress Strict Precision: 0.2145
Companyaddress Strict Recall: 0.7651
Companyaddress Strict F1: 0.3350
Companyaddress Ent Type Precision: 0.2542
Companyaddress Ent Type Recall: 0.9068
Companyaddress Ent Type F1: 0.3971
Companyaddress Partial Precision: 0.2370
Companyaddress Partial Recall: 0.8455
Companyaddress Partial F1: 0.3703
Companyaddress Exact Precision: 0.2161
Companyaddress Exact Recall: 0.7708
Companyaddress Exact F1: 0.3375
Taxamount Strict Precision: 0.0881
Taxamount Strict Recall: 0.6936
Taxamount Strict F1: 0.1564
Taxamount Ent Type Precision: 0.1007
Taxamount Ent Type Recall: 0.7923
Taxamount Ent Type F1: 0.1786
Taxamount Partial Precision: 0.0962
Taxamount Partial Recall: 0.7568
Taxamount Partial F1: 0.1706
Taxamount Exact Precision: 0.0896
Taxamount Exact Recall: 0.7049
Taxamount Exact F1: 0.1589
Hotelfaxnumber Strict Precision: 0.1304
Hotelfaxnumber Strict Recall: 0.8039
Hotelfaxnumber Strict F1: 0.2244
Hotelfaxnumber Ent Type Precision: 0.1478
Hotelfaxnumber Ent Type Recall: 0.9112
Hotelfaxnumber Ent Type F1: 0.2543
Hotelfaxnumber Partial Precision: 0.1393
Hotelfaxnumber Partial Recall: 0.8593
Hotelfaxnumber Partial F1: 0.2398
Hotelfaxnumber Exact Precision: 0.1306
Hotelfaxnumber Exact Recall: 0.8054
Hotelfaxnumber Exact F1: 0.2248
Invoicedate Strict Precision: 0.2452
Invoicedate Strict Recall: 0.8999
Invoicedate Strict F1: 0.3854
Invoicedate Ent Type Precision: 0.2516
Invoicedate Ent Type Recall: 0.9234
Invoicedate Ent Type F1: 0.3955
Invoicedate Partial Precision: 0.2509
Invoicedate Partial Recall: 0.9205
Invoicedate Partial F1: 0.3943
Invoicedate Exact Precision: 0.2474
Invoicedate Exact Recall: 0.9079
Invoicedate Exact F1: 0.3889
Cardnumber Strict Precision: 0.0093
Cardnumber Strict Recall: 0.3426
Cardnumber Strict F1: 0.0181
Cardnumber Ent Type Precision: 0.0127
Cardnumber Ent Type Recall: 0.4697
Cardnumber Ent Type F1: 0.0248
Cardnumber Partial Precision: 0.0111
Cardnumber Partial Recall: 0.4096
Cardnumber Partial F1: 0.0216
Cardnumber Exact Precision: 0.0094
Cardnumber Exact Recall: 0.3452
Cardnumber Exact F1: 0.0182
Hoteladdress Strict Precision: 0.1427
Hoteladdress Strict Recall: 0.4745
Hoteladdress Strict F1: 0.2194
Hoteladdress Ent Type Precision: 0.2111
Hoteladdress Ent Type Recall: 0.7021
Hoteladdress Ent Type F1: 0.3246
Hoteladdress Partial Precision: 0.1794
Hoteladdress Partial Recall: 0.5968
Hoteladdress Partial F1: 0.2759
Hoteladdress Exact Precision: 0.1433
Hoteladdress Exact Recall: 0.4768
Hoteladdress Exact F1: 0.2204
Checkout Strict Precision: 0.2655
Checkout Strict Recall: 0.8953
Checkout Strict F1: 0.4095
Checkout Ent Type Precision: 0.2708
Checkout Ent Type Recall: 0.9133
Checkout Ent Type F1: 0.4177
Checkout Partial Precision: 0.2697
Checkout Partial Recall: 0.9095
Checkout Partial F1: 0.4160
Checkout Exact Precision: 0.2668
Checkout Exact Recall: 0.8998
Checkout Exact F1: 0.4116
Companyzipcode Strict Precision: 0.2477
Companyzipcode Strict Recall: 0.9050
Companyzipcode Strict F1: 0.3890
Companyzipcode Ent Type Precision: 0.2547
Companyzipcode Ent Type Recall: 0.9304
Companyzipcode Ent Type F1: 0.3999
Companyzipcode Partial Precision: 0.2545
Companyzipcode Partial Recall: 0.9299
Companyzipcode Partial F1: 0.3996
Companyzipcode Exact Precision: 0.2500
Companyzipcode Exact Recall: 0.9134
Companyzipcode Exact F1: 0.3926
Currencycode Strict Precision: 0.1021
Currencycode Strict Recall: 0.4933
Currencycode Strict F1: 0.1692
Currencycode Ent Type Precision: 0.1027
Currencycode Ent Type Recall: 0.4963
Currencycode Ent Type F1: 0.1702
Currencycode Partial Precision: 0.1025
Currencycode Partial Recall: 0.4952
Currencycode Partial F1: 0.1698
Currencycode Exact Precision: 0.1022
Currencycode Exact Recall: 0.4936
Currencycode Exact F1: 0.1693
Roomno Strict Precision: 0.2656
Roomno Strict Recall: 0.8078
Roomno Strict F1: 0.3998
Roomno Ent Type Precision: 0.2674
Roomno Ent Type Recall: 0.8131
Roomno Ent Type F1: 0.4024
Roomno Partial Precision: 0.2689
Roomno Partial Recall: 0.8177
Roomno Partial F1: 0.4047
Roomno Exact Precision: 0.2679
Roomno Exact Recall: 0.8148
Roomno Exact F1: 0.4033
Hotelcountry Strict Precision: 0.0569
Hotelcountry Strict Recall: 0.7678
Hotelcountry Strict F1: 0.1060
Hotelcountry Ent Type Precision: 0.0577
Hotelcountry Ent Type Recall: 0.7783
Hotelcountry Ent Type F1: 0.1074
Hotelcountry Partial Precision: 0.0591
Hotelcountry Partial Recall: 0.7978
Hotelcountry Partial F1: 0.1101
Hotelcountry Exact Precision: 0.0585
Hotelcountry Exact Recall: 0.7898
Hotelcountry Exact F1: 0.1090
Bookingnumber Strict Precision: 0.0365
Bookingnumber Strict Recall: 0.4692
Bookingnumber Strict F1: 0.0677
Bookingnumber Ent Type Precision: 0.0440
Bookingnumber Ent Type Recall: 0.5650
Bookingnumber Ent Type F1: 0.0816
Bookingnumber Partial Precision: 0.0476
Bookingnumber Partial Recall: 0.6111
Bookingnumber Partial F1: 0.0882
Bookingnumber Exact Precision: 0.0432
Bookingnumber Exact Recall: 0.5549
Bookingnumber Exact F1: 0.0801
Travellername Strict Precision: 0.1861
Travellername Strict Recall: 0.5283
Travellername Strict F1: 0.2752
Travellername Ent Type Precision: 0.2543
Travellername Ent Type Recall: 0.7220
Travellername Ent Type F1: 0.3761
Travellername Partial Precision: 0.2220
Travellername Partial Recall: 0.6304
Travellername Partial F1: 0.3284
Travellername Exact Precision: 0.1871
Travellername Exact Recall: 0.5313
Travellername Exact F1: 0.2767
Netamount Strict Precision: 0.0985
Netamount Strict Recall: 0.6569
Netamount Strict F1: 0.1713
Netamount Ent Type Precision: 0.1131
Netamount Ent Type Recall: 0.7545
Netamount Ent Type F1: 0.1968
Netamount Partial Precision: 0.1105
Netamount Partial Recall: 0.7367
Netamount Partial F1: 0.1921
Netamount Exact Precision: 0.1026
Netamount Exact Recall: 0.6842
Netamount Exact F1: 0.1784
Companyname Strict Precision: 0.1981
Companyname Strict Recall: 0.7006
Companyname Strict F1: 0.3088
Companyname Ent Type Precision: 0.2477
Companyname Ent Type Recall: 0.8762
Companyname Ent Type F1: 0.3862
Companyname Partial Precision: 0.2255
Companyname Partial Recall: 0.7976
Companyname Partial F1: 0.3516
Companyname Exact Precision: 0.1995
Companyname Exact Recall: 0.7055
Companyname Exact F1: 0.3110
Documenttype Strict Precision: 0.2132
Documenttype Strict Recall: 0.7457
Documenttype Strict F1: 0.3316
Documenttype Ent Type Precision: 0.2337
Documenttype Ent Type Recall: 0.8175
Documenttype Ent Type F1: 0.3635
Documenttype Partial Precision: 0.2241
Documenttype Partial Recall: 0.7837
Documenttype Partial F1: 0.3485
Documenttype Exact Precision: 0.2135
Documenttype Exact Recall: 0.7467
Documenttype Exact F1: 0.3320
Pagenumber Strict Precision: 0.1409
Pagenumber Strict Recall: 0.8340
Pagenumber Strict F1: 0.2411
Pagenumber Ent Type Precision: 0.1420
Pagenumber Ent Type Recall: 0.8403
Pagenumber Ent Type F1: 0.2429
Pagenumber Partial Precision: 0.1417
Pagenumber Partial Recall: 0.8384
Pagenumber Partial F1: 0.2424
Pagenumber Exact Precision: 0.1412
Pagenumber Exact Recall: 0.8353
Pagenumber Exact F1: 0.2415
Companycity Strict Precision: 0.2328
Companycity Strict Recall: 0.8333
Companycity Strict F1: 0.3640
Companycity Ent Type Precision: 0.2474
Companycity Ent Type Recall: 0.8854
Companycity Ent Type F1: 0.3867
Companycity Partial Precision: 0.2457
Companycity Partial Recall: 0.8794
Companycity Partial F1: 0.3841
Companycity Exact Precision: 0.2374
Companycity Exact Recall: 0.8496
Companycity Exact F1: 0.3711
Reservationnumber Strict Precision: 0.0371
Reservationnumber Strict Recall: 0.5028
Reservationnumber Strict F1: 0.0691
Reservationnumber Ent Type Precision: 0.0390
Reservationnumber Ent Type Recall: 0.5288
Reservationnumber Ent Type F1: 0.0726
Reservationnumber Partial Precision: 0.0470
Reservationnumber Partial Recall: 0.6380
Reservationnumber Partial F1: 0.0876
Reservationnumber Exact Precision: 0.0451
Reservationnumber Exact Recall: 0.6122
Reservationnumber Exact F1: 0.0841
Hotelcity Strict Precision: 0.1914
Hotelcity Strict Recall: 0.6465
Hotelcity Strict F1: 0.2954
Hotelcity Ent Type Precision: 0.2088
Hotelcity Ent Type Recall: 0.7052
Hotelcity Ent Type F1: 0.3222
Hotelcity Partial Precision: 0.2050
Hotelcity Partial Recall: 0.6923
Hotelcity Partial F1: 0.3163
Hotelcity Exact Precision: 0.1952
Hotelcity Exact Recall: 0.6591
Hotelcity Exact F1: 0.3012
Companyvatnumber Strict Precision: 0.0620
Companyvatnumber Strict Recall: 0.6566
Companyvatnumber Strict F1: 0.1133
Companyvatnumber Ent Type Precision: 0.0669
Companyvatnumber Ent Type Recall: 0.7083
Companyvatnumber Ent Type F1: 0.1223
Companyvatnumber Partial Precision: 0.0707
Companyvatnumber Partial Recall: 0.7480
Companyvatnumber Partial F1: 0.1291
Companyvatnumber Exact Precision: 0.0679
Companyvatnumber Exact Recall: 0.7188
Companyvatnumber Exact F1: 0.1241
Hotelname Strict Precision: 0.1162
Hotelname Strict Recall: 0.3375
Hotelname Strict F1: 0.1728
Hotelname Ent Type Precision: 0.1847
Hotelname Ent Type Recall: 0.5365
Hotelname Ent Type F1: 0.2748
Hotelname Partial Precision: 0.1521
Hotelname Partial Recall: 0.4419
Hotelname Partial F1: 0.2263
Hotelname Exact Precision: 0.1163
Hotelname Exact Recall: 0.3380
Hotelname Exact F1: 0.1731
Hoteltaxcode Strict Precision: 0.0435
Hoteltaxcode Strict Recall: 0.5060
Hoteltaxcode Strict F1: 0.0800
Hoteltaxcode Ent Type Precision: 0.0464
Hoteltaxcode Ent Type Recall: 0.5405
Hoteltaxcode Ent Type F1: 0.0855
Hoteltaxcode Partial Precision: 0.0487
Hoteltaxcode Partial Recall: 0.5674
Hoteltaxcode Partial F1: 0.0897
Hoteltaxcode Exact Precision: 0.0465
Hoteltaxcode Exact Recall: 0.5420
Hoteltaxcode Exact F1: 0.0857
Cardtype Strict Precision: 0.0537
Cardtype Strict Recall: 0.5081
Cardtype Strict F1: 0.0972
Cardtype Ent Type Precision: 0.0609
Cardtype Ent Type Recall: 0.5763
Cardtype Ent Type F1: 0.1102
Cardtype Partial Precision: 0.0574
Cardtype Partial Recall: 0.5426
Cardtype Partial F1: 0.1038
Cardtype Exact Precision: 0.0537
Cardtype Exact Recall: 0.5083
Cardtype Exact F1: 0.0972
Checkin Strict Precision: 0.2689
Checkin Strict Recall: 0.8985
Checkin Strict F1: 0.4139
Checkin Ent Type Precision: 0.2751
Checkin Ent Type Recall: 0.9193
Checkin Ent Type F1: 0.4234
Checkin Partial Precision: 0.2740
Checkin Partial Recall: 0.9159
Checkin Partial F1: 0.4219
Checkin Exact Precision: 0.2704
Checkin Exact Recall: 0.9039
Checkin Exact F1: 0.4163
Companycountry Strict Precision: 0.1620
Companycountry Strict Recall: 0.8526
Companycountry Strict F1: 0.2723
Companycountry Ent Type Precision: 0.1638
Companycountry Ent Type Recall: 0.8619
Companycountry Ent Type F1: 0.2753
Companycountry Partial Precision: 0.1674
Companycountry Partial Recall: 0.8808
Companycountry Partial F1: 0.2814
Companycountry Exact Precision: 0.1663
Companycountry Exact Recall: 0.8750
Companycountry Exact F1: 0.2795
Grossamount Strict Precision: 0.1726
Grossamount Strict Recall: 0.6147
Grossamount Strict F1: 0.2695
Grossamount Ent Type Precision: 0.1925
Grossamount Ent Type Recall: 0.6856
Grossamount Ent Type F1: 0.3006
Grossamount Partial Precision: 0.1857
Grossamount Partial Recall: 0.6617
Grossamount Partial F1: 0.2901
Grossamount Exact Precision: 0.1754
Grossamount Exact Recall: 0.6246
Grossamount Exact F1: 0.2738
Hotelzipcode Strict Precision: 0.2014
Hotelzipcode Strict Recall: 0.7080
Hotelzipcode Strict F1: 0.3136
Hotelzipcode Ent Type Precision: 0.2135
Hotelzipcode Ent Type Recall: 0.7502
Hotelzipcode Ent Type F1: 0.3323
Hotelzipcode Partial Precision: 0.2096
Hotelzipcode Partial Recall: 0.7368
Hotelzipcode Partial F1: 0.3264
Hotelzipcode Exact Precision: 0.2032
Hotelzipcode Exact Recall: 0.7142
Hotelzipcode Exact F1: 0.3164
Externalreservationnumber Strict Precision: 0.0
Externalreservationnumber Strict Recall: 0.0
Externalreservationnumber Strict F1: 0
Externalreservationnumber Ent Type Precision: 0.0059
Externalreservationnumber Ent Type Recall: 0.4655
Externalreservationnumber Ent Type F1: 0.0116
Externalreservationnumber Partial Precision: 0.0047
Externalreservationnumber Partial Recall: 0.3734
Externalreservationnumber Partial F1: 0.0093
Externalreservationnumber Exact Precision: 0.0
Externalreservationnumber Exact Recall: 0.0
Externalreservationnumber Exact F1: 0
Invoicenumber Strict Precision: 0.2328
Invoicenumber Strict Recall: 0.8354
Invoicenumber Strict F1: 0.3641
Invoicenumber Ent Type Precision: 0.2499
Invoicenumber Ent Type Recall: 0.8968
Invoicenumber Ent Type F1: 0.3909
Invoicenumber Partial Precision: 0.2433
Invoicenumber Partial Recall: 0.8729
Invoicenumber Partial F1: 0.3805
Invoicenumber Exact Precision: 0.2346
Invoicenumber Exact Recall: 0.8416
Invoicenumber Exact F1: 0.3669
Hotelbankaccount Strict Precision: 0.0
Hotelbankaccount Strict Recall: 0
Hotelbankaccount Strict F1: 0
Hotelbankaccount Ent Type Precision: 0.0
Hotelbankaccount Ent Type Recall: 0
Hotelbankaccount Ent Type F1: 0
Hotelbankaccount Partial Precision: 0.0
Hotelbankaccount Partial Recall: 0
Hotelbankaccount Partial F1: 0
Hotelbankaccount Exact Precision: 0.0
Hotelbankaccount Exact Recall: 0
Hotelbankaccount Exact F1: 0

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 1e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
gradient_accumulation_steps: 16
total_train_batch_size: 128
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
lr_scheduler_warmup_ratio: 0.5
num_epochs: 8

Training results

Training Loss	Epoch	Step	Validation Loss	Overall Strict Precision	Overall Strict Recall	Overall Strict F1	Overall Ent Type Precision	Overall Ent Type Recall	Overall Ent Type F1	Overall Partial Precision	Overall Partial Recall	Overall Partial F1	Overall Exact Precision	Overall Exact Recall	Overall Exact F1	Hotelvatnumber Strict Precision	Hotelvatnumber Strict Recall	Hotelvatnumber Strict F1	Hotelvatnumber Ent Type Precision	Hotelvatnumber Ent Type Recall	Hotelvatnumber Ent Type F1	Hotelvatnumber Partial Precision	Hotelvatnumber Partial Recall	Hotelvatnumber Partial F1	Hotelvatnumber Exact Precision	Hotelvatnumber Exact Recall	Hotelvatnumber Exact F1	Hotelphonenumber Strict Precision	Hotelphonenumber Strict Recall	Hotelphonenumber Strict F1	Hotelphonenumber Ent Type Precision	Hotelphonenumber Ent Type Recall	Hotelphonenumber Ent Type F1	Hotelphonenumber Partial Precision	Hotelphonenumber Partial Recall	Hotelphonenumber Partial F1	Hotelphonenumber Exact Precision	Hotelphonenumber Exact Recall	Hotelphonenumber Exact F1	Hotelemail Strict Precision	Hotelemail Strict Recall	Hotelemail Strict F1	Hotelemail Ent Type Precision	Hotelemail Ent Type Recall	Hotelemail Ent Type F1	Hotelemail Partial Precision	Hotelemail Partial Recall	Hotelemail Partial F1	Hotelemail Exact Precision	Hotelemail Exact Recall	Hotelemail Exact F1	Companyaddress Strict Precision	Companyaddress Strict Recall	Companyaddress Strict F1	Companyaddress Ent Type Precision	Companyaddress Ent Type Recall	Companyaddress Ent Type F1	Companyaddress Partial Precision	Companyaddress Partial Recall	Companyaddress Partial F1	Companyaddress Exact Precision	Companyaddress Exact Recall	Companyaddress Exact F1	Taxamount Strict Precision	Taxamount Strict Recall	Taxamount Strict F1	Taxamount Ent Type Precision	Taxamount Ent Type Recall	Taxamount Ent Type F1	Taxamount Partial Precision	Taxamount Partial Recall	Taxamount Partial F1	Taxamount Exact Precision	Taxamount Exact Recall	Taxamount Exact F1	Hotelfaxnumber Strict Precision	Hotelfaxnumber Strict Recall	Hotelfaxnumber Strict F1	Hotelfaxnumber Ent Type Precision	Hotelfaxnumber Ent Type Recall	Hotelfaxnumber Ent Type F1	Hotelfaxnumber Partial Precision	Hotelfaxnumber Partial Recall	Hotelfaxnumber Partial F1	Hotelfaxnumber Exact Precision	Hotelfaxnumber Exact Recall	Hotelfaxnumber Exact F1	Invoicedate Strict Precision	Invoicedate Strict Recall	Invoicedate Strict F1	Invoicedate Ent Type Precision	Invoicedate Ent Type Recall	Invoicedate Ent Type F1	Invoicedate Partial Precision	Invoicedate Partial Recall	Invoicedate Partial F1	Invoicedate Exact Precision	Invoicedate Exact Recall	Invoicedate Exact F1	Cardnumber Strict Precision	Cardnumber Strict Recall	Cardnumber Strict F1	Cardnumber Ent Type Precision	Cardnumber Ent Type Recall	Cardnumber Ent Type F1	Cardnumber Partial Precision	Cardnumber Partial Recall	Cardnumber Partial F1	Cardnumber Exact Precision	Cardnumber Exact Recall	Cardnumber Exact F1	Hoteladdress Strict Precision	Hoteladdress Strict Recall	Hoteladdress Strict F1	Hoteladdress Ent Type Precision	Hoteladdress Ent Type Recall	Hoteladdress Ent Type F1	Hoteladdress Partial Precision	Hoteladdress Partial Recall	Hoteladdress Partial F1	Hoteladdress Exact Precision	Hoteladdress Exact Recall	Hoteladdress Exact F1	Checkout Strict Precision	Checkout Strict Recall	Checkout Strict F1	Checkout Ent Type Precision	Checkout Ent Type Recall	Checkout Ent Type F1	Checkout Partial Precision	Checkout Partial Recall	Checkout Partial F1	Checkout Exact Precision	Checkout Exact Recall	Checkout Exact F1	Companyzipcode Strict Precision	Companyzipcode Strict Recall	Companyzipcode Strict F1	Companyzipcode Ent Type Precision	Companyzipcode Ent Type Recall	Companyzipcode Ent Type F1	Companyzipcode Partial Precision	Companyzipcode Partial Recall	Companyzipcode Partial F1	Companyzipcode Exact Precision	Companyzipcode Exact Recall	Companyzipcode Exact F1	Roomno Strict Precision	Roomno Strict Recall	Roomno Strict F1	Roomno Ent Type Precision	Roomno Ent Type Recall	Roomno Ent Type F1	Roomno Partial Precision	Roomno Partial Recall	Roomno Partial F1	Roomno Exact Precision	Roomno Exact Recall	Roomno Exact F1	Currencycode Strict Precision	Currencycode Strict Recall	Currencycode Strict F1	Currencycode Ent Type Precision	Currencycode Ent Type Recall	Currencycode Ent Type F1	Currencycode Partial Precision	Currencycode Partial Recall	Currencycode Partial F1	Currencycode Exact Precision	Currencycode Exact Recall	Currencycode Exact F1	Hotelcountry Strict Precision	Hotelcountry Strict Recall	Hotelcountry Strict F1	Hotelcountry Ent Type Precision	Hotelcountry Ent Type Recall	Hotelcountry Ent Type F1	Hotelcountry Partial Precision	Hotelcountry Partial Recall	Hotelcountry Partial F1	Hotelcountry Exact Precision	Hotelcountry Exact Recall	Hotelcountry Exact F1	Bookingnumber Strict Precision	Bookingnumber Strict Recall	Bookingnumber Strict F1	Bookingnumber Ent Type Precision	Bookingnumber Ent Type Recall	Bookingnumber Ent Type F1	Bookingnumber Partial Precision	Bookingnumber Partial Recall	Bookingnumber Partial F1	Bookingnumber Exact Precision	Bookingnumber Exact Recall	Bookingnumber Exact F1	Travellername Strict Precision	Travellername Strict Recall	Travellername Strict F1	Travellername Ent Type Precision	Travellername Ent Type Recall	Travellername Ent Type F1	Travellername Partial Precision	Travellername Partial Recall	Travellername Partial F1	Travellername Exact Precision	Travellername Exact Recall	Travellername Exact F1	Netamount Strict Precision	Netamount Strict Recall	Netamount Strict F1	Netamount Ent Type Precision	Netamount Ent Type Recall	Netamount Ent Type F1	Netamount Partial Precision	Netamount Partial Recall	Netamount Partial F1	Netamount Exact Precision	Netamount Exact Recall	Netamount Exact F1	Companyname Strict Precision	Companyname Strict Recall	Companyname Strict F1	Companyname Ent Type Precision	Companyname Ent Type Recall	Companyname Ent Type F1	Companyname Partial Precision	Companyname Partial Recall	Companyname Partial F1	Companyname Exact Precision	Companyname Exact Recall	Companyname Exact F1	Documenttype Strict Precision	Documenttype Strict Recall	Documenttype Strict F1	Documenttype Ent Type Precision	Documenttype Ent Type Recall	Documenttype Ent Type F1	Documenttype Partial Precision	Documenttype Partial Recall	Documenttype Partial F1	Documenttype Exact Precision	Documenttype Exact Recall	Documenttype Exact F1	Pagenumber Strict Precision	Pagenumber Strict Recall	Pagenumber Strict F1	Pagenumber Ent Type Precision	Pagenumber Ent Type Recall	Pagenumber Ent Type F1	Pagenumber Partial Precision	Pagenumber Partial Recall	Pagenumber Partial F1	Pagenumber Exact Precision	Pagenumber Exact Recall	Pagenumber Exact F1	Companycity Strict Precision	Companycity Strict Recall	Companycity Strict F1	Companycity Ent Type Precision	Companycity Ent Type Recall	Companycity Ent Type F1	Companycity Partial Precision	Companycity Partial Recall	Companycity Partial F1	Companycity Exact Precision	Companycity Exact Recall	Companycity Exact F1	Reservationnumber Strict Precision	Reservationnumber Strict Recall	Reservationnumber Strict F1	Reservationnumber Ent Type Precision	Reservationnumber Ent Type Recall	Reservationnumber Ent Type F1	Reservationnumber Partial Precision	Reservationnumber Partial Recall	Reservationnumber Partial F1	Reservationnumber Exact Precision	Reservationnumber Exact Recall	Reservationnumber Exact F1	Hotelcity Strict Precision	Hotelcity Strict Recall	Hotelcity Strict F1	Hotelcity Ent Type Precision	Hotelcity Ent Type Recall	Hotelcity Ent Type F1	Hotelcity Partial Precision	Hotelcity Partial Recall	Hotelcity Partial F1	Hotelcity Exact Precision	Hotelcity Exact Recall	Hotelcity Exact F1	Companyvatnumber Strict Precision	Companyvatnumber Strict Recall	Companyvatnumber Strict F1	Companyvatnumber Ent Type Precision	Companyvatnumber Ent Type Recall	Companyvatnumber Ent Type F1	Companyvatnumber Partial Precision	Companyvatnumber Partial Recall	Companyvatnumber Partial F1	Companyvatnumber Exact Precision	Companyvatnumber Exact Recall	Companyvatnumber Exact F1	Hotelname Strict Precision	Hotelname Strict Recall	Hotelname Strict F1	Hotelname Ent Type Precision	Hotelname Ent Type Recall	Hotelname Ent Type F1	Hotelname Partial Precision	Hotelname Partial Recall	Hotelname Partial F1	Hotelname Exact Precision	Hotelname Exact Recall	Hotelname Exact F1	Hoteltaxcode Strict Precision	Hoteltaxcode Strict Recall	Hoteltaxcode Strict F1	Hoteltaxcode Ent Type Precision	Hoteltaxcode Ent Type Recall	Hoteltaxcode Ent Type F1	Hoteltaxcode Partial Precision	Hoteltaxcode Partial Recall	Hoteltaxcode Partial F1	Hoteltaxcode Exact Precision	Hoteltaxcode Exact Recall	Hoteltaxcode Exact F1	Cardtype Strict Precision	Cardtype Strict Recall	Cardtype Strict F1	Cardtype Ent Type Precision	Cardtype Ent Type Recall	Cardtype Ent Type F1	Cardtype Partial Precision	Cardtype Partial Recall	Cardtype Partial F1	Cardtype Exact Precision	Cardtype Exact Recall	Cardtype Exact F1	Checkin Strict Precision	Checkin Strict Recall	Checkin Strict F1	Checkin Ent Type Precision	Checkin Ent Type Recall	Checkin Ent Type F1	Checkin Partial Precision	Checkin Partial Recall	Checkin Partial F1	Checkin Exact Precision	Checkin Exact Recall	Checkin Exact F1	Companycountry Strict Precision	Companycountry Strict Recall	Companycountry Strict F1	Companycountry Ent Type Precision	Companycountry Ent Type Recall	Companycountry Ent Type F1	Companycountry Partial Precision	Companycountry Partial Recall	Companycountry Partial F1	Companycountry Exact Precision	Companycountry Exact Recall	Companycountry Exact F1	Grossamount Strict Precision	Grossamount Strict Recall	Grossamount Strict F1	Grossamount Ent Type Precision	Grossamount Ent Type Recall	Grossamount Ent Type F1	Grossamount Partial Precision	Grossamount Partial Recall	Grossamount Partial F1	Grossamount Exact Precision	Grossamount Exact Recall	Grossamount Exact F1	Hotelzipcode Strict Precision	Hotelzipcode Strict Recall	Hotelzipcode Strict F1	Hotelzipcode Ent Type Precision	Hotelzipcode Ent Type Recall	Hotelzipcode Ent Type F1	Hotelzipcode Partial Precision	Hotelzipcode Partial Recall	Hotelzipcode Partial F1	Hotelzipcode Exact Precision	Hotelzipcode Exact Recall	Hotelzipcode Exact F1	Externalreservationnumber Strict Precision	Externalreservationnumber Strict Recall	Externalreservationnumber Strict F1	Externalreservationnumber Ent Type Precision	Externalreservationnumber Ent Type Recall	Externalreservationnumber Ent Type F1	Externalreservationnumber Partial Precision	Externalreservationnumber Partial Recall	Externalreservationnumber Partial F1	Externalreservationnumber Exact Precision	Externalreservationnumber Exact Recall	Externalreservationnumber Exact F1	Invoicenumber Strict Precision	Invoicenumber Strict Recall	Invoicenumber Strict F1	Invoicenumber Ent Type Precision	Invoicenumber Ent Type Recall	Invoicenumber Ent Type F1	Invoicenumber Partial Precision	Invoicenumber Partial Recall	Invoicenumber Partial F1	Invoicenumber Exact Precision	Invoicenumber Exact Recall	Invoicenumber Exact F1
1.8224	0.9995	574	0.5795	0.2640	0.3403	0.2974	0.4339	0.5592	0.4886	0.4219	0.5438	0.4751	0.3046	0.3926	0.3430	0.0245	0.3259	0.0456	0.0337	0.4480	0.0626	0.0427	0.5685	0.0795	0.0335	0.4461	0.0624	0.0433	0.4937	0.0797	0.0641	0.7305	0.1179	0.0580	0.6609	0.1067	0.0455	0.5189	0.0837	0.0521	0.7314	0.0973	0.0610	0.8555	0.1139	0.0566	0.7945	0.1057	0.0522	0.7320	0.0974	0.0513	0.4253	0.0915	0.0759	0.6301	0.1355	0.0797	0.6611	0.1422	0.0581	0.4824	0.1038	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0281	0.5083	0.0533	0.0386	0.6970	0.0731	0.0344	0.6212	0.0651	0.0286	0.5163	0.0541	0.0630	0.6317	0.1146	0.0694	0.6957	0.1262	0.0746	0.7473	0.1356	0.0683	0.6843	0.1242	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0187	0.1829	0.0339	0.0530	0.5189	0.0961	0.0394	0.3860	0.0715	0.0196	0.1924	0.0356	0.0201	0.1421	0.0352	0.0640	0.4526	0.1121	0.0474	0.3356	0.0831	0.0220	0.1554	0.0385	0.0320	0.3028	0.0580	0.0714	0.6742	0.1291	0.0645	0.6092	0.1166	0.0401	0.3788	0.0725	0.0003	0.9259	0.0006	0.0003	0.9259	0.0006	0.0003	1.0	0.0007	0.0003	1.0	0.0007	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0400	0.3274	0.0713	0.0660	0.5403	0.1177	0.0599	0.4897	0.1067	0.0433	0.3542	0.0772	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0399	0.3958	0.0725	0.0715	0.7094	0.1299	0.0619	0.6139	0.1124	0.0424	0.4204	0.0770	0.0001	0.0826	0.0003	0.0001	0.0826	0.0003	0.0001	0.0826	0.0003	0.0001	0.0826	0.0003	0.0003	0.1547	0.0005	0.0003	0.1623	0.0005	0.0003	0.1585	0.0005	0.0003	0.1547	0.0005	0.0153	0.2061	0.0284	0.0347	0.4684	0.0646	0.0463	0.6257	0.0863	0.0323	0.4360	0.0601	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0008	0.1274	0.0017	0.0027	0.4097	0.0054	0.0020	0.2999	0.0040	0.0009	0.1416	0.0019	0.0001	0.0316	0.0001	0.0010	0.4655	0.0020	0.0006	0.2701	0.0012	0.0001	0.0316	0.0001	0.0060	0.1381	0.0114	0.0195	0.4510	0.0373	0.0137	0.3166	0.0262	0.0063	0.1463	0.0121	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0502	0.2513	0.0837	0.0797	0.3987	0.1328	0.0852	0.4265	0.1421	0.0567	0.2837	0.0945	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0002	0.0085	0.0004	0.0030	0.1230	0.0058	0.0079	0.3226	0.0153	0.0009	0.0375	0.0018	0.0066	0.2454	0.0129	0.0114	0.4209	0.0222	0.0097	0.3573	0.0188	0.0072	0.2672	0.0141	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0363	0.3852	0.0664	0.0494	0.5235	0.0903	0.0610	0.6465	0.1115	0.0520	0.5515	0.0951
0.4685	1.9989	1148	0.2694	0.6432	0.5540	0.5953	0.7792	0.6711	0.7211	0.7426	0.6396	0.6873	0.6614	0.5696	0.6121	0.0915	0.4623	0.1528	0.1081	0.5460	0.1804	0.1114	0.5627	0.1859	0.1010	0.5102	0.1686	0.1274	0.7032	0.2157	0.1572	0.8682	0.2663	0.1430	0.7894	0.2421	0.1279	0.7061	0.2166	0.1360	0.8005	0.2325	0.1448	0.8519	0.2475	0.1406	0.8272	0.2403	0.1361	0.8010	0.2327	0.1534	0.6746	0.2500	0.1897	0.8342	0.3092	0.1762	0.7747	0.2871	0.1557	0.6846	0.2537	0.0020	0.0296	0.0038	0.0052	0.0774	0.0098	0.0067	0.0988	0.0125	0.0030	0.0437	0.0055	0.0941	0.7667	0.1677	0.1079	0.8791	0.1923	0.1012	0.8242	0.1803	0.0942	0.7673	0.1678	0.1804	0.8239	0.2960	0.1884	0.8602	0.3091	0.1872	0.8550	0.3072	0.1829	0.8354	0.3002	0.0029	0.2196	0.0057	0.0070	0.5358	0.0139	0.0050	0.3795	0.0098	0.0029	0.2208	0.0057	0.0835	0.2991	0.1306	0.1605	0.5745	0.2509	0.1254	0.4489	0.1961	0.0844	0.3023	0.1320	0.2044	0.8213	0.3273	0.2119	0.8515	0.3393	0.2104	0.8454	0.3369	0.2063	0.8291	0.3304	0.1801	0.8201	0.2953	0.1900	0.8653	0.3116	0.1903	0.8664	0.3120	0.1839	0.8377	0.3017	0.1700	0.6446	0.2691	0.1700	0.6446	0.2691	0.1713	0.6494	0.2711	0.1713	0.6494	0.2711	0.0111	0.2689	0.0214	0.0111	0.2689	0.0214	0.0111	0.2689	0.0214	0.0111	0.2689	0.0214	0.0003	0.76	0.0006	0.0003	0.76	0.0006	0.0003	0.76	0.0006	0.0003	0.76	0.0006	0.0010	0.0314	0.0020	0.0143	0.4328	0.0277	0.0124	0.3741	0.0239	0.0011	0.0343	0.0022	0.1268	0.4327	0.1961	0.1875	0.6399	0.2900	0.1601	0.5463	0.2476	0.1283	0.4380	0.1985	0.0170	0.0985	0.0290	0.0541	0.3139	0.0922	0.0715	0.4151	0.1220	0.0235	0.1362	0.0400	0.1338	0.5571	0.2158	0.1822	0.7583	0.2938	0.1615	0.6721	0.2604	0.1355	0.5640	0.2185	0.1440	0.6452	0.2355	0.1654	0.7408	0.2704	0.1555	0.6966	0.2543	0.1443	0.6462	0.2359	0.0983	0.7986	0.1751	0.0997	0.8093	0.1775	0.0997	0.8093	0.1775	0.0985	0.7996	0.1753	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.1666	0.7549	0.2730	0.1821	0.8253	0.2984	0.1822	0.8257	0.2985	0.1729	0.7834	0.2833	0.1298	0.4986	0.2060	0.1521	0.5839	0.2413	0.1517	0.5824	0.2407	0.1375	0.5279	0.2182	0.0069	0.1299	0.0131	0.0379	0.7110	0.0719	0.0245	0.46	0.0465	0.0071	0.1337	0.0135	0.0426	0.1537	0.0667	0.1244	0.4495	0.1949	0.0858	0.3099	0.1344	0.0431	0.1557	0.0675	0.0100	0.2371	0.0192	0.0273	0.6482	0.0524	0.0200	0.4757	0.0385	0.0105	0.2486	0.0201	0.0154	0.3274	0.0295	0.0228	0.4843	0.0436	0.0191	0.4059	0.0365	0.0154	0.3274	0.0295	0.2065	0.8385	0.3314	0.2148	0.8720	0.3446	0.2145	0.8708	0.3442	0.2094	0.8501	0.3360	0.1045	0.6728	0.1809	0.1091	0.7025	0.1889	0.1203	0.7745	0.2082	0.1173	0.7557	0.2031	0.0876	0.2216	0.1255	0.1070	0.2709	0.1535	0.1174	0.2970	0.1683	0.1045	0.2643	0.1497	0.1355	0.5436	0.2170	0.1538	0.6172	0.2463	0.1470	0.5896	0.2353	0.1373	0.5507	0.2198	0.0005	0.0231	0.0010	0.0113	0.5011	0.0222	0.0078	0.3449	0.0153	0.0011	0.0492	0.0022	0.1607	0.6920	0.2609	0.1846	0.7948	0.2996	0.1764	0.7596	0.2863	0.1641	0.7064	0.2663
0.2594	2.9984	1722	0.2179	0.7436	0.6421	0.6891	0.8484	0.7326	0.7863	0.8173	0.7057	0.7574	0.7588	0.6552	0.7032	0.1425	0.6045	0.2306	0.1551	0.6579	0.2510	0.1598	0.6779	0.2586	0.1524	0.6465	0.2466	0.1741	0.7407	0.2819	0.2097	0.8922	0.3396	0.1925	0.8193	0.3118	0.1745	0.7423	0.2825	0.1837	0.8443	0.3018	0.1928	0.8859	0.3167	0.1884	0.8656	0.3094	0.1838	0.8448	0.3020	0.2096	0.7267	0.3253	0.2517	0.8728	0.3907	0.2350	0.8148	0.3648	0.2119	0.7348	0.3289	0.0520	0.3267	0.0898	0.0656	0.4119	0.1132	0.0660	0.4140	0.1138	0.0551	0.3458	0.0950	0.1297	0.7899	0.2227	0.1468	0.8946	0.2523	0.1385	0.8439	0.2380	0.1299	0.7915	0.2232	0.2378	0.8770	0.3741	0.2470	0.9109	0.3886	0.2443	0.9012	0.3844	0.2396	0.8838	0.3770	0.0053	0.2098	0.0103	0.0121	0.4802	0.0237	0.0088	0.3468	0.0171	0.0053	0.2107	0.0104	0.1261	0.3729	0.1884	0.2090	0.6181	0.3123	0.1709	0.5057	0.2555	0.1273	0.3765	0.1902	0.2679	0.8747	0.4101	0.2747	0.8969	0.4205	0.2728	0.8908	0.4177	0.2693	0.8793	0.4123	0.2434	0.8636	0.3797	0.2523	0.8952	0.3936	0.2530	0.8978	0.3948	0.2472	0.8773	0.3858	0.0901	0.4278	0.1488	0.0907	0.4310	0.1499	0.0905	0.4300	0.1495	0.0901	0.4282	0.1489	0.2559	0.7579	0.3826	0.2584	0.7655	0.3864	0.2598	0.7696	0.3885	0.2584	0.7655	0.3864	0.0433	0.5879	0.0806	0.0443	0.6016	0.0825	0.0449	0.6099	0.0836	0.0444	0.6029	0.0827	0.0278	0.2830	0.0507	0.0492	0.4994	0.0895	0.0495	0.5032	0.0902	0.0349	0.3550	0.0636	0.1806	0.4786	0.2623	0.2567	0.6803	0.3728	0.2211	0.5859	0.3210	0.1821	0.4824	0.2643	0.0587	0.3373	0.1000	0.0846	0.4860	0.1441	0.0900	0.5173	0.1534	0.0695	0.3991	0.1183	0.1907	0.6502	0.2949	0.2448	0.8345	0.3785	0.2210	0.7536	0.3418	0.1921	0.6550	0.2971	0.2072	0.6876	0.3185	0.2313	0.7675	0.3555	0.2199	0.7298	0.3380	0.2075	0.6886	0.3189	0.1380	0.8026	0.2355	0.1391	0.8095	0.2375	0.1388	0.8077	0.2370	0.1382	0.8040	0.2359	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.2272	0.7903	0.3530	0.2440	0.8487	0.3790	0.2421	0.8421	0.3761	0.2325	0.8086	0.3611	0.1866	0.5623	0.2802	0.2094	0.6308	0.3144	0.2042	0.6154	0.3067	0.1902	0.5730	0.2856	0.0582	0.5922	0.1060	0.0667	0.6791	0.1215	0.0699	0.7113	0.1273	0.0646	0.6569	0.1176	0.1030	0.2682	0.1489	0.1849	0.4813	0.2671	0.1464	0.3811	0.2115	0.1035	0.2694	0.1495	0.0436	0.5364	0.0806	0.0477	0.5875	0.0883	0.0495	0.6093	0.0916	0.0472	0.5812	0.0874	0.0446	0.4808	0.0816	0.0512	0.5524	0.0937	0.0479	0.5169	0.0877	0.0446	0.4808	0.0816	0.2717	0.8872	0.4160	0.2789	0.9107	0.4270	0.2774	0.9059	0.4248	0.2734	0.8926	0.4186	0.1550	0.7700	0.2580	0.1579	0.7842	0.2628	0.1656	0.8224	0.2756	0.1629	0.8093	0.2712	0.1620	0.4536	0.2387	0.1878	0.5257	0.2767	0.1896	0.5309	0.2794	0.1737	0.4864	0.2560	0.1967	0.6311	0.2999	0.2113	0.6779	0.3221	0.2061	0.6612	0.3142	0.1982	0.6360	0.3022	0.0322	0.4764	0.0602	0.0355	0.5262	0.0666	0.0440	0.6512	0.0823	0.0406	0.6010	0.0760	0.2269	0.7920	0.3527	0.2486	0.8678	0.3864	0.2402	0.8386	0.3734	0.2291	0.7998	0.3562
0.1968	3.9996	2297	0.2076	0.7587	0.6885	0.7219	0.8522	0.7733	0.8108	0.8215	0.7454	0.7816	0.7716	0.7002	0.7341	0.1384	0.6325	0.2271	0.1495	0.6835	0.2454	0.1535	0.7019	0.2520	0.1469	0.6716	0.2411	0.1697	0.7498	0.2768	0.2043	0.9026	0.3332	0.1874	0.8277	0.3056	0.1700	0.7510	0.2773	0.1803	0.8473	0.2974	0.1885	0.8858	0.3109	0.1845	0.8670	0.3043	0.1804	0.8477	0.2975	0.2050	0.7550	0.3225	0.2450	0.9022	0.3853	0.2276	0.8384	0.3580	0.2067	0.7615	0.3252	0.0757	0.6119	0.1347	0.0888	0.7175	0.1580	0.0847	0.6850	0.1508	0.0773	0.6252	0.1377	0.1256	0.7942	0.2169	0.1424	0.9008	0.2460	0.1343	0.8492	0.2319	0.1258	0.7958	0.2173	0.2377	0.8811	0.3744	0.2451	0.9085	0.3860	0.2438	0.9039	0.3841	0.2400	0.8896	0.3780	0.0085	0.3471	0.0165	0.0119	0.4890	0.0233	0.0103	0.4208	0.0200	0.0085	0.3499	0.0167	0.1271	0.4170	0.1948	0.1992	0.6535	0.3053	0.1660	0.5446	0.2544	0.1281	0.4202	0.1963	0.2650	0.8775	0.4071	0.2702	0.8948	0.4151	0.2693	0.8918	0.4137	0.2665	0.8825	0.4094	0.2384	0.8946	0.3765	0.2461	0.9233	0.3886	0.2455	0.9212	0.3877	0.2407	0.9030	0.3800	0.2541	0.7658	0.3816	0.2572	0.7752	0.3862	0.2580	0.7776	0.3875	0.2564	0.7727	0.3850	0.0839	0.5053	0.1439	0.0845	0.5086	0.1448	0.0843	0.5077	0.1446	0.0840	0.5057	0.1440	0.0506	0.7284	0.0946	0.0530	0.7634	0.0992	0.0536	0.7713	0.1002	0.0521	0.7507	0.0975	0.0333	0.4083	0.0616	0.0438	0.5358	0.0809	0.0465	0.5696	0.0860	0.0398	0.4868	0.0735	0.1811	0.4974	0.2655	0.2537	0.6969	0.3720	0.2196	0.6032	0.3220	0.1823	0.5006	0.2672	0.0851	0.5642	0.1479	0.1020	0.6763	0.1772	0.1022	0.6778	0.1776	0.0916	0.6075	0.1592	0.1818	0.6664	0.2857	0.2370	0.8687	0.3724	0.2115	0.7752	0.3324	0.1828	0.6701	0.2873	0.2028	0.7275	0.3172	0.2250	0.8071	0.3519	0.2145	0.7692	0.3354	0.2032	0.7286	0.3177	0.1349	0.8111	0.2314	0.1361	0.8183	0.2334	0.1358	0.8163	0.2328	0.1352	0.8127	0.2318	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.2249	0.8334	0.3542	0.2377	0.8807	0.3743	0.2367	0.8771	0.3728	0.2295	0.8504	0.3614	0.1792	0.6001	0.2760	0.1972	0.6604	0.3037	0.1933	0.6472	0.2977	0.1828	0.612	0.2815	0.0569	0.6332	0.1044	0.0635	0.7064	0.1164	0.0660	0.7349	0.1211	0.0623	0.6939	0.1144	0.0902	0.2856	0.1371	0.1578	0.4997	0.2399	0.1255	0.3974	0.1908	0.0903	0.2860	0.1373	0.0437	0.5389	0.0808	0.0464	0.5724	0.0858	0.0490	0.6041	0.0906	0.0472	0.5828	0.0874	0.0493	0.5111	0.0899	0.0546	0.5662	0.0996	0.0520	0.5389	0.0948	0.0493	0.5111	0.0899	0.2678	0.8806	0.4107	0.2738	0.9003	0.4199	0.2734	0.8990	0.4193	0.2699	0.8875	0.4139	0.1534	0.8372	0.2593	0.1558	0.8502	0.2633	0.1595	0.8704	0.2696	0.1581	0.8628	0.2672	0.1555	0.5527	0.2428	0.1755	0.6237	0.2739	0.1712	0.6084	0.2672	0.1605	0.5705	0.2506	0.1921	0.6680	0.2984	0.2035	0.7078	0.3162	0.1999	0.6952	0.3105	0.1937	0.6736	0.3008	0.0368	0.4709	0.0683	0.0399	0.5096	0.0739	0.0527	0.6738	0.0977	0.0499	0.6381	0.0926	0.2235	0.8176	0.3511	0.2421	0.8856	0.3803	0.2348	0.8589	0.3688	0.2253	0.8242	0.3539
0.1632	4.9990	2871	0.2099	0.7717	0.6999	0.7341	0.8616	0.7814	0.8196	0.8317	0.7543	0.7911	0.7839	0.7109	0.7456	0.1479	0.6385	0.2402	0.1590	0.6863	0.2582	0.1633	0.7047	0.2651	0.1571	0.6782	0.2551	0.1793	0.7575	0.2900	0.2146	0.9068	0.3471	0.1973	0.8337	0.3191	0.1795	0.7584	0.2903	0.1903	0.8718	0.3124	0.1982	0.9081	0.3254	0.1943	0.8905	0.3191	0.1903	0.8722	0.3125	0.2176	0.7627	0.3386	0.2584	0.9056	0.4020	0.2407	0.8435	0.3745	0.2194	0.7688	0.3413	0.0875	0.6472	0.1541	0.1010	0.7474	0.1779	0.0966	0.7152	0.1703	0.0892	0.6603	0.1572	0.1336	0.7956	0.2287	0.1506	0.8972	0.2580	0.1425	0.8485	0.2439	0.1339	0.7974	0.2293	0.2484	0.8924	0.3886	0.2553	0.9174	0.3994	0.2543	0.9139	0.3979	0.2505	0.9002	0.3920	0.0088	0.3321	0.0172	0.0122	0.4597	0.0237	0.0106	0.3986	0.0206	0.0089	0.3348	0.0173	0.1410	0.4556	0.2154	0.2133	0.6891	0.3258	0.1798	0.5810	0.2747	0.1420	0.4586	0.2168	0.2730	0.8884	0.4177	0.2785	0.9063	0.4261	0.2772	0.9020	0.4241	0.2743	0.8925	0.4196	0.2514	0.8957	0.3926	0.2587	0.9217	0.4041	0.2592	0.9234	0.4048	0.2544	0.9063	0.3973	0.1001	0.4735	0.1653	0.1005	0.4754	0.1660	0.1004	0.4749	0.1658	0.1002	0.4738	0.1654	0.2653	0.7758	0.3954	0.2679	0.7836	0.3993	0.2690	0.7866	0.4009	0.2676	0.7826	0.3988	0.0566	0.7624	0.1054	0.0580	0.7803	0.1079	0.0590	0.7947	0.1099	0.0582	0.7833	0.1083	0.0345	0.4232	0.0638	0.0434	0.5322	0.0802	0.0465	0.5704	0.0860	0.0411	0.5037	0.0759	0.1879	0.5033	0.2736	0.2620	0.7020	0.3816	0.2268	0.6076	0.3303	0.1888	0.5059	0.2750	0.0959	0.6224	0.1662	0.1122	0.7283	0.1945	0.1102	0.7150	0.1909	0.1010	0.6553	0.1750	0.1994	0.6867	0.3091	0.2515	0.8661	0.3898	0.2284	0.7867	0.3540	0.2009	0.6920	0.3115	0.2173	0.7348	0.3354	0.2391	0.8086	0.3691	0.2288	0.7738	0.3532	0.2176	0.7360	0.3359	0.1434	0.8252	0.2443	0.1445	0.8316	0.2462	0.1442	0.8301	0.2458	0.1437	0.8268	0.2448	0.2361	0.8247	0.3671	0.2512	0.8774	0.3905	0.2497	0.8723	0.3883	0.2412	0.8425	0.3750	0.0383	0.4736	0.0708	0.0410	0.5074	0.0759	0.0517	0.6393	0.0956	0.0493	0.6097	0.0912	0.1927	0.6342	0.2956	0.2120	0.6978	0.3253	0.2074	0.6824	0.3181	0.1962	0.6457	0.3010	0.0624	0.6523	0.1139	0.0683	0.7134	0.1246	0.0714	0.7465	0.1304	0.0679	0.7096	0.1239	0.1196	0.3273	0.1752	0.1918	0.5248	0.2809	0.1576	0.4312	0.2308	0.1201	0.3285	0.1758	0.0502	0.5132	0.0915	0.0534	0.5461	0.0973	0.0573	0.5855	0.1044	0.0550	0.5622	0.1002	0.0550	0.4975	0.0991	0.0616	0.5569	0.1109	0.0583	0.5276	0.1051	0.0550	0.4977	0.0991	0.2770	0.8919	0.4227	0.2833	0.9122	0.4323	0.2824	0.9093	0.4309	0.2787	0.8975	0.4254	0.1647	0.8438	0.2756	0.1665	0.8528	0.2786	0.1712	0.8771	0.2865	0.1702	0.8717	0.2847	0.1717	0.5882	0.2658	0.1923	0.6591	0.2978	0.1870	0.6409	0.2896	0.1761	0.6033	0.2726	0.2034	0.7014	0.3153	0.2154	0.7429	0.3340	0.2113	0.7286	0.3276	0.2047	0.7061	0.3174	0.0	0.0	0	0.0010	0.4158	0.0020	0.0010	0.3960	0.0019	0.0	0.0	0	0.2371	0.8341	0.3692	0.2545	0.8956	0.3964	0.2477	0.8714	0.3857	0.2388	0.8403	0.3719
0.1424	5.9985	3445	0.2110	0.7647	0.7156	0.7393	0.8523	0.7975	0.8240	0.8221	0.7692	0.7948	0.7756	0.7257	0.7498	0.1320	0.6575	0.2199	0.1421	0.7078	0.2367	0.1444	0.7195	0.2406	0.1390	0.6921	0.2315	0.1675	0.7642	0.2747	0.1998	0.9117	0.3278	0.1839	0.8392	0.3017	0.1676	0.7650	0.2750	0.1771	0.8667	0.2941	0.1845	0.9029	0.3064	0.1809	0.8851	0.3004	0.1772	0.8669	0.2942	0.2043	0.7628	0.3222	0.2420	0.9037	0.3818	0.2258	0.8433	0.3562	0.2058	0.7685	0.3247	0.0823	0.6885	0.1470	0.0938	0.7845	0.1675	0.0899	0.7523	0.1607	0.0839	0.7022	0.1500	0.1228	0.8049	0.2131	0.1394	0.9136	0.2419	0.1313	0.8606	0.2279	0.1230	0.8059	0.2134	0.2325	0.9028	0.3698	0.2387	0.9270	0.3797	0.2378	0.9235	0.3782	0.2345	0.9107	0.3730	0.0076	0.3618	0.0150	0.0105	0.4984	0.0206	0.0091	0.4333	0.0179	0.0077	0.3650	0.0151	0.1286	0.4572	0.2007	0.1958	0.6960	0.3056	0.1646	0.5851	0.2569	0.1293	0.4597	0.2018	0.2522	0.9002	0.3940	0.2578	0.9202	0.4028	0.2564	0.9150	0.4005	0.2534	0.9045	0.3959	0.2356	0.9028	0.3737	0.2421	0.9277	0.3840	0.2423	0.9284	0.3843	0.2380	0.9122	0.3776	0.0908	0.4987	0.1536	0.0912	0.5010	0.1543	0.0911	0.5004	0.1541	0.0908	0.4990	0.1537	0.2501	0.8188	0.3832	0.2524	0.8261	0.3866	0.2535	0.8299	0.3884	0.2523	0.8258	0.3865	0.0526	0.7784	0.0985	0.0536	0.7937	0.1004	0.0547	0.8094	0.1024	0.0540	0.7989	0.1011	0.0321	0.4602	0.0600	0.0409	0.5866	0.0764	0.0427	0.6126	0.0798	0.0374	0.5362	0.0699	0.1754	0.5314	0.2637	0.2392	0.7248	0.3597	0.2090	0.6333	0.3143	0.1764	0.5344	0.2652	0.0921	0.6410	0.1610	0.1062	0.7393	0.1857	0.1045	0.7277	0.1828	0.0967	0.6730	0.1690	0.1878	0.6906	0.2953	0.2357	0.8666	0.3706	0.2149	0.7901	0.3379	0.1896	0.6970	0.2981	0.2028	0.7430	0.3186	0.2226	0.8156	0.3498	0.2132	0.7812	0.3350	0.2030	0.7440	0.3190	0.1329	0.8335	0.2292	0.1338	0.8397	0.2309	0.1335	0.8378	0.2304	0.1330	0.8347	0.2295	0.2216	0.8315	0.3499	0.2352	0.8827	0.3715	0.2339	0.8778	0.3694	0.2263	0.8491	0.3573	0.0334	0.5344	0.0629	0.0354	0.5667	0.0667	0.0417	0.6661	0.0784	0.0400	0.6392	0.0752	0.1770	0.6380	0.2771	0.1945	0.7012	0.3045	0.1904	0.6865	0.2981	0.1804	0.6505	0.2825	0.0574	0.6644	0.1056	0.0623	0.7214	0.1146	0.0652	0.7552	0.1200	0.0624	0.7228	0.1149	0.1013	0.3263	0.1546	0.1685	0.5429	0.2571	0.1361	0.4387	0.2078	0.1014	0.3267	0.1547	0.0436	0.5245	0.0805	0.0459	0.5527	0.0848	0.0497	0.5979	0.0918	0.0480	0.5768	0.0885	0.0483	0.5233	0.0884	0.0546	0.5919	0.0999	0.0515	0.5581	0.0942	0.0483	0.5235	0.0884	0.2564	0.9010	0.3992	0.2628	0.9235	0.4092	0.2617	0.9195	0.4074	0.2580	0.9067	0.4017	0.1531	0.8518	0.2595	0.1548	0.8616	0.2625	0.1584	0.8814	0.2685	0.1572	0.8749	0.2666	0.1622	0.6084	0.2561	0.1809	0.6789	0.2857	0.1750	0.6567	0.2764	0.1652	0.6197	0.2608	0.1851	0.7070	0.2934	0.1961	0.7493	0.3109	0.1924	0.7349	0.3049	0.1864	0.7122	0.2955	0.0	0.0	0	0.0024	0.4147	0.0047	0.0023	0.3992	0.0045	0.0	0.0	0	0.2229	0.8410	0.3524	0.2385	0.8998	0.3770	0.2324	0.8769	0.3675	0.2245	0.8470	0.3549
0.1219	6.9997	4020	0.2163	0.7693	0.7161	0.7417	0.8560	0.7967	0.8253	0.8255	0.7683	0.7958	0.7795	0.7255	0.7515	0.1367	0.6564	0.2263	0.1467	0.7043	0.2428	0.1500	0.7199	0.2482	0.1443	0.6929	0.2389	0.1717	0.7659	0.2806	0.2043	0.9111	0.3338	0.1884	0.8401	0.3077	0.1720	0.7670	0.2810	0.1804	0.8718	0.2990	0.1878	0.9074	0.3111	0.1841	0.8899	0.3052	0.1805	0.8721	0.2990	0.2078	0.7672	0.3270	0.2460	0.9083	0.3871	0.2295	0.8474	0.3611	0.2093	0.7730	0.3294	0.0838	0.7004	0.1497	0.0962	0.8041	0.1719	0.0915	0.7642	0.1634	0.0849	0.7095	0.1517	0.1258	0.8048	0.2177	0.1424	0.9104	0.2462	0.1344	0.8593	0.2324	0.1261	0.8063	0.2181	0.2352	0.9001	0.3729	0.2417	0.9251	0.3833	0.2407	0.9213	0.3817	0.2373	0.9082	0.3763	0.0086	0.3628	0.0168	0.0118	0.5005	0.0231	0.0103	0.4349	0.0201	0.0087	0.3656	0.0169	0.1377	0.4729	0.2132	0.2035	0.6992	0.3153	0.1730	0.5944	0.2680	0.1384	0.4755	0.2144	0.2576	0.8980	0.4004	0.2625	0.9151	0.4080	0.2615	0.9115	0.4064	0.2588	0.9023	0.4023	0.2397	0.9067	0.3792	0.2464	0.9318	0.3897	0.2460	0.9305	0.3891	0.2417	0.9142	0.3823	0.0952	0.5013	0.1600	0.0958	0.5042	0.1610	0.0956	0.5034	0.1607	0.0953	0.5016	0.1602	0.2517	0.8110	0.3842	0.2534	0.8162	0.3867	0.2547	0.8206	0.3887	0.2538	0.8177	0.3874	0.0548	0.7625	0.1022	0.0555	0.7730	0.1036	0.0570	0.7936	0.1064	0.0565	0.7864	0.1054	0.0294	0.4582	0.0552	0.0368	0.5740	0.0692	0.0383	0.5973	0.0720	0.0341	0.5316	0.0641	0.1783	0.5340	0.2674	0.2422	0.7254	0.3632	0.2120	0.6348	0.3178	0.1793	0.5370	0.2689	0.0934	0.6561	0.1635	0.1081	0.7596	0.1893	0.1050	0.7377	0.1838	0.0971	0.6824	0.1700	0.1899	0.6957	0.2983	0.2389	0.8755	0.3754	0.2167	0.7942	0.3406	0.1911	0.7002	0.3002	0.2064	0.7452	0.3233	0.2261	0.8164	0.3542	0.2168	0.7827	0.3395	0.2067	0.7462	0.3237	0.1355	0.8361	0.2332	0.1365	0.8423	0.2350	0.1362	0.8404	0.2344	0.1357	0.8373	0.2336	0.2254	0.8361	0.3551	0.2393	0.8877	0.3770	0.2374	0.8807	0.3740	0.2297	0.8521	0.3618	0.0338	0.5487	0.0637	0.0358	0.5802	0.0674	0.0414	0.6723	0.0781	0.0400	0.6483	0.0753	0.1852	0.6396	0.2873	0.2026	0.6995	0.3142	0.1986	0.6858	0.3080	0.1888	0.6518	0.2928	0.0584	0.6615	0.1074	0.0631	0.7142	0.1160	0.0664	0.7519	0.1221	0.0638	0.7218	0.1172	0.1129	0.3308	0.1683	0.1797	0.5267	0.2680	0.1479	0.4335	0.2206	0.1130	0.3313	0.1686	0.0424	0.5159	0.0784	0.0453	0.5514	0.0838	0.0479	0.5821	0.0885	0.0457	0.5561	0.0845	0.0508	0.5190	0.0926	0.0572	0.5841	0.1042	0.0541	0.5520	0.0985	0.0509	0.5193	0.0926	0.2610	0.9015	0.4048	0.2668	0.9216	0.4139	0.2661	0.9190	0.4127	0.2627	0.9072	0.4074	0.1561	0.8517	0.2638	0.1579	0.8617	0.2669	0.1613	0.8801	0.2726	0.1601	0.8738	0.2706	0.1630	0.6249	0.2586	0.1820	0.6976	0.2887	0.1757	0.6733	0.2787	0.1658	0.6352	0.2629	0.1946	0.7056	0.3051	0.2063	0.7482	0.3235	0.2025	0.7343	0.3175	0.1962	0.7114	0.3076	0.0	0.0	0	0.0043	0.4569	0.0085	0.0037	0.3959	0.0074	0.0	0.0	0	0.2255	0.8407	0.3556	0.2421	0.9027	0.3818	0.2355	0.8782	0.3714	0.2271	0.8468	0.3581
0.1173	7.9956	4592	0.2170	0.7734	0.7134	0.7422	0.8606	0.7938	0.8258	0.8306	0.7662	0.7971	0.7842	0.7234	0.7525	0.1410	0.6508	0.2318	0.1518	0.7003	0.2495	0.1550	0.7154	0.2549	0.1489	0.6870	0.2447	0.1768	0.7636	0.2871	0.2112	0.9120	0.3429	0.1943	0.8391	0.3155	0.1770	0.7646	0.2875	0.1865	0.8702	0.3071	0.1946	0.9081	0.3205	0.1906	0.8894	0.3139	0.1865	0.8705	0.3072	0.2145	0.7651	0.3350	0.2542	0.9068	0.3971	0.2370	0.8455	0.3703	0.2161	0.7708	0.3375	0.0881	0.6936	0.1564	0.1007	0.7923	0.1786	0.0962	0.7568	0.1706	0.0896	0.7049	0.1589	0.1304	0.8039	0.2244	0.1478	0.9112	0.2543	0.1393	0.8593	0.2398	0.1306	0.8054	0.2248	0.2452	0.8999	0.3854	0.2516	0.9234	0.3955	0.2509	0.9205	0.3943	0.2474	0.9079	0.3889	0.0093	0.3426	0.0181	0.0127	0.4697	0.0248	0.0111	0.4096	0.0216	0.0094	0.3452	0.0182	0.1427	0.4745	0.2194	0.2111	0.7021	0.3246	0.1794	0.5968	0.2759	0.1433	0.4768	0.2204	0.2655	0.8953	0.4095	0.2708	0.9133	0.4177	0.2697	0.9095	0.4160	0.2668	0.8998	0.4116	0.2477	0.9050	0.3890	0.2547	0.9304	0.3999	0.2545	0.9299	0.3996	0.2500	0.9134	0.3926	0.1021	0.4933	0.1692	0.1027	0.4963	0.1702	0.1025	0.4952	0.1698	0.1022	0.4936	0.1693	0.2656	0.8078	0.3998	0.2674	0.8131	0.4024	0.2689	0.8177	0.4047	0.2679	0.8148	0.4033	0.0569	0.7678	0.1060	0.0577	0.7783	0.1074	0.0591	0.7978	0.1101	0.0585	0.7898	0.1090	0.0365	0.4692	0.0677	0.0440	0.5650	0.0816	0.0476	0.6111	0.0882	0.0432	0.5549	0.0801	0.1861	0.5283	0.2752	0.2543	0.7220	0.3761	0.2220	0.6304	0.3284	0.1871	0.5313	0.2767	0.0985	0.6569	0.1713	0.1131	0.7545	0.1968	0.1105	0.7367	0.1921	0.1026	0.6842	0.1784	0.1981	0.7006	0.3088	0.2477	0.8762	0.3862	0.2255	0.7976	0.3516	0.1995	0.7055	0.3110	0.2132	0.7457	0.3316	0.2337	0.8175	0.3635	0.2241	0.7837	0.3485	0.2135	0.7467	0.3320	0.1409	0.8340	0.2411	0.1420	0.8403	0.2429	0.1417	0.8384	0.2424	0.1412	0.8353	0.2415	0.2328	0.8333	0.3640	0.2474	0.8854	0.3867	0.2457	0.8794	0.3841	0.2374	0.8496	0.3711	0.0371	0.5028	0.0691	0.0390	0.5288	0.0726	0.0470	0.6380	0.0876	0.0451	0.6122	0.0841	0.1914	0.6465	0.2954	0.2088	0.7052	0.3222	0.2050	0.6923	0.3163	0.1952	0.6591	0.3012	0.0620	0.6566	0.1133	0.0669	0.7083	0.1223	0.0707	0.7480	0.1291	0.0679	0.7188	0.1241	0.1162	0.3375	0.1728	0.1847	0.5365	0.2748	0.1521	0.4419	0.2263	0.1163	0.3380	0.1731	0.0435	0.5060	0.0800	0.0464	0.5405	0.0855	0.0487	0.5674	0.0897	0.0465	0.5420	0.0857	0.0537	0.5081	0.0972	0.0609	0.5763	0.1102	0.0574	0.5426	0.1038	0.0537	0.5083	0.0972	0.2689	0.8985	0.4139	0.2751	0.9193	0.4234	0.2740	0.9159	0.4219	0.2704	0.9039	0.4163	0.1620	0.8526	0.2723	0.1638	0.8619	0.2753	0.1674	0.8808	0.2814	0.1663	0.8750	0.2795	0.1726	0.6147	0.2695	0.1925	0.6856	0.3006	0.1857	0.6617	0.2901	0.1754	0.6246	0.2738	0.2014	0.7080	0.3136	0.2135	0.7502	0.3323	0.2096	0.7368	0.3264	0.2032	0.7142	0.3164	0.0	0.0	0	0.0059	0.4655	0.0116	0.0047	0.3734	0.0093	0.0	0.0	0	0.2328	0.8354	0.3641	0.2499	0.8968	0.3909	0.2433	0.8729	0.3805	0.2346	0.8416	0.3669

Framework versions

Transformers 4.40.2
Pytorch 2.3.1+cu121
Datasets 2.20.0
Tokenizers 0.19.1

nttaii
/

bert-base-multilingual-cased-iob2-20240817212230

bert-base-multilingual-cased-iob2-20240817212230

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

Model tree for nttaii/bert-base-multilingual-cased-iob2-20240817212230

Evaluation results