File size: 60,265 Bytes
398cd83 bfcf855 398cd83 bfcf855 398cd83 bfcf855 398cd83 bfcf855 398cd83 bfcf855 398cd83 bfcf855 398cd83 bfcf855 398cd83 bfcf855 398cd83 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 |
---
license: other
base_model: nvidia/mit-b1
tags:
- vision
- image-segmentation
- generated_from_trainer
metrics:
- recall
model-index:
- name: segformer-b1-finetuned-segments-greenhousev3-sep-23
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# segformer-b1-finetuned-segments-greenhousev3-sep-23
This model is a fine-tuned version of [nvidia/mit-b1](https://huggingface.co/nvidia/mit-b1) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1597
- Mean Iou: 0.4935
- Mean Accuracy: 0.5586
- Overall Accuracy: 0.9588
- F1 Score: 0.9572
- Recall: 0.9588
- Accuracy Unlabeled: nan
- Accuracy Object: 0.4024
- Accuracy Road: nan
- Accuracy Plant: 0.9535
- Accuracy Iron: 0.7940
- Accuracy Wood: 0.0
- Accuracy Wall: 0.9003
- Accuracy Raw Road: 0.9903
- Accuracy Bottom Wall: 0.8851
- Accuracy Roof: 0.7599
- Accuracy Grass: 0.0
- Accuracy Mulch: 0.9244
- Accuracy Person: 0.0
- Accuracy Tomato: 0.0931
- Iou Unlabeled: nan
- Iou Object: 0.3611
- Iou Road: nan
- Iou Plant: 0.8948
- Iou Iron: 0.6336
- Iou Wood: 0.0
- Iou Wall: 0.8675
- Iou Raw Road: 0.9818
- Iou Bottom Wall: 0.7132
- Iou Roof: 0.5201
- Iou Grass: 0.0
- Iou Mulch: 0.8571
- Iou Person: 0.0
- Iou Tomato: 0.0931
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 6e-05
- train_batch_size: 2
- eval_batch_size: 2
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 15
### Training results
| Training Loss | Epoch | Step | Validation Loss | Mean Iou | Mean Accuracy | Overall Accuracy | F1 Score | Recall | Accuracy Unlabeled | Accuracy Object | Accuracy Road | Accuracy Plant | Accuracy Iron | Accuracy Wood | Accuracy Wall | Accuracy Raw Road | Accuracy Bottom Wall | Accuracy Roof | Accuracy Grass | Accuracy Mulch | Accuracy Person | Accuracy Tomato | Iou Unlabeled | Iou Object | Iou Road | Iou Plant | Iou Iron | Iou Wood | Iou Wall | Iou Raw Road | Iou Bottom Wall | Iou Roof | Iou Grass | Iou Mulch | Iou Person | Iou Tomato |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------:|:----------------:|:--------:|:------:|:------------------:|:---------------:|:-------------:|:--------------:|:-------------:|:-------------:|:-------------:|:-----------------:|:--------------------:|:-------------:|:--------------:|:--------------:|:---------------:|:---------------:|:-------------:|:----------:|:--------:|:---------:|:--------:|:--------:|:--------:|:------------:|:---------------:|:--------:|:---------:|:---------:|:----------:|:----------:|
| 1.7068 | 0.14 | 20 | 1.9114 | 0.1735 | 0.2515 | 0.8241 | 0.8228 | 0.8241 | nan | 0.0 | nan | 0.9077 | 0.0001 | 0.0 | 0.3530 | 0.8953 | 0.0 | 0.0 | 0.0 | 0.8617 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.7834 | 0.0001 | 0.0 | 0.3333 | 0.8856 | 0.0 | 0.0 | 0.0 | 0.4260 | 0.0 | 0.0 |
| 1.0565 | 0.29 | 40 | 1.0070 | 0.2182 | 0.2796 | 0.8760 | 0.8745 | 0.8760 | nan | 0.0 | nan | 0.9284 | 0.0000 | 0.0 | 0.6187 | 0.9511 | 0.0 | 0.0 | 0.0 | 0.8567 | 0.0 | 0.0 | nan | 0.0 | 0.0 | 0.8118 | 0.0000 | 0.0 | 0.5509 | 0.9416 | 0.0 | 0.0 | 0.0 | 0.5322 | 0.0 | 0.0 |
| 1.1966 | 0.43 | 60 | 0.7817 | 0.2680 | 0.3121 | 0.9069 | 0.9054 | 0.9069 | nan | 0.0 | nan | 0.9500 | 0.0003 | 0.0 | 0.9521 | 0.9633 | 0.0581 | 0.0 | 0.0 | 0.8219 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8229 | 0.0003 | 0.0 | 0.6960 | 0.9502 | 0.0570 | 0.0 | 0.0 | 0.6892 | 0.0 | 0.0 |
| 0.6843 | 0.57 | 80 | 0.6587 | 0.2711 | 0.3147 | 0.9128 | 0.9113 | 0.9128 | nan | 0.0 | nan | 0.9246 | 0.0 | 0.0 | 0.9616 | 0.9752 | 0.0525 | 0.0 | 0.0 | 0.8623 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8370 | 0.0 | 0.0 | 0.6928 | 0.9567 | 0.0519 | 0.0 | 0.0 | 0.7149 | 0.0 | 0.0 |
| 0.6619 | 0.71 | 100 | 0.6456 | 0.2732 | 0.3142 | 0.9154 | 0.9139 | 0.9154 | nan | 0.0 | nan | 0.9457 | 0.0 | 0.0 | 0.9385 | 0.9745 | 0.0533 | 0.0 | 0.0 | 0.8587 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8491 | 0.0 | 0.0 | 0.7033 | 0.9562 | 0.0529 | 0.0 | 0.0 | 0.7166 | 0.0 | 0.0 |
| 0.8047 | 0.86 | 120 | 0.5774 | 0.2788 | 0.3245 | 0.9169 | 0.9154 | 0.9169 | nan | 0.0 | nan | 0.9178 | 0.0 | 0.0 | 0.9732 | 0.9658 | 0.1038 | 0.0 | 0.0 | 0.9340 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8572 | 0.0 | 0.0 | 0.7017 | 0.9579 | 0.0985 | 0.0 | 0.0 | 0.7304 | 0.0 | 0.0 |
| 0.7346 | 1.0 | 140 | 0.4795 | 0.2806 | 0.3199 | 0.9239 | 0.9224 | 0.9239 | nan | 0.0 | nan | 0.9638 | 0.0 | 0.0 | 0.9607 | 0.9783 | 0.0750 | 0.0 | 0.0 | 0.8614 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8576 | 0.0 | 0.0 | 0.6969 | 0.9662 | 0.0732 | 0.0 | 0.0 | 0.7736 | 0.0 | 0.0 |
| 0.6979 | 1.14 | 160 | 0.4546 | 0.3058 | 0.3599 | 0.9234 | 0.9219 | 0.9234 | nan | 0.0 | nan | 0.9642 | 0.0 | 0.0 | 0.7884 | 0.9701 | 0.7135 | 0.0 | 0.0 | 0.8827 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8627 | 0.0 | 0.0 | 0.6906 | 0.9624 | 0.3790 | 0.0 | 0.0 | 0.7746 | 0.0 | 0.0 |
| 0.3592 | 1.29 | 180 | 0.4140 | 0.3068 | 0.3570 | 0.9263 | 0.9248 | 0.9263 | nan | 0.0 | nan | 0.9626 | 0.0 | 0.0 | 0.8151 | 0.9728 | 0.6385 | 0.0 | 0.0 | 0.8947 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8679 | 0.0 | 0.0 | 0.7112 | 0.9662 | 0.3604 | 0.0 | 0.0 | 0.7761 | 0.0 | 0.0 |
| 0.392 | 1.43 | 200 | 0.3753 | 0.3037 | 0.3585 | 0.9251 | 0.9236 | 0.9251 | nan | 0.0 | nan | 0.9627 | 0.0 | 0.0 | 0.7517 | 0.9763 | 0.7199 | 0.0 | 0.0 | 0.8915 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8720 | 0.0 | 0.0 | 0.6653 | 0.9688 | 0.3521 | 0.0 | 0.0 | 0.7862 | 0.0 | 0.0 |
| 0.2577 | 1.57 | 220 | 0.3416 | 0.3267 | 0.3757 | 0.9379 | 0.9364 | 0.9379 | nan | 0.0 | nan | 0.9630 | 0.0 | 0.0 | 0.8695 | 0.9834 | 0.8060 | 0.0 | 0.0 | 0.8861 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8790 | 0.0 | 0.0 | 0.7722 | 0.9723 | 0.4894 | 0.0 | 0.0 | 0.8077 | 0.0 | 0.0 |
| 0.2839 | 1.71 | 240 | 0.3134 | 0.3236 | 0.3645 | 0.9384 | 0.9368 | 0.9384 | nan | 0.0 | nan | 0.9496 | 0.0 | 0.0 | 0.9726 | 0.9786 | 0.5534 | 0.0 | 0.0 | 0.9202 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8814 | 0.0 | 0.0 | 0.7707 | 0.9711 | 0.4503 | 0.0 | 0.0 | 0.8097 | 0.0 | 0.0 |
| 0.2286 | 1.86 | 260 | 0.2998 | 0.3254 | 0.3672 | 0.9399 | 0.9384 | 0.9399 | nan | 0.0 | nan | 0.9389 | 0.0 | 0.0 | 0.9682 | 0.9838 | 0.5888 | 0.0 | 0.0 | 0.9272 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8842 | 0.0 | 0.0 | 0.7854 | 0.9728 | 0.4498 | 0.0 | 0.0 | 0.8128 | 0.0 | 0.0 |
| 0.287 | 2.0 | 280 | 0.2714 | 0.3297 | 0.3785 | 0.9401 | 0.9385 | 0.9401 | nan | 0.0 | nan | 0.9403 | 0.0001 | 0.0 | 0.8842 | 0.9841 | 0.7971 | 0.0 | 0.0 | 0.9365 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8829 | 0.0001 | 0.0 | 0.7911 | 0.9744 | 0.4961 | 0.0 | 0.0 | 0.8116 | 0.0 | 0.0 |
| 0.1879 | 2.14 | 300 | 0.2660 | 0.3328 | 0.3684 | 0.9438 | 0.9422 | 0.9438 | nan | 0.0 | nan | 0.9458 | 0.0068 | 0.0 | 0.9676 | 0.9886 | 0.5868 | 0.0 | 0.0 | 0.9247 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8840 | 0.0068 | 0.0 | 0.7986 | 0.9754 | 0.5019 | 0.0 | 0.0 | 0.8265 | 0.0 | 0.0 |
| 0.1907 | 2.29 | 320 | 0.2585 | 0.3369 | 0.3898 | 0.9431 | 0.9416 | 0.9431 | nan | 0.0 | nan | 0.9444 | 0.0098 | 0.0 | 0.8806 | 0.9856 | 0.9296 | 0.0 | 0.0 | 0.9271 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8857 | 0.0098 | 0.0 | 0.8014 | 0.9757 | 0.5427 | 0.0 | 0.0 | 0.8277 | 0.0 | 0.0 |
| 0.2508 | 2.43 | 340 | 0.2580 | 0.3312 | 0.3824 | 0.9401 | 0.9385 | 0.9401 | nan | 0.0 | nan | 0.9654 | 0.0493 | 0.0 | 0.8419 | 0.9842 | 0.8481 | 0.0 | 0.0 | 0.8993 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8836 | 0.0491 | 0.0 | 0.7603 | 0.9761 | 0.4786 | 0.0 | 0.0 | 0.8262 | 0.0 | 0.0 |
| 0.2966 | 2.57 | 360 | 0.2444 | 0.3045 | 0.3407 | 0.9372 | 0.9357 | 0.9372 | nan | 0.0 | nan | 0.9628 | 0.0283 | 0.0 | 0.9863 | 0.9892 | 0.2420 | 0.0 | 0.0 | 0.8804 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8869 | 0.0282 | 0.0 | 0.7170 | 0.9767 | 0.2229 | 0.0 | 0.0 | 0.8226 | 0.0 | 0.0 |
| 0.7831 | 2.71 | 380 | 0.2644 | 0.3228 | 0.3855 | 0.9319 | 0.9304 | 0.9319 | nan | 0.0 | nan | 0.9559 | 0.1710 | 0.0 | 0.6594 | 0.9865 | 0.9382 | 0.0 | 0.0 | 0.9156 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8897 | 0.1644 | 0.0 | 0.6163 | 0.9767 | 0.3965 | 0.0 | 0.0 | 0.8294 | 0.0 | 0.0 |
| 0.2107 | 2.86 | 400 | 0.2218 | 0.3581 | 0.3982 | 0.9463 | 0.9447 | 0.9463 | nan | 0.0 | nan | 0.9553 | 0.2642 | 0.0 | 0.9037 | 0.9877 | 0.7503 | 0.0 | 0.0 | 0.9170 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8867 | 0.2471 | 0.0 | 0.7955 | 0.9776 | 0.5616 | 0.0 | 0.0 | 0.8286 | 0.0 | 0.0 |
| 0.121 | 3.0 | 420 | 0.2124 | 0.3483 | 0.3960 | 0.9449 | 0.9433 | 0.9449 | nan | 0.0 | nan | 0.955 | 0.1629 | 0.0 | 0.8745 | 0.9901 | 0.8669 | 0.0 | 0.0 | 0.9020 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8883 | 0.1575 | 0.0 | 0.7918 | 0.9769 | 0.5319 | 0.0 | 0.0 | 0.8333 | 0.0 | 0.0 |
| 0.4441 | 3.14 | 440 | 0.2052 | 0.3781 | 0.4163 | 0.9506 | 0.9491 | 0.9506 | nan | 0.0 | nan | 0.9633 | 0.3664 | 0.0 | 0.9261 | 0.9852 | 0.8421 | 0.0 | 0.0 | 0.9121 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8859 | 0.3240 | 0.0 | 0.8503 | 0.9764 | 0.6635 | 0.0 | 0.0 | 0.8374 | 0.0 | 0.0 |
| 0.1234 | 3.29 | 460 | 0.2051 | 0.3648 | 0.4113 | 0.9481 | 0.9466 | 0.9481 | nan | 0.0 | nan | 0.9540 | 0.2939 | 0.0 | 0.8976 | 0.9890 | 0.8941 | 0.0 | 0.0 | 0.9066 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8897 | 0.2712 | 0.0 | 0.8204 | 0.9774 | 0.5831 | 0.0 | 0.0 | 0.8355 | 0.0 | 0.0 |
| 0.118 | 3.43 | 480 | 0.1972 | 0.3647 | 0.3996 | 0.9486 | 0.9470 | 0.9486 | nan | 0.0 | nan | 0.9559 | 0.3642 | 0.0 | 0.9475 | 0.9902 | 0.6257 | 0.0 | 0.0 | 0.9117 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8912 | 0.3299 | 0.0 | 0.8035 | 0.9774 | 0.5351 | 0.0 | 0.0 | 0.8395 | 0.0 | 0.0 |
| 0.2892 | 3.57 | 500 | 0.2113 | 0.3669 | 0.4210 | 0.9473 | 0.9457 | 0.9473 | nan | 0.0 | nan | 0.9496 | 0.3868 | 0.0 | 0.8413 | 0.9880 | 0.9625 | 0.0 | 0.0 | 0.9237 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8918 | 0.3327 | 0.0 | 0.7976 | 0.9781 | 0.5633 | 0.0 | 0.0 | 0.8398 | 0.0 | 0.0 |
| 0.1092 | 3.71 | 520 | 0.1957 | 0.3741 | 0.4182 | 0.9508 | 0.9492 | 0.9508 | nan | 0.0 | nan | 0.9588 | 0.3413 | 0.0 | 0.9148 | 0.9875 | 0.9055 | 0.0 | 0.0 | 0.9104 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8927 | 0.3121 | 0.0 | 0.8375 | 0.9780 | 0.6290 | 0.0 | 0.0 | 0.8395 | 0.0 | 0.0 |
| 0.4433 | 3.86 | 540 | 0.1977 | 0.3813 | 0.4270 | 0.9515 | 0.9499 | 0.9515 | nan | 0.0 | nan | 0.9470 | 0.4228 | 0.0 | 0.9093 | 0.9870 | 0.9251 | 0.0 | 0.0 | 0.9329 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8914 | 0.3769 | 0.0 | 0.8470 | 0.9784 | 0.6440 | 0.0 | 0.0 | 0.8377 | 0.0 | 0.0 |
| 0.1103 | 4.0 | 560 | 0.1926 | 0.3920 | 0.4362 | 0.9531 | 0.9515 | 0.9531 | nan | 0.0 | nan | 0.9530 | 0.5607 | 0.0 | 0.9085 | 0.9893 | 0.9057 | 0.0 | 0.0 | 0.9168 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8903 | 0.4774 | 0.0 | 0.8469 | 0.9789 | 0.6663 | 0.0 | 0.0 | 0.8446 | 0.0 | 0.0 |
| 0.1849 | 4.14 | 580 | 0.1873 | 0.3827 | 0.4263 | 0.9513 | 0.9497 | 0.9513 | nan | 0.0 | nan | 0.9499 | 0.4656 | 0.0 | 0.9142 | 0.9870 | 0.8703 | 0.0 | 0.0 | 0.9282 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8882 | 0.4183 | 0.0 | 0.8333 | 0.9788 | 0.6310 | 0.0 | 0.0 | 0.8431 | 0.0 | 0.0 |
| 0.4098 | 4.29 | 600 | 0.1879 | 0.3913 | 0.4353 | 0.9529 | 0.9513 | 0.9529 | nan | 0.0 | nan | 0.9608 | 0.5469 | 0.0 | 0.9107 | 0.9876 | 0.9105 | 0.0 | 0.0 | 0.9067 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8925 | 0.4699 | 0.0 | 0.8418 | 0.9774 | 0.6683 | 0.0 | 0.0 | 0.8453 | 0.0 | 0.0 |
| 0.1571 | 4.43 | 620 | 0.1888 | 0.3834 | 0.4255 | 0.9514 | 0.9499 | 0.9514 | nan | 0.0 | nan | 0.9492 | 0.4750 | 0.0 | 0.9111 | 0.9931 | 0.8724 | 0.0 | 0.0 | 0.9054 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8936 | 0.4166 | 0.0 | 0.8375 | 0.9748 | 0.6329 | 0.0 | 0.0 | 0.8451 | 0.0 | 0.0 |
| 0.1006 | 4.57 | 640 | 0.1921 | 0.3830 | 0.4312 | 0.9517 | 0.9501 | 0.9517 | nan | 0.0 | nan | 0.9534 | 0.4537 | 0.0 | 0.8942 | 0.9868 | 0.9640 | 0.0 | 0.0 | 0.9228 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8916 | 0.3990 | 0.0 | 0.8421 | 0.9776 | 0.6382 | 0.0 | 0.0 | 0.8471 | 0.0 | 0.0 |
| 0.1224 | 4.71 | 660 | 0.1860 | 0.3931 | 0.4339 | 0.9528 | 0.9512 | 0.9528 | nan | 0.0 | nan | 0.9635 | 0.5783 | 0.0 | 0.9208 | 0.9907 | 0.8675 | 0.0 | 0.0 | 0.8864 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8908 | 0.4967 | 0.0 | 0.8392 | 0.9780 | 0.6732 | 0.0 | 0.0 | 0.8394 | 0.0 | 0.0 |
| 0.1059 | 4.86 | 680 | 0.1877 | 0.3986 | 0.4433 | 0.9538 | 0.9523 | 0.9538 | nan | 0.0 | nan | 0.9405 | 0.6260 | 0.0 | 0.9148 | 0.9892 | 0.9119 | 0.0 | 0.0 | 0.9368 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8883 | 0.5318 | 0.0 | 0.8526 | 0.9798 | 0.6879 | 0.0 | 0.0 | 0.8431 | 0.0 | 0.0 |
| 0.0831 | 5.0 | 700 | 0.1811 | 0.3918 | 0.4336 | 0.9532 | 0.9516 | 0.9532 | nan | 0.0 | nan | 0.9576 | 0.5426 | 0.0 | 0.9191 | 0.9879 | 0.8807 | 0.0 | 0.0 | 0.9150 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8883 | 0.4846 | 0.0 | 0.8465 | 0.9799 | 0.6556 | 0.0 | 0.0 | 0.8463 | 0.0 | 0.0 |
| 0.1175 | 5.14 | 720 | 0.1795 | 0.4013 | 0.4477 | 0.9546 | 0.9530 | 0.9546 | nan | 0.0 | nan | 0.9547 | 0.7383 | 0.0 | 0.9052 | 0.9901 | 0.8693 | 0.0 | 0.0 | 0.9147 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8918 | 0.5727 | 0.0 | 0.8471 | 0.9802 | 0.6771 | 0.0 | 0.0 | 0.8470 | 0.0 | 0.0 |
| 0.9127 | 5.29 | 740 | 0.1838 | 0.4007 | 0.4455 | 0.9545 | 0.9530 | 0.9545 | nan | 0.0 | nan | 0.9540 | 0.6621 | 0.0 | 0.9155 | 0.9886 | 0.9099 | 0.0 | 0.0 | 0.9162 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8905 | 0.5619 | 0.0 | 0.8539 | 0.9800 | 0.6757 | 0.0 | 0.0 | 0.8466 | 0.0 | 0.0 |
| 0.1136 | 5.43 | 760 | 0.1827 | 0.4014 | 0.4493 | 0.9544 | 0.9528 | 0.9544 | nan | 0.0 | nan | 0.9509 | 0.7678 | 0.0 | 0.8970 | 0.9898 | 0.8579 | 0.0026 | 0.0 | 0.9251 | 0.0 | 0.0002 | nan | 0.0 | nan | 0.8914 | 0.5790 | 0.0 | 0.8438 | 0.9804 | 0.6724 | 0.0026 | 0.0 | 0.8469 | 0.0 | 0.0002 |
| 0.0983 | 5.57 | 780 | 0.1758 | 0.4027 | 0.4484 | 0.9554 | 0.9538 | 0.9554 | nan | 0.0 | nan | 0.9566 | 0.7098 | 0.0 | 0.9026 | 0.9897 | 0.9051 | 0.0003 | 0.0 | 0.9172 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8939 | 0.5596 | 0.0 | 0.8518 | 0.9803 | 0.6984 | 0.0003 | 0.0 | 0.8479 | 0.0 | 0.0 |
| 0.1405 | 5.71 | 800 | 0.1827 | 0.3970 | 0.4439 | 0.9540 | 0.9524 | 0.9540 | nan | 0.0 | nan | 0.9579 | 0.6841 | 0.0 | 0.8965 | 0.9890 | 0.8835 | 0.0005 | 0.0 | 0.9151 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8923 | 0.5283 | 0.0 | 0.8435 | 0.9798 | 0.6729 | 0.0005 | 0.0 | 0.8468 | 0.0 | 0.0 |
| 0.2309 | 5.86 | 820 | 0.1810 | 0.3998 | 0.4424 | 0.9545 | 0.9529 | 0.9545 | nan | 0.0 | nan | 0.9488 | 0.6788 | 0.0 | 0.9130 | 0.9921 | 0.8570 | 0.0001 | 0.0 | 0.9193 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8908 | 0.5532 | 0.0 | 0.8500 | 0.9796 | 0.6762 | 0.0001 | 0.0 | 0.8472 | 0.0 | 0.0 |
| 0.0797 | 6.0 | 840 | 0.1857 | 0.4003 | 0.4463 | 0.9539 | 0.9523 | 0.9539 | nan | 0.0 | nan | 0.9633 | 0.6793 | 0.0 | 0.9033 | 0.9874 | 0.9172 | 0.0028 | 0.0 | 0.9027 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8892 | 0.5559 | 0.0 | 0.8519 | 0.9797 | 0.6817 | 0.0028 | 0.0 | 0.8421 | 0.0 | 0.0 |
| 0.1045 | 6.14 | 860 | 0.1788 | 0.4055 | 0.4497 | 0.9556 | 0.9540 | 0.9556 | nan | 0.0 | nan | 0.9535 | 0.7273 | 0.0 | 0.9069 | 0.9902 | 0.8916 | 0.0043 | 0.0 | 0.9211 | 0.0 | 0.0012 | nan | 0.0 | nan | 0.8921 | 0.5842 | 0.0 | 0.8553 | 0.9805 | 0.6996 | 0.0043 | 0.0 | 0.8484 | 0.0 | 0.0012 |
| 0.3298 | 6.29 | 880 | 0.1736 | 0.4039 | 0.4455 | 0.9555 | 0.9539 | 0.9555 | nan | 0.0 | nan | 0.9574 | 0.7145 | 0.0 | 0.9216 | 0.9896 | 0.8473 | 0.0 | 0.0 | 0.9155 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8918 | 0.5810 | 0.0 | 0.8530 | 0.9807 | 0.6926 | 0.0 | 0.0 | 0.8483 | 0.0 | 0.0 |
| 0.1343 | 6.43 | 900 | 0.1829 | 0.4063 | 0.4514 | 0.9556 | 0.9540 | 0.9556 | nan | 0.0 | nan | 0.9567 | 0.7286 | 0.0 | 0.9095 | 0.9891 | 0.9190 | 0.0 | 0.0 | 0.9140 | 0.0 | 0.0002 | nan | 0.0 | nan | 0.8916 | 0.5962 | 0.0 | 0.8568 | 0.9806 | 0.7026 | 0.0 | 0.0 | 0.8470 | 0.0 | 0.0002 |
| 0.0934 | 6.57 | 920 | 0.1798 | 0.4077 | 0.4571 | 0.9548 | 0.9533 | 0.9548 | nan | 0.0 | nan | 0.9565 | 0.8102 | 0.0 | 0.8938 | 0.9871 | 0.8693 | 0.0388 | 0.0 | 0.9250 | 0.0 | 0.0046 | nan | 0.0 | nan | 0.8909 | 0.5856 | 0.0 | 0.8481 | 0.9804 | 0.6966 | 0.0385 | 0.0 | 0.8476 | 0.0 | 0.0046 |
| 0.132 | 6.71 | 940 | 0.1735 | 0.4049 | 0.4464 | 0.9555 | 0.9540 | 0.9555 | nan | 0.0 | nan | 0.9503 | 0.6646 | 0.0 | 0.9168 | 0.9926 | 0.8924 | 0.0240 | 0.0 | 0.9158 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8911 | 0.5562 | 0.0 | 0.8563 | 0.9801 | 0.7008 | 0.0239 | 0.0 | 0.8500 | 0.0 | 0.0 |
| 0.2263 | 6.86 | 960 | 0.1758 | 0.4154 | 0.4586 | 0.9555 | 0.9539 | 0.9555 | nan | 0.0 | nan | 0.9508 | 0.6794 | 0.0 | 0.9114 | 0.9906 | 0.8817 | 0.1656 | 0.0 | 0.9239 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8903 | 0.5590 | 0.0 | 0.8566 | 0.9806 | 0.6825 | 0.1632 | 0.0 | 0.8521 | 0.0 | 0.0 |
| 0.1023 | 7.0 | 980 | 0.1748 | 0.4365 | 0.4823 | 0.9566 | 0.9550 | 0.9566 | nan | 0.0 | nan | 0.9619 | 0.7301 | 0.0 | 0.9087 | 0.9892 | 0.8994 | 0.3900 | 0.0 | 0.9085 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8916 | 0.5952 | 0.0 | 0.8637 | 0.9811 | 0.7035 | 0.3532 | 0.0 | 0.8493 | 0.0 | 0.0 |
| 0.0589 | 7.14 | 1000 | 0.1747 | 0.4384 | 0.4890 | 0.9565 | 0.9550 | 0.9565 | nan | 0.0 | nan | 0.9467 | 0.7324 | 0.0 | 0.9074 | 0.9894 | 0.9022 | 0.4552 | 0.0 | 0.9344 | 0.0 | 0.0 | nan | 0.0 | nan | 0.8923 | 0.5984 | 0.0 | 0.8627 | 0.9810 | 0.7060 | 0.3721 | 0.0 | 0.8488 | 0.0 | 0.0 |
| 0.3476 | 7.29 | 1020 | 0.1766 | 0.4247 | 0.4733 | 0.9558 | 0.9542 | 0.9558 | nan | 0.0068 | nan | 0.9471 | 0.7570 | 0.0 | 0.8906 | 0.9914 | 0.9206 | 0.2371 | 0.0 | 0.9272 | 0.0 | 0.0022 | nan | 0.0068 | nan | 0.8910 | 0.5899 | 0.0 | 0.8518 | 0.9810 | 0.6921 | 0.2294 | 0.0 | 0.8525 | 0.0 | 0.0022 |
| 0.5283 | 7.43 | 1040 | 0.1698 | 0.4095 | 0.4536 | 0.9553 | 0.9537 | 0.9553 | nan | 0.0130 | nan | 0.9658 | 0.7658 | 0.0 | 0.9040 | 0.9913 | 0.9032 | 0.0068 | 0.0 | 0.8865 | 0.0 | 0.0063 | nan | 0.0130 | nan | 0.8886 | 0.6013 | 0.0 | 0.8571 | 0.9806 | 0.7177 | 0.0068 | 0.0 | 0.8419 | 0.0 | 0.0063 |
| 0.3578 | 7.57 | 1060 | 0.1688 | 0.4143 | 0.4585 | 0.9565 | 0.9549 | 0.9565 | nan | 0.0022 | nan | 0.9488 | 0.7091 | 0.0 | 0.9069 | 0.9895 | 0.9295 | 0.0817 | 0.0 | 0.9340 | 0.0 | 0.0000 | nan | 0.0022 | nan | 0.8932 | 0.5909 | 0.0 | 0.8621 | 0.9808 | 0.7114 | 0.0808 | 0.0 | 0.8502 | 0.0 | 0.0000 |
| 0.0797 | 7.71 | 1080 | 0.1749 | 0.4416 | 0.4880 | 0.9567 | 0.9552 | 0.9567 | nan | 0.0442 | nan | 0.9632 | 0.7645 | 0.0 | 0.8973 | 0.9904 | 0.9325 | 0.3074 | 0.0 | 0.8998 | 0.0 | 0.0564 | nan | 0.0441 | nan | 0.8944 | 0.6115 | 0.0 | 0.8622 | 0.9799 | 0.7114 | 0.2918 | 0.0 | 0.8475 | 0.0 | 0.0563 |
| 0.198 | 7.86 | 1100 | 0.1688 | 0.4347 | 0.4803 | 0.9570 | 0.9554 | 0.9570 | nan | 0.0493 | nan | 0.9525 | 0.7111 | 0.0 | 0.9060 | 0.9907 | 0.9416 | 0.2611 | 0.0 | 0.9198 | 0.0 | 0.0310 | nan | 0.0493 | nan | 0.8949 | 0.5898 | 0.0 | 0.8635 | 0.9802 | 0.7040 | 0.2510 | 0.0 | 0.8529 | 0.0 | 0.0310 |
| 0.0702 | 8.0 | 1120 | 0.1616 | 0.4425 | 0.4862 | 0.9572 | 0.9556 | 0.9572 | nan | 0.0631 | nan | 0.9450 | 0.7285 | 0.0 | 0.9181 | 0.9907 | 0.9036 | 0.3378 | 0.0 | 0.9325 | 0.0 | 0.0152 | nan | 0.0630 | nan | 0.8935 | 0.6050 | 0.0 | 0.8665 | 0.9794 | 0.7176 | 0.3170 | 0.0 | 0.8532 | 0.0 | 0.0152 |
| 0.0902 | 8.14 | 1140 | 0.1591 | 0.4417 | 0.4849 | 0.9577 | 0.9562 | 0.9577 | nan | 0.0419 | nan | 0.9613 | 0.7609 | 0.0 | 0.9123 | 0.9898 | 0.9058 | 0.3121 | 0.0 | 0.9107 | 0.0 | 0.0235 | nan | 0.0418 | nan | 0.8946 | 0.6172 | 0.0 | 0.8694 | 0.9804 | 0.7243 | 0.2976 | 0.0 | 0.8516 | 0.0 | 0.0235 |
| 0.0848 | 8.29 | 1160 | 0.1671 | 0.4454 | 0.4922 | 0.9570 | 0.9554 | 0.9570 | nan | 0.0379 | nan | 0.9423 | 0.7011 | 0.0 | 0.9128 | 0.9902 | 0.9308 | 0.4485 | 0.0 | 0.9374 | 0.0 | 0.0058 | nan | 0.0379 | nan | 0.8943 | 0.5889 | 0.0 | 0.8692 | 0.9789 | 0.7081 | 0.4080 | 0.0 | 0.8535 | 0.0 | 0.0058 |
| 0.0722 | 8.43 | 1180 | 0.1618 | 0.4482 | 0.5167 | 0.9566 | 0.9550 | 0.9566 | nan | 0.0469 | nan | 0.9638 | 0.6784 | 0.0 | 0.8937 | 0.9894 | 0.9139 | 0.8039 | 0.0 | 0.9057 | 0.0 | 0.0051 | nan | 0.0468 | nan | 0.8935 | 0.5769 | 0.0 | 0.8584 | 0.9804 | 0.7105 | 0.4555 | 0.0 | 0.8513 | 0.0 | 0.0051 |
| 0.1101 | 8.57 | 1200 | 0.1650 | 0.4453 | 0.4971 | 0.9577 | 0.9561 | 0.9577 | nan | 0.0027 | nan | 0.9532 | 0.7528 | 0.0 | 0.8955 | 0.9915 | 0.9207 | 0.5253 | 0.0 | 0.9233 | 0.0 | 0.0007 | nan | 0.0027 | nan | 0.8947 | 0.6085 | 0.0 | 0.8653 | 0.9812 | 0.7207 | 0.4175 | 0.0 | 0.8529 | 0.0 | 0.0007 |
| 0.0973 | 8.71 | 1220 | 0.1644 | 0.4490 | 0.5029 | 0.9573 | 0.9557 | 0.9573 | nan | 0.0779 | nan | 0.9507 | 0.8351 | 0.0 | 0.8951 | 0.9908 | 0.9130 | 0.4361 | 0.0 | 0.9219 | 0.0 | 0.0136 | nan | 0.0774 | nan | 0.8926 | 0.6162 | 0.0 | 0.8608 | 0.9814 | 0.7174 | 0.3746 | 0.0 | 0.8538 | 0.0 | 0.0136 |
| 0.1039 | 8.86 | 1240 | 0.1665 | 0.4446 | 0.4951 | 0.9573 | 0.9557 | 0.9573 | nan | 0.0227 | nan | 0.9604 | 0.7618 | 0.0 | 0.9035 | 0.9893 | 0.9160 | 0.4738 | 0.0 | 0.9115 | 0.0 | 0.0017 | nan | 0.0227 | nan | 0.8920 | 0.6130 | 0.0 | 0.8663 | 0.9815 | 0.7143 | 0.3926 | 0.0 | 0.8512 | 0.0 | 0.0017 |
| 0.0792 | 9.0 | 1260 | 0.1669 | 0.4567 | 0.5080 | 0.9577 | 0.9561 | 0.9577 | nan | 0.0916 | nan | 0.9590 | 0.7936 | 0.0 | 0.9025 | 0.9895 | 0.9132 | 0.5201 | 0.0 | 0.9130 | 0.0 | 0.0133 | nan | 0.0912 | nan | 0.8908 | 0.6335 | 0.0 | 0.8679 | 0.9817 | 0.7206 | 0.4284 | 0.0 | 0.8526 | 0.0 | 0.0133 |
| 0.0792 | 9.14 | 1280 | 0.1693 | 0.4344 | 0.4780 | 0.9572 | 0.9556 | 0.9572 | nan | 0.0 | nan | 0.9538 | 0.7097 | 0.0 | 0.9177 | 0.9877 | 0.9273 | 0.3042 | 0.0 | 0.9287 | 0.0 | 0.0071 | nan | 0.0 | nan | 0.8938 | 0.6037 | 0.0 | 0.8680 | 0.9810 | 0.7190 | 0.2908 | 0.0 | 0.8488 | 0.0 | 0.0071 |
| 0.0787 | 9.29 | 1300 | 0.1620 | 0.4540 | 0.5069 | 0.9572 | 0.9557 | 0.9572 | nan | 0.0421 | nan | 0.9482 | 0.7339 | 0.0 | 0.9076 | 0.9919 | 0.8666 | 0.6638 | 0.0 | 0.9281 | 0.0 | 0.0006 | nan | 0.0419 | nan | 0.8920 | 0.6029 | 0.0 | 0.8672 | 0.9810 | 0.7018 | 0.5086 | 0.0 | 0.8518 | 0.0 | 0.0006 |
| 0.0771 | 9.43 | 1320 | 0.1712 | 0.4768 | 0.5428 | 0.9574 | 0.9558 | 0.9574 | nan | 0.3190 | nan | 0.9601 | 0.7340 | 0.0 | 0.8929 | 0.9903 | 0.9208 | 0.7577 | 0.0 | 0.9063 | 0.0 | 0.0325 | nan | 0.2973 | nan | 0.8942 | 0.6028 | 0.0 | 0.8629 | 0.9804 | 0.7112 | 0.4877 | 0.0 | 0.8522 | 0.0 | 0.0325 |
| 0.0808 | 9.57 | 1340 | 0.1728 | 0.4734 | 0.5281 | 0.9578 | 0.9562 | 0.9578 | nan | 0.2930 | nan | 0.9539 | 0.7638 | 0.0 | 0.8984 | 0.9892 | 0.9335 | 0.5209 | 0.0 | 0.9225 | 0.0 | 0.0623 | nan | 0.2795 | nan | 0.8937 | 0.6132 | 0.0 | 0.8646 | 0.9810 | 0.7134 | 0.4179 | 0.0 | 0.8549 | 0.0 | 0.0623 |
| 0.1643 | 9.71 | 1360 | 0.1672 | 0.4657 | 0.5238 | 0.9579 | 0.9563 | 0.9579 | nan | 0.2256 | nan | 0.9523 | 0.7870 | 0.0 | 0.8968 | 0.9910 | 0.9035 | 0.5916 | 0.0 | 0.9227 | 0.0 | 0.0150 | nan | 0.2189 | nan | 0.8931 | 0.6216 | 0.0 | 0.8638 | 0.9813 | 0.7215 | 0.4180 | 0.0 | 0.8556 | 0.0 | 0.0150 |
| 0.6353 | 9.86 | 1380 | 0.1695 | 0.4622 | 0.5143 | 0.9577 | 0.9562 | 0.9577 | nan | 0.2124 | nan | 0.9606 | 0.7924 | 0.0 | 0.8932 | 0.9901 | 0.9256 | 0.4625 | 0.0 | 0.9100 | 0.0 | 0.0250 | nan | 0.2072 | nan | 0.8933 | 0.6165 | 0.0 | 0.8626 | 0.9816 | 0.7213 | 0.3853 | 0.0 | 0.8534 | 0.0 | 0.0250 |
| 0.1332 | 10.0 | 1400 | 0.1712 | 0.4832 | 0.5447 | 0.9579 | 0.9563 | 0.9579 | nan | 0.3034 | nan | 0.9493 | 0.8111 | 0.0 | 0.8882 | 0.9891 | 0.9280 | 0.6416 | 0.0 | 0.9320 | 0.0 | 0.0943 | nan | 0.2861 | nan | 0.8938 | 0.6142 | 0.0 | 0.8619 | 0.9813 | 0.7171 | 0.4938 | 0.0 | 0.8555 | 0.0 | 0.0942 |
| 0.694 | 10.14 | 1420 | 0.1686 | 0.4712 | 0.5406 | 0.9579 | 0.9563 | 0.9579 | nan | 0.2211 | nan | 0.9492 | 0.7362 | 0.0 | 0.8942 | 0.9902 | 0.9239 | 0.7909 | 0.0 | 0.9307 | 0.0 | 0.0501 | nan | 0.2129 | nan | 0.8942 | 0.6134 | 0.0 | 0.8624 | 0.9815 | 0.7228 | 0.4624 | 0.0 | 0.8550 | 0.0 | 0.0501 |
| 0.1005 | 10.29 | 1440 | 0.1677 | 0.4741 | 0.5353 | 0.9579 | 0.9564 | 0.9579 | nan | 0.2181 | nan | 0.9589 | 0.8116 | 0.0 | 0.8912 | 0.9897 | 0.9229 | 0.6682 | 0.0 | 0.9121 | 0.0 | 0.0512 | nan | 0.2094 | nan | 0.8935 | 0.6293 | 0.0 | 0.8639 | 0.9814 | 0.7229 | 0.4848 | 0.0 | 0.8531 | 0.0 | 0.0512 |
| 0.3182 | 10.43 | 1460 | 0.1648 | 0.4785 | 0.5334 | 0.9583 | 0.9567 | 0.9583 | nan | 0.2595 | nan | 0.9537 | 0.7487 | 0.0 | 0.9060 | 0.9908 | 0.9077 | 0.6331 | 0.0 | 0.9196 | 0.0 | 0.0816 | nan | 0.2467 | nan | 0.8942 | 0.6125 | 0.0 | 0.8675 | 0.9813 | 0.7181 | 0.4849 | 0.0 | 0.8551 | 0.0 | 0.0816 |
| 0.0818 | 10.57 | 1480 | 0.1653 | 0.4766 | 0.5381 | 0.9580 | 0.9564 | 0.9580 | nan | 0.2588 | nan | 0.9530 | 0.7726 | 0.0 | 0.8935 | 0.9905 | 0.8986 | 0.7058 | 0.0 | 0.9251 | 0.0 | 0.0594 | nan | 0.2470 | nan | 0.8942 | 0.6117 | 0.0 | 0.8635 | 0.9813 | 0.7142 | 0.4919 | 0.0 | 0.8554 | 0.0 | 0.0594 |
| 0.14 | 10.71 | 1500 | 0.1684 | 0.4819 | 0.5509 | 0.9582 | 0.9566 | 0.9582 | nan | 0.2843 | nan | 0.9530 | 0.7815 | 0.0 | 0.8871 | 0.9908 | 0.9298 | 0.7732 | 0.0 | 0.9210 | 0.0 | 0.0900 | nan | 0.2695 | nan | 0.8942 | 0.6275 | 0.0 | 0.8621 | 0.9816 | 0.7190 | 0.4829 | 0.0 | 0.8558 | 0.0 | 0.0899 |
| 2.1713 | 10.86 | 1520 | 0.1689 | 0.4898 | 0.5597 | 0.9585 | 0.9569 | 0.9585 | nan | 0.3787 | nan | 0.9590 | 0.7863 | 0.0 | 0.8949 | 0.9905 | 0.9114 | 0.7763 | 0.0 | 0.9095 | 0.0 | 0.1091 | nan | 0.3402 | nan | 0.8946 | 0.6316 | 0.0 | 0.8647 | 0.9819 | 0.7230 | 0.4789 | 0.0 | 0.8541 | 0.0 | 0.1090 |
| 0.2183 | 11.0 | 1540 | 0.1692 | 0.4890 | 0.5479 | 0.9584 | 0.9568 | 0.9584 | nan | 0.3785 | nan | 0.9535 | 0.7376 | 0.0 | 0.9100 | 0.9888 | 0.9097 | 0.6825 | 0.0 | 0.9247 | 0.0 | 0.0894 | nan | 0.3416 | nan | 0.8941 | 0.6113 | 0.0 | 0.8670 | 0.9815 | 0.7135 | 0.5139 | 0.0 | 0.8558 | 0.0 | 0.0893 |
| 0.0917 | 11.14 | 1560 | 0.1767 | 0.4973 | 0.5531 | 0.9585 | 0.9570 | 0.9585 | nan | 0.3842 | nan | 0.9533 | 0.7260 | 0.0 | 0.9028 | 0.9921 | 0.9368 | 0.6055 | 0.0 | 0.9123 | 0.0 | 0.2248 | nan | 0.3504 | nan | 0.8955 | 0.6079 | 0.0 | 0.8682 | 0.9810 | 0.7109 | 0.4777 | 0.0 | 0.8551 | 0.0 | 0.2205 |
| 0.0636 | 11.29 | 1580 | 0.1715 | 0.4841 | 0.5345 | 0.9586 | 0.9570 | 0.9586 | nan | 0.3237 | nan | 0.9554 | 0.7520 | 0.0 | 0.9069 | 0.9889 | 0.9346 | 0.4678 | 0.0 | 0.9225 | 0.0 | 0.1623 | nan | 0.3058 | nan | 0.8950 | 0.6222 | 0.0 | 0.8696 | 0.9815 | 0.7146 | 0.4025 | 0.0 | 0.8564 | 0.0 | 0.1612 |
| 0.1112 | 11.43 | 1600 | 0.1684 | 0.4906 | 0.5484 | 0.9588 | 0.9572 | 0.9588 | nan | 0.3242 | nan | 0.9557 | 0.7896 | 0.0 | 0.8975 | 0.9901 | 0.9219 | 0.6537 | 0.0 | 0.9191 | 0.0 | 0.1293 | nan | 0.3033 | nan | 0.8943 | 0.6281 | 0.0 | 0.8691 | 0.9817 | 0.7217 | 0.5035 | 0.0 | 0.8563 | 0.0 | 0.1291 |
| 0.0972 | 11.57 | 1620 | 0.1669 | 0.5035 | 0.5670 | 0.9591 | 0.9575 | 0.9591 | nan | 0.4028 | nan | 0.9499 | 0.8014 | 0.0 | 0.8976 | 0.9912 | 0.9180 | 0.7138 | 0.0 | 0.9242 | 0.0 | 0.2051 | nan | 0.3583 | nan | 0.8953 | 0.6364 | 0.0 | 0.8696 | 0.9815 | 0.7256 | 0.5169 | 0.0 | 0.8561 | 0.0 | 0.2022 |
| 0.2112 | 11.71 | 1640 | 0.1633 | 0.4952 | 0.5658 | 0.9585 | 0.9569 | 0.9585 | nan | 0.4332 | nan | 0.9555 | 0.7908 | 0.0 | 0.8945 | 0.9901 | 0.8802 | 0.7811 | 0.0 | 0.9219 | 0.0 | 0.1426 | nan | 0.3761 | nan | 0.8958 | 0.6318 | 0.0 | 0.8617 | 0.9816 | 0.7160 | 0.4821 | 0.0 | 0.8557 | 0.0 | 0.1421 |
| 0.0853 | 11.86 | 1660 | 0.1675 | 0.5075 | 0.5814 | 0.9589 | 0.9573 | 0.9589 | nan | 0.4450 | nan | 0.9527 | 0.7887 | 0.0 | 0.8908 | 0.9908 | 0.9096 | 0.7882 | 0.0 | 0.9222 | 0.0 | 0.2882 | nan | 0.3845 | nan | 0.8979 | 0.6330 | 0.0 | 0.8623 | 0.9811 | 0.7247 | 0.4738 | 0.0 | 0.8559 | 0.0 | 0.2765 |
| 0.0971 | 12.0 | 1680 | 0.1638 | 0.4867 | 0.5427 | 0.9586 | 0.9570 | 0.9586 | nan | 0.3256 | nan | 0.9527 | 0.7280 | 0.0 | 0.9093 | 0.9903 | 0.9067 | 0.6807 | 0.0 | 0.9244 | 0.0 | 0.0949 | nan | 0.3073 | nan | 0.8945 | 0.6079 | 0.0 | 0.8683 | 0.9816 | 0.7190 | 0.5110 | 0.0 | 0.8562 | 0.0 | 0.0949 |
| 0.104 | 12.14 | 1700 | 0.1708 | 0.4779 | 0.5390 | 0.9583 | 0.9567 | 0.9583 | nan | 0.2507 | nan | 0.9562 | 0.7614 | 0.0 | 0.8965 | 0.9905 | 0.9269 | 0.7290 | 0.0 | 0.9160 | 0.0 | 0.0408 | nan | 0.2415 | nan | 0.8934 | 0.6229 | 0.0 | 0.8679 | 0.9814 | 0.7197 | 0.5117 | 0.0 | 0.8555 | 0.0 | 0.0408 |
| 0.1286 | 12.29 | 1720 | 0.1694 | 0.4872 | 0.5507 | 0.9583 | 0.9568 | 0.9583 | nan | 0.3193 | nan | 0.9517 | 0.7436 | 0.0 | 0.9019 | 0.9893 | 0.9240 | 0.7432 | 0.0 | 0.9272 | 0.0 | 0.1083 | nan | 0.3025 | nan | 0.8936 | 0.6218 | 0.0 | 0.8672 | 0.9815 | 0.7194 | 0.4967 | 0.0 | 0.8555 | 0.0 | 0.1083 |
| 0.0712 | 12.43 | 1740 | 0.1721 | 0.5003 | 0.5802 | 0.9580 | 0.9564 | 0.9580 | nan | 0.4300 | nan | 0.9517 | 0.7718 | 0.0 | 0.8846 | 0.9898 | 0.9220 | 0.8101 | 0.0 | 0.9236 | 0.0 | 0.2787 | nan | 0.3832 | nan | 0.8957 | 0.6283 | 0.0 | 0.8535 | 0.9816 | 0.7160 | 0.4172 | 0.0 | 0.8561 | 0.0 | 0.2720 |
| 0.197 | 12.57 | 1760 | 0.1687 | 0.5139 | 0.5842 | 0.9590 | 0.9574 | 0.9590 | nan | 0.4264 | nan | 0.9502 | 0.7523 | 0.0 | 0.8990 | 0.9908 | 0.9186 | 0.7751 | 0.0 | 0.9244 | 0.0 | 0.3738 | nan | 0.3822 | nan | 0.8971 | 0.6215 | 0.0 | 0.8640 | 0.9816 | 0.7158 | 0.4934 | 0.0 | 0.8567 | 0.0 | 0.3545 |
| 0.0788 | 12.71 | 1780 | 0.1703 | 0.5025 | 0.5712 | 0.9588 | 0.9572 | 0.9588 | nan | 0.4052 | nan | 0.9559 | 0.7632 | 0.0 | 0.8930 | 0.9896 | 0.9252 | 0.7670 | 0.0 | 0.9210 | 0.0 | 0.2344 | nan | 0.3649 | nan | 0.8960 | 0.6274 | 0.0 | 0.8644 | 0.9818 | 0.7186 | 0.4902 | 0.0 | 0.8564 | 0.0 | 0.2303 |
| 0.0576 | 12.86 | 1800 | 0.1651 | 0.4948 | 0.5592 | 0.9589 | 0.9573 | 0.9589 | nan | 0.3756 | nan | 0.9530 | 0.7767 | 0.0 | 0.8989 | 0.9907 | 0.9041 | 0.7459 | 0.0 | 0.9235 | 0.0 | 0.1422 | nan | 0.3421 | nan | 0.8953 | 0.6285 | 0.0 | 0.8671 | 0.9819 | 0.7198 | 0.5038 | 0.0 | 0.8568 | 0.0 | 0.1420 |
| 0.4981 | 13.0 | 1820 | 0.1654 | 0.5011 | 0.5570 | 0.9592 | 0.9576 | 0.9592 | nan | 0.3964 | nan | 0.9487 | 0.7658 | 0.0 | 0.9088 | 0.9906 | 0.9156 | 0.6252 | 0.0 | 0.9288 | 0.0 | 0.2036 | nan | 0.3592 | nan | 0.8954 | 0.6256 | 0.0 | 0.8712 | 0.9817 | 0.7191 | 0.5028 | 0.0 | 0.8571 | 0.0 | 0.2015 |
| 0.0836 | 13.14 | 1840 | 0.1616 | 0.4860 | 0.5349 | 0.9589 | 0.9573 | 0.9589 | nan | 0.3586 | nan | 0.9563 | 0.7332 | 0.0 | 0.9146 | 0.9904 | 0.8988 | 0.5570 | 0.0 | 0.9190 | 0.0 | 0.0911 | nan | 0.3306 | nan | 0.8948 | 0.6161 | 0.0 | 0.8701 | 0.9819 | 0.7153 | 0.4751 | 0.0 | 0.8564 | 0.0 | 0.0911 |
| 2.2966 | 13.29 | 1860 | 0.1625 | 0.4898 | 0.5406 | 0.9592 | 0.9576 | 0.9592 | nan | 0.3665 | nan | 0.9543 | 0.7736 | 0.0 | 0.9071 | 0.9906 | 0.9103 | 0.5564 | 0.0 | 0.9229 | 0.0 | 0.1049 | nan | 0.3388 | nan | 0.8952 | 0.6326 | 0.0 | 0.8718 | 0.9819 | 0.7200 | 0.4749 | 0.0 | 0.8571 | 0.0 | 0.1049 |
| 0.1384 | 13.43 | 1880 | 0.1671 | 0.4986 | 0.5583 | 0.9590 | 0.9574 | 0.9590 | nan | 0.4039 | nan | 0.9500 | 0.7832 | 0.0 | 0.8936 | 0.9913 | 0.9325 | 0.6544 | 0.0 | 0.9256 | 0.0 | 0.1655 | nan | 0.3632 | nan | 0.8954 | 0.6308 | 0.0 | 0.8672 | 0.9817 | 0.7161 | 0.5058 | 0.0 | 0.8575 | 0.0 | 0.1652 |
| 0.2411 | 13.57 | 1900 | 0.1626 | 0.4930 | 0.5531 | 0.9588 | 0.9573 | 0.9588 | nan | 0.3949 | nan | 0.9517 | 0.7610 | 0.0 | 0.9016 | 0.9900 | 0.9139 | 0.6965 | 0.0 | 0.9281 | 0.0 | 0.1002 | nan | 0.3577 | nan | 0.8948 | 0.6281 | 0.0 | 0.8686 | 0.9817 | 0.7167 | 0.5110 | 0.0 | 0.8569 | 0.0 | 0.1002 |
| 0.0853 | 13.71 | 1920 | 0.1683 | 0.5024 | 0.5664 | 0.9589 | 0.9573 | 0.9589 | nan | 0.3947 | nan | 0.9529 | 0.7613 | 0.0 | 0.8987 | 0.9892 | 0.9331 | 0.7412 | 0.0 | 0.9256 | 0.0 | 0.1999 | nan | 0.3580 | nan | 0.8954 | 0.6295 | 0.0 | 0.8679 | 0.9816 | 0.7141 | 0.5266 | 0.0 | 0.8569 | 0.0 | 0.1983 |
| 0.0531 | 13.86 | 1940 | 0.1683 | 0.5003 | 0.5670 | 0.9588 | 0.9572 | 0.9588 | nan | 0.3945 | nan | 0.9570 | 0.7793 | 0.0 | 0.8921 | 0.9895 | 0.9326 | 0.7642 | 0.0 | 0.9184 | 0.0 | 0.1768 | nan | 0.3553 | nan | 0.8951 | 0.6345 | 0.0 | 0.8665 | 0.9817 | 0.7176 | 0.5204 | 0.0 | 0.8566 | 0.0 | 0.1762 |
| 0.0672 | 14.0 | 1960 | 0.1679 | 0.5015 | 0.5669 | 0.9590 | 0.9574 | 0.9590 | nan | 0.3913 | nan | 0.9552 | 0.7735 | 0.0 | 0.8938 | 0.9904 | 0.9339 | 0.7550 | 0.0 | 0.9182 | 0.0 | 0.1912 | nan | 0.3548 | nan | 0.8953 | 0.6322 | 0.0 | 0.8671 | 0.9818 | 0.7173 | 0.5219 | 0.0 | 0.8570 | 0.0 | 0.1902 |
| 0.0714 | 14.14 | 1980 | 0.1650 | 0.4979 | 0.5671 | 0.9589 | 0.9573 | 0.9589 | nan | 0.4079 | nan | 0.9556 | 0.7901 | 0.0 | 0.8935 | 0.9899 | 0.9183 | 0.7769 | 0.0 | 0.9200 | 0.0 | 0.1533 | nan | 0.3634 | nan | 0.8953 | 0.6374 | 0.0 | 0.8657 | 0.9818 | 0.7202 | 0.5007 | 0.0 | 0.8568 | 0.0 | 0.1532 |
| 0.0754 | 14.29 | 2000 | 0.1646 | 0.5051 | 0.5717 | 0.9592 | 0.9577 | 0.9592 | nan | 0.4391 | nan | 0.9545 | 0.7785 | 0.0 | 0.8977 | 0.9906 | 0.9257 | 0.7560 | 0.0 | 0.9189 | 0.0 | 0.1992 | nan | 0.3843 | nan | 0.8962 | 0.6359 | 0.0 | 0.8683 | 0.9818 | 0.7201 | 0.5200 | 0.0 | 0.8570 | 0.0 | 0.1977 |
| 0.0923 | 14.43 | 2020 | 0.1667 | 0.4990 | 0.5750 | 0.9585 | 0.9569 | 0.9585 | nan | 0.4396 | nan | 0.9490 | 0.8005 | 0.0 | 0.8826 | 0.9909 | 0.9246 | 0.7994 | 0.0 | 0.9283 | 0.0 | 0.1847 | nan | 0.3843 | nan | 0.8955 | 0.6348 | 0.0 | 0.8596 | 0.9818 | 0.7178 | 0.4732 | 0.0 | 0.8572 | 0.0 | 0.1838 |
| 0.2083 | 14.57 | 2040 | 0.1613 | 0.4910 | 0.5550 | 0.9588 | 0.9572 | 0.9588 | nan | 0.3514 | nan | 0.9523 | 0.7814 | 0.0 | 0.8960 | 0.9912 | 0.8950 | 0.7657 | 0.0 | 0.9247 | 0.0 | 0.1020 | nan | 0.3279 | nan | 0.8946 | 0.6298 | 0.0 | 0.8672 | 0.9817 | 0.7156 | 0.5163 | 0.0 | 0.8570 | 0.0 | 0.1020 |
| 0.0729 | 14.71 | 2060 | 0.1670 | 0.5042 | 0.5701 | 0.9591 | 0.9575 | 0.9591 | nan | 0.4128 | nan | 0.9509 | 0.7789 | 0.0 | 0.8968 | 0.9899 | 0.9308 | 0.7507 | 0.0 | 0.9272 | 0.0 | 0.2030 | nan | 0.3707 | nan | 0.8957 | 0.6354 | 0.0 | 0.8680 | 0.9818 | 0.7167 | 0.5232 | 0.0 | 0.8574 | 0.0 | 0.2012 |
| 0.1156 | 14.86 | 2080 | 0.1664 | 0.4946 | 0.5645 | 0.9586 | 0.9570 | 0.9586 | nan | 0.4007 | nan | 0.9559 | 0.7844 | 0.0 | 0.8896 | 0.9891 | 0.9211 | 0.7812 | 0.0 | 0.9233 | 0.0 | 0.1284 | nan | 0.3595 | nan | 0.8949 | 0.6351 | 0.0 | 0.8643 | 0.9817 | 0.7180 | 0.4967 | 0.0 | 0.8566 | 0.0 | 0.1283 |
| 0.2123 | 15.0 | 2100 | 0.1597 | 0.4935 | 0.5586 | 0.9588 | 0.9572 | 0.9588 | nan | 0.4024 | nan | 0.9535 | 0.7940 | 0.0 | 0.9003 | 0.9903 | 0.8851 | 0.7599 | 0.0 | 0.9244 | 0.0 | 0.0931 | nan | 0.3611 | nan | 0.8948 | 0.6336 | 0.0 | 0.8675 | 0.9818 | 0.7132 | 0.5201 | 0.0 | 0.8571 | 0.0 | 0.0931 |
### Framework versions
- Transformers 4.33.2
- Pytorch 2.0.1
- Datasets 3.0.0
- Tokenizers 0.13.3
|