checkpoints / README.md
igerasimov's picture
igerasimov/nasa-impact-bert-e-base-mlm-finetuned
5767d8e verified
|
raw
history blame
96.9 kB
metadata
license: apache-2.0
base_model: nasa-impact/nasa-smd-ibm-st
tags:
  - generated_from_trainer
metrics:
  - accuracy
model-index:
  - name: checkpoints
    results: []

checkpoints

This model is a fine-tuned version of nasa-impact/nasa-smd-ibm-st on the None dataset. It achieves the following results on the evaluation set:

  • Accuracy: 0.7087
  • Loss: 1.5329
  • Overall/weighted Precision: 0.7311
  • Overall/weighted Recall: 0.7087
  • Overall/weighted F1: 0.7105
  • Class Agriculture/precision: 1.0
  • Class Agriculture/recall: 1.0
  • Class Agriculture/f1: 1.0
  • Class Air quality/precision: 0.7586
  • Class Air quality/recall: 0.8462
  • Class Air quality/f1: 0.8
  • Class Cryospheric climate indicators/precision: 1.0
  • Class Cryospheric climate indicators/recall: 0.5
  • Class Cryospheric climate indicators/f1: 0.6667
  • Class Droughts/precision: 1.0
  • Class Droughts/recall: 1.0
  • Class Droughts/f1: 1.0
  • Class Earthquakes/precision: 1.0
  • Class Earthquakes/recall: 1.0
  • Class Earthquakes/f1: 1.0
  • Class Ecosystem species/precision: 0.8571
  • Class Ecosystem species/recall: 0.75
  • Class Ecosystem species/f1: 0.8
  • Class Ecosystems/precision: 0.0
  • Class Ecosystems/recall: 1.0
  • Class Ecosystems/f1: 0.0
  • Class Energy production/use/precision: 0.0
  • Class Energy production/use/recall: 0.0
  • Class Energy production/use/f1: 0.0
  • Class Extreme weather/precision: 0.3846
  • Class Extreme weather/recall: 0.8333
  • Class Extreme weather/f1: 0.5263
  • Class Floods/precision: 0.0
  • Class Floods/recall: 0.0
  • Class Floods/f1: 0.0
  • Class Greenhouse gases/precision: 0.6667
  • Class Greenhouse gases/recall: 0.5
  • Class Greenhouse gases/f1: 0.5714
  • Class Heat/precision: 0.75
  • Class Heat/recall: 0.75
  • Class Heat/f1: 0.75
  • Class Land use and cover change/precision: 1.0
  • Class Land use and cover change/recall: 1.0
  • Class Land use and cover change/f1: 1.0
  • Class Landslides/precision: 0.8333
  • Class Landslides/recall: 0.8333
  • Class Landslides/f1: 0.8333
  • Class Public health/precision: 1.0
  • Class Public health/recall: 0.5
  • Class Public health/f1: 0.6667
  • Class Severe storms/precision: 0.5
  • Class Severe storms/recall: 0.4
  • Class Severe storms/f1: 0.4444
  • Class Sun-earth interactions/precision: 0.7667
  • Class Sun-earth interactions/recall: 0.6970
  • Class Sun-earth interactions/f1: 0.7302
  • Class Teleconnections/precision: 0.6667
  • Class Teleconnections/recall: 0.5455
  • Class Teleconnections/f1: 0.6
  • Class Temperature indicators/precision: 0.5
  • Class Temperature indicators/recall: 0.6667
  • Class Temperature indicators/f1: 0.5714

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 16
  • eval_batch_size: 16
  • seed: 42
  • gradient_accumulation_steps: 4
  • total_train_batch_size: 64
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • lr_scheduler_warmup_steps: 500
  • num_epochs: 50
  • mixed_precision_training: Native AMP

Training results

Training Loss Epoch Step Accuracy Validation Loss Overall/weighted Precision Overall/weighted Recall Overall/weighted F1 Class Agriculture/precision Class Agriculture/recall Class Agriculture/f1 Class Air quality/precision Class Air quality/recall Class Air quality/f1 Class Cryospheric climate indicators/precision Class Cryospheric climate indicators/recall Class Cryospheric climate indicators/f1 Class Droughts/precision Class Droughts/recall Class Droughts/f1 Class Earthquakes/precision Class Earthquakes/recall Class Earthquakes/f1 Class Ecosystem species/precision Class Ecosystem species/recall Class Ecosystem species/f1 Class Ecosystems/precision Class Ecosystems/recall Class Ecosystems/f1 Class Energy production/use/precision Class Energy production/use/recall Class Energy production/use/f1 Class Extreme weather/precision Class Extreme weather/recall Class Extreme weather/f1 Class Floods/precision Class Floods/recall Class Floods/f1 Class Greenhouse gases/precision Class Greenhouse gases/recall Class Greenhouse gases/f1 Class Heat/precision Class Heat/recall Class Heat/f1 Class Land use and cover change/precision Class Land use and cover change/recall Class Land use and cover change/f1 Class Landslides/precision Class Landslides/recall Class Landslides/f1 Class Public health/precision Class Public health/recall Class Public health/f1 Class Severe storms/precision Class Severe storms/recall Class Severe storms/f1 Class Sun-earth interactions/precision Class Sun-earth interactions/recall Class Sun-earth interactions/f1 Class Teleconnections/precision Class Teleconnections/recall Class Teleconnections/f1 Class Temperature indicators/precision Class Temperature indicators/recall Class Temperature indicators/f1 Class Validation/precision Class Validation/recall Class Validation/f1
No log 1.0 8 0.0 3.1300 0.4173 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0
3.1343 2.0 16 0.0945 3.0987 0.4665 0.0945 0.0646 1.0 0.0 0.0 0.24 0.4615 0.3158 1.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 1.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0
3.1018 3.0 24 0.2126 3.0484 0.5508 0.2126 0.0978 1.0 0.0 0.0 0.2336 0.9615 0.3759 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.1176 0.0606 0.08 1.0 0.0 0.0 1.0 0.0 0.0
3.0499 4.0 32 0.2283 2.9848 0.6297 0.2283 0.1095 1.0 0.0 0.0 0.2364 1.0 0.3824 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.1765 0.0909 0.12 1.0 0.0 0.0 1.0 0.0 0.0
2.9715 5.0 40 0.2283 2.9113 0.6321 0.2283 0.1095 1.0 0.0 0.0 0.2342 1.0 0.3796 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.1875 0.0909 0.1224 1.0 0.0 0.0 1.0 0.0 0.0
2.9715 6.0 48 0.2520 2.8317 0.6668 0.2520 0.1394 1.0 0.0 0.0 0.2407 1.0 0.3881 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.3158 0.1818 0.2308 1.0 0.0 0.0 1.0 0.0 0.0
2.8735 7.0 56 0.4016 2.7478 0.7263 0.4016 0.2582 1.0 0.0 0.0 0.52 1.0 0.6842 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.3247 0.7576 0.4545 1.0 0.0 0.0 1.0 0.0 0.0
2.7766 8.0 64 0.3937 2.6696 0.7255 0.3937 0.2552 1.0 0.0 0.0 0.5319 0.9615 0.6849 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.3125 0.7576 0.4425 1.0 0.0 0.0 1.0 0.0 0.0
2.6778 9.0 72 0.3307 2.6007 0.7783 0.3307 0.2201 1.0 0.0 0.0 0.8333 0.3846 0.5263 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.2783 0.9697 0.4324 1.0 0.0 0.0 1.0 0.0 0.0
2.6132 10.0 80 0.3701 2.5347 0.7679 0.3701 0.2580 1.0 0.0 0.0 0.7727 0.6538 0.7083 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.2857 0.9091 0.4348 1.0 0.0 0.0 1.0 0.0 0.0
2.6132 11.0 88 0.3937 2.4538 0.7650 0.3937 0.2717 1.0 0.0 0.0 0.7407 0.7692 0.7547 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.3 0.9091 0.4511 1.0 0.0 0.0 1.0 0.0 0.0
2.502 12.0 96 0.4252 2.3546 0.7537 0.4252 0.3030 1.0 0.0 0.0 0.6667 0.9231 0.7742 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.25 0.4 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.3146 0.8485 0.4590 1.0 0.0 0.0 1.0 0.0 0.0
2.4298 13.0 104 0.4646 2.2607 0.7308 0.4646 0.3283 1.0 0.0 0.0 0.6098 0.9615 0.7463 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.6 0.75 0.6667 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.3684 0.8485 0.5138 1.0 0.0 0.0 1.0 0.0 0.0
2.263 14.0 112 0.4803 2.1656 0.6757 0.4803 0.3474 1.0 0.0 0.0 0.6098 0.9615 0.7463 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.4375 0.875 0.5833 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.4179 0.8485 0.56 0.3333 0.0909 0.1429 1.0 0.0 0.0
2.1649 15.0 120 0.4882 2.0712 0.6239 0.4882 0.3616 1.0 0.0 0.0 0.5814 0.9615 0.7246 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.5 0.75 0.6 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.4462 0.8788 0.5918 0.4 0.1818 0.25 1.0 0.0 0.0
2.1649 16.0 128 0.5118 1.9789 0.6575 0.5118 0.3960 1.0 0.0 0.0 0.6944 0.9615 0.8065 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.4615 0.75 0.5714 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.1538 0.25 0.1905 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.5082 0.9394 0.6596 0.25 0.0909 0.1333 1.0 0.0 0.0
2.0169 17.0 136 0.5433 1.9319 0.7150 0.5433 0.4470 1.0 0.0 0.0 0.6757 0.9615 0.7937 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.4286 0.75 0.5455 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.1818 0.5 0.2667 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.6383 0.9091 0.75 0.5714 0.3636 0.4444 1.0 0.0 0.0
1.8937 18.0 144 0.5276 1.8886 0.7051 0.5276 0.4316 1.0 0.0 0.0 0.5814 0.9615 0.7246 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.4615 0.75 0.5714 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.25 0.75 0.375 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.65 0.7879 0.7123 0.5714 0.3636 0.4444 1.0 0.0 0.0
1.8209 19.0 152 0.5512 1.7950 0.7211 0.5512 0.4524 1.0 0.0 0.0 0.6579 0.9615 0.7812 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.5 0.75 0.6 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.24 0.75 0.3636 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.6444 0.8788 0.7436 0.5714 0.3636 0.4444 1.0 0.0 0.0
1.6452 20.0 160 0.5827 1.7998 0.7483 0.5827 0.4947 1.0 0.0 0.0 0.625 0.9615 0.7576 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.6667 0.75 0.7059 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.24 0.75 0.3636 1.0 0.25 0.4 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.6829 0.8485 0.7568 0.7273 0.7273 0.7273 1.0 0.0 0.0
1.6452 21.0 168 0.5827 1.7016 0.7211 0.5827 0.5068 1.0 0.0 0.0 0.6757 0.9615 0.7937 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.5833 0.875 0.7 1.0 0.0 0.0 0.5 0.1667 0.25 1.0 0.0 0.0 0.25 0.75 0.375 1.0 0.25 0.4 1.0 0.25 0.4 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.6512 0.8485 0.7368 0.7143 0.4545 0.5556 1.0 0.0 0.0
1.5597 22.0 176 0.6378 1.6544 0.7338 0.6378 0.5642 1.0 0.0 0.0 0.6579 0.9615 0.7812 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.5 0.6667 0.75 0.75 0.75 1.0 0.0 0.0 0.6 0.5 0.5455 1.0 0.0 0.0 0.4118 0.875 0.56 0.75 0.75 0.75 1.0 0.25 0.4 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.0 0.0 0.6512 0.8485 0.7368 0.7 0.6364 0.6667 1.0 0.0 0.0
1.4316 23.0 184 0.6850 1.5807 0.7513 0.6850 0.6319 1.0 0.0 0.0 0.7742 0.9231 0.8421 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.5 0.6667 0.6667 0.75 0.7059 1.0 0.0 0.0 0.5 0.5 0.5 1.0 0.0 0.0 0.4 0.75 0.5217 0.6 0.75 0.6667 1.0 0.75 0.8571 1.0 0.8333 0.9091 1.0 0.0 0.0 1.0 0.0 0.0 0.6977 0.9091 0.7895 0.6667 0.5455 0.6 1.0 0.0 0.0
1.2604 24.0 192 0.6850 1.5698 0.7486 0.6850 0.6436 1.0 0.0 0.0 0.7353 0.9615 0.8333 1.0 0.0 0.0 1.0 0.0 0.0 1.0 0.5 0.6667 0.75 0.75 0.75 1.0 0.0 0.0 0.4286 0.5 0.4615 1.0 0.0 0.0 0.4 0.75 0.5217 0.75 0.75 0.75 1.0 0.75 0.8571 1.0 0.8333 0.9091 1.0 0.0 0.0 1.0 0.0 0.0 0.7027 0.7879 0.7429 0.6364 0.6364 0.6364 1.0 0.6667 0.8
1.17 25.0 200 0.6772 1.5075 0.7379 0.6772 0.6377 1.0 0.0 0.0 0.7353 0.9615 0.8333 1.0 0.0 0.0 1.0 0.5 0.6667 1.0 0.5 0.6667 0.6667 0.75 0.7059 1.0 0.0 0.0 0.4444 0.6667 0.5333 1.0 0.0 0.0 0.4615 0.75 0.5714 0.75 0.75 0.75 1.0 0.75 0.8571 1.0 0.8333 0.9091 1.0 0.0 0.0 1.0 0.0 0.0 0.6757 0.7576 0.7143 0.6 0.5455 0.5714 1.0 0.3333 0.5
1.17 26.0 208 0.7165 1.4437 0.7679 0.7165 0.6756 1.0 0.0 0.0 0.8065 0.9615 0.8772 1.0 0.0 0.0 1.0 0.5 0.6667 1.0 0.5 0.6667 0.75 0.75 0.75 1.0 0.0 0.0 0.4444 0.6667 0.5333 1.0 0.0 0.0 0.5455 0.75 0.6316 0.6 0.75 0.6667 1.0 0.75 0.8571 1.0 0.8333 0.9091 1.0 0.0 0.0 1.0 0.0 0.0 0.6905 0.8788 0.7733 0.6667 0.5455 0.6 1.0 0.6667 0.8
1.0515 27.0 216 0.7402 1.3992 0.7587 0.7402 0.7103 1.0 0.0 0.0 0.8214 0.8846 0.8519 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.75 0.75 0.75 1.0 0.0 0.0 0.5 0.8333 0.625 1.0 0.0 0.0 0.8333 0.625 0.7143 1.0 0.75 0.8571 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.0 0.0 0.0 0.0 0.0 0.6667 0.9091 0.7692 0.6667 0.5455 0.6 1.0 0.6667 0.8
0.9513 28.0 224 0.7165 1.3520 0.7659 0.7165 0.6754 1.0 0.0 0.0 0.7667 0.8846 0.8214 1.0 0.0 0.0 1.0 1.0 1.0 1.0 1.0 1.0 0.75 0.75 0.75 1.0 0.0 0.0 0.5 0.8333 0.625 1.0 0.0 0.0 0.6667 0.75 0.7059 1.0 0.75 0.8571 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.0 0.0 1.0 0.0 0.0 0.6667 0.8485 0.7467 0.5455 0.5455 0.5455 1.0 0.3333 0.5
0.7942 29.0 232 0.7244 1.3103 0.7409 0.7244 0.7038 1.0 0.5 0.6667 0.8065 0.9615 0.8772 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.6667 0.75 0.7059 1.0 0.0 0.0 0.4167 0.8333 0.5556 1.0 0.0 0.0 0.75 0.75 0.75 1.0 0.75 0.8571 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.0 0.0 0.0 0.0 0.0 0.7059 0.7273 0.7164 0.5455 0.5455 0.5455 1.0 0.6667 0.8
0.7386 30.0 240 0.7008 1.3628 0.7289 0.7008 0.6813 1.0 0.0 0.0 0.8065 0.9615 0.8772 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.75 0.75 0.75 1.0 0.0 0.0 0.3333 0.6667 0.4444 1.0 0.0 0.0 0.7143 0.625 0.6667 0.75 0.75 0.75 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.0 0.0 0.0 0.0 0.0 0.7059 0.7273 0.7164 0.6 0.5455 0.5714 0.6667 0.6667 0.6667
0.7386 31.0 248 0.7165 1.3002 0.7389 0.7165 0.6980 1.0 0.5 0.6667 0.7353 0.9615 0.8333 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.75 0.75 0.75 1.0 0.0 0.0 0.4 0.6667 0.5 1.0 0.0 0.0 0.75 0.75 0.75 0.75 0.75 0.75 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.0 0.0 0.0 0.0 0.0 0.7586 0.6667 0.7097 0.5714 0.7273 0.64 1.0 0.6667 0.8
0.64 32.0 256 0.7244 1.3095 0.7345 0.7244 0.7027 1.0 0.5 0.6667 0.8065 0.9615 0.8772 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.75 0.75 0.75 1.0 0.0 0.0 0.4 0.6667 0.5 1.0 0.0 0.0 0.75 0.75 0.75 0.75 0.75 0.75 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.0 0.0 0.0 0.0 0.0 0.6944 0.7576 0.7246 0.5455 0.5455 0.5455 1.0 0.6667 0.8
0.5528 33.0 264 0.7087 1.2698 0.7282 0.7087 0.6903 1.0 0.5 0.6667 0.7576 0.9615 0.8475 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.75 0.75 0.75 1.0 0.0 0.0 0.3636 0.6667 0.4706 1.0 0.0 0.0 0.75 0.75 0.75 0.75 0.75 0.75 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.0 0.0 0.0 0.0 0.0 0.6970 0.6970 0.6970 0.6 0.5455 0.5714 1.0 0.6667 0.8
0.4612 34.0 272 0.7402 1.2532 0.7488 0.7402 0.7174 1.0 1.0 1.0 0.7812 0.9615 0.8621 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.8571 0.75 0.8 1.0 0.0 0.0 0.4 0.6667 0.5 1.0 0.0 0.0 0.75 0.75 0.75 0.75 0.75 0.75 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.0 0.0 0.0 0.0 0.0 0.7027 0.7879 0.7429 0.6667 0.5455 0.6 1.0 0.6667 0.8
0.4051 35.0 280 0.7087 1.2745 0.7369 0.7087 0.6930 1.0 1.0 1.0 0.7812 0.9615 0.8621 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.8571 0.75 0.8 1.0 0.0 0.0 0.3846 0.8333 0.5263 1.0 0.0 0.0 0.0 1.0 0.0 0.7143 0.625 0.6667 0.75 0.75 0.75 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.0 0.0 0.0 0.0 0.0 0.7241 0.6364 0.6774 0.5 0.6364 0.56 1.0 0.6667 0.8
0.4051 36.0 288 0.7087 1.3092 0.7413 0.7087 0.6988 1.0 1.0 1.0 0.8276 0.9231 0.8727 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.8571 0.75 0.8 1.0 0.0 0.0 0.3077 0.6667 0.4211 1.0 0.0 0.0 0.0 1.0 0.0 0.75 0.75 0.75 0.75 0.75 0.75 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.0 0.0 0.0 0.0 0.0 0.6765 0.6970 0.6866 0.6 0.5455 0.5714 1.0 0.6667 0.8
0.3354 37.0 296 0.6929 1.2752 0.7348 0.6929 0.6799 1.0 0.5 0.6667 0.7143 0.9615 0.8197 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.75 0.75 0.75 1.0 0.0 0.0 0.3333 0.6667 0.4444 1.0 0.0 0.0 0.0 1.0 0.0 0.7143 0.625 0.6667 0.75 0.75 0.75 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.0 0.0 0.3333 0.2 0.25 0.76 0.5758 0.6552 0.5714 0.7273 0.64 0.6667 0.6667 0.6667
0.2905 38.0 304 0.7244 1.2621 0.7442 0.7244 0.7060 1.0 1.0 1.0 0.7812 0.9615 0.8621 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.8571 0.75 0.8 1.0 0.0 0.0 0.3846 0.8333 0.5263 1.0 0.0 0.0 0.6667 0.5 0.5714 0.75 0.75 0.75 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.0 0.0 0.0 0.0 0.0 0.7273 0.7273 0.7273 0.7 0.6364 0.6667 0.6667 0.6667 0.6667
0.249 39.0 312 0.7165 1.3443 0.7636 0.7165 0.7027 1.0 1.0 1.0 0.7143 0.9615 0.8197 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.8571 0.75 0.8 1.0 0.0 0.0 0.3846 0.8333 0.5263 1.0 0.0 0.0 0.0 1.0 0.0 0.7143 0.625 0.6667 0.75 0.75 0.75 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.0 0.0 0.3333 0.2 0.25 0.8261 0.5758 0.6786 0.6 0.8182 0.6923 0.6667 0.6667 0.6667
0.201 40.0 320 0.7008 1.2940 0.7209 0.7008 0.6824 1.0 1.0 1.0 0.8276 0.9231 0.8727 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.8571 0.75 0.8 0.0 1.0 0.0 1.0 0.0 0.0 0.3333 0.6667 0.4444 1.0 0.0 0.0 0.5 0.25 0.3333 0.75 0.75 0.75 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.0 0.0 0.0 0.0 0.0 0.6842 0.7879 0.7324 0.6 0.5455 0.5714 0.6667 0.6667 0.6667
0.201 41.0 328 0.7638 1.3724 0.8040 0.7638 0.7341 1.0 1.0 1.0 0.8 0.9231 0.8571 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.8571 0.75 0.8 1.0 0.0 0.0 0.5 0.8333 0.625 1.0 0.0 0.0 0.8571 0.75 0.8 1.0 0.75 0.8571 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.0 0.0 1.0 0.0 0.0 0.6744 0.8788 0.7632 0.6667 0.5455 0.6 1.0 0.6667 0.8
0.1855 42.0 336 0.7323 1.3904 0.7521 0.7323 0.7117 1.0 1.0 1.0 0.8846 0.8846 0.8846 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.8571 0.75 0.8 1.0 0.0 0.0 0.3636 0.6667 0.4706 1.0 0.0 0.0 0.8 0.5 0.6154 0.75 0.75 0.75 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.0 0.0 0.0 0.0 0.0 0.6591 0.8788 0.7532 0.6667 0.5455 0.6 0.6667 0.6667 0.6667
0.1636 43.0 344 0.6929 1.4009 0.7417 0.6929 0.6851 1.0 1.0 1.0 0.6970 0.8846 0.7797 0.5 0.5 0.5 1.0 1.0 1.0 1.0 1.0 1.0 0.8571 0.75 0.8 1.0 0.0 0.0 0.3571 0.8333 0.5 1.0 0.0 0.0 0.0 1.0 0.0 0.8 0.5 0.6154 1.0 0.75 0.8571 1.0 1.0 1.0 0.7143 0.8333 0.7692 1.0 0.0 0.0 0.2 0.2 0.2 0.7692 0.6061 0.6780 0.7273 0.7273 0.7273 0.6667 0.6667 0.6667
0.1472 44.0 352 0.7165 1.4073 0.7307 0.7165 0.7020 1.0 1.0 1.0 0.8462 0.8462 0.8462 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.8571 0.75 0.8 1.0 0.0 0.0 0.3636 0.6667 0.4706 1.0 0.0 0.0 0.8333 0.625 0.7143 0.75 0.75 0.75 1.0 1.0 1.0 0.8333 0.8333 0.8333 1.0 0.5 0.6667 0.0 0.0 0.0 0.6429 0.8182 0.72 0.625 0.4545 0.5263 0.6667 0.6667 0.6667
0.114 45.0 360 0.7244 1.4105 0.7553 0.7244 0.7219 1.0 1.0 1.0 0.7059 0.9231 0.8 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.8571 0.75 0.8 0.0 0.0 0.0 0.3846 0.8333 0.5263 1.0 0.0 0.0 0.0 1.0 0.0 0.7143 0.625 0.6667 0.75 0.75 0.75 1.0 1.0 1.0 0.8333 0.8333 0.8333 1.0 0.5 0.6667 0.6667 0.4 0.5 0.8077 0.6364 0.7119 0.7 0.6364 0.6667 0.6667 0.6667 0.6667
0.114 46.0 368 0.7402 1.3171 0.7515 0.7402 0.7248 1.0 1.0 1.0 0.8065 0.9615 0.8772 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.8571 0.75 0.8 1.0 0.0 0.0 0.3846 0.8333 0.5263 1.0 0.0 0.0 0.7143 0.625 0.6667 0.75 0.75 0.75 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.5 0.6667 0.0 0.0 0.0 0.7353 0.7576 0.7463 0.6667 0.5455 0.6 0.6667 0.6667 0.6667
0.0875 47.0 376 0.7402 1.3592 0.7814 0.7402 0.7375 1.0 1.0 1.0 0.7742 0.9231 0.8421 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.8571 0.75 0.8 1.0 0.0 0.0 0.3571 0.8333 0.5 1.0 0.0 0.0 0.7143 0.625 0.6667 0.75 0.75 0.75 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.5 0.6667 0.4 0.4 0.4 0.8148 0.6667 0.7333 0.7273 0.7273 0.7273 0.5 0.6667 0.5714
0.0698 48.0 384 0.7244 1.4037 0.7611 0.7244 0.7204 1.0 1.0 1.0 0.8 0.9231 0.8571 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.8571 0.75 0.8 0.0 1.0 0.0 1.0 0.0 0.0 0.3846 0.8333 0.5263 1.0 0.0 0.0 0.0 1.0 0.0 0.6667 0.5 0.5714 0.75 0.75 0.75 0.8 1.0 0.8889 1.0 0.8333 0.9091 1.0 0.5 0.6667 0.3333 0.2 0.25 0.7667 0.6970 0.7302 0.7 0.6364 0.6667 0.5 0.6667 0.5714
0.0519 49.0 392 0.7244 1.5194 0.7606 0.7244 0.7188 1.0 1.0 1.0 0.7576 0.9615 0.8475 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.8571 0.75 0.8 0.0 1.0 0.0 1.0 0.0 0.0 0.3846 0.8333 0.5263 1.0 0.0 0.0 0.0 1.0 0.0 0.6667 0.5 0.5714 0.75 0.75 0.75 1.0 1.0 1.0 1.0 0.8333 0.9091 1.0 0.5 0.6667 0.3333 0.2 0.25 0.7586 0.6667 0.7097 0.7 0.6364 0.6667 0.6667 0.6667 0.6667
0.0404 50.0 400 0.7087 1.5329 0.7311 0.7087 0.7105 1.0 1.0 1.0 0.7586 0.8462 0.8 1.0 0.5 0.6667 1.0 1.0 1.0 1.0 1.0 1.0 0.8571 0.75 0.8 0.0 1.0 0.0 0.0 0.0 0.0 0.3846 0.8333 0.5263 0.0 0.0 0.0 0.6667 0.5 0.5714 0.75 0.75 0.75 1.0 1.0 1.0 0.8333 0.8333 0.8333 1.0 0.5 0.6667 0.5 0.4 0.4444 0.7667 0.6970 0.7302 0.6667 0.5455 0.6 0.5 0.6667 0.5714

Framework versions

  • Transformers 4.38.2
  • Pytorch 2.2.1+cu121
  • Datasets 2.18.0
  • Tokenizers 0.15.2