Training in progress, step 5000

nohup.out

@@ -33831,3 +33831,74 @@ Several commits (2) will be pushed upstream.
 [INFO|modeling_utils.py:1693] 2023-07-20 17:12:51,133 >> Model weights saved in ./checkpoint-4000/pytorch_model.bin
 [INFO|feature_extraction_utils.py:368] 2023-07-20 17:12:51,145 >> Feature extractor saved in ./checkpoint-4000/preprocessor_config.json
 [INFO|feature_extraction_utils.py:368] 2023-07-20 17:12:57,138 >> Feature extractor saved in ./preprocessor_config.json
+
 80%|████████  | 4001/5000 [6:08:06<85:05:49, 306.66s/it]
 80%|████████  | 4002/5000 [6:08:11<59:53:28, 216.04s/it]
 80%|████████  | 4003/5000 [6:08:16<42:16:08, 152.63s/it]
 80%|████████  | 4004/5000 [6:08:21<30:00:37, 108.47s/it]
 80%|████████  | 4005/5000 [6:08:25<21:19:11, 77.14s/it] 
 80%|████████  | 4006/5000 [6:08:30<15:16:50, 55.34s/it]
 80%|████████  | 4007/5000 [6:08:35<11:05:34, 40.22s/it]
 80%|████████  | 4008/5000 [6:08:38<8:04:38, 29.31s/it] 
 80%|████████  | 4009/5000 [6:08:42<5:57:41, 21.66s/it]
 80%|████████  | 4010/5000 [6:08:46<4:28:51, 16.29s/it]
 80%|████████  | 4011/5000 [6:08:50<3:28:09, 12.63s/it]
 80%|████████  | 4012/5000 [6:08:54<2:44:22,  9.98s/it]
 80%|████████  | 4013/5000 [6:08:59<2:18:01,  8.39s/it]
 80%|████████  | 4014/5000 [6:09:03<1:58:27,  7.21s/it]
 80%|████████  | 4015/5000 [6:09:07<1:43:43,  6.32s/it]
 80%|████████  | 4016/5000 [6:09:11<1:31:13,  5.56s/it]
 80%|████████  | 4017/5000 [6:09:16<1:27:21,  5.33s/it]
 80%|████████  | 4018/5000 [6:09:21<1:24:34,  5.17s/it]
 80%|████████  | 4019/5000 [6:09:25<1:20:36,  4.93s/it]
 80%|████████  | 4020/5000 [6:09:31<1:25:05,  5.21s/it]
 80%|████████  | 4021/5000 [6:09:37<1:31:02,  5.58s/it]
 80%|████████  | 4022/5000 [6:09:41<1:23:44,  5.14s/it]
 80%|████████  | 4023/5000 [6:09:45<1:17:17,  4.75s/it]
 80%|████████  | 4024/5000 [6:09:49<1:12:35,  4.46s/it]
 80%|████████  | 4025/5000 [6:09:53<1:09:21,  4.27s/it]
                                                       
 80%|████████  | 4025/5000 [6:09:53<1:09:21,  4.27s/it]
 81%|████████  | 4026/5000 [6:09:57<1:08:55,  4.25s/it]
 81%|████████  | 4027/5000 [6:10:02<1:10:00,  4.32s/it]
 81%|████████  | 4028/5000 [6:10:08<1:18:21,  4.84s/it]
 81%|████████  | 4029/5000 [6:10:13<1:22:26,  5.09s/it]
 81%|████████  | 4030/5000 [6:10:17<1:16:30,  4.73s/it]
 81%|████████  | 4031/5000 [6:10:21<1:13:57,  4.58s/it]
 81%|████████  | 4032/5000 [6:10:26<1:13:35,  4.56s/it]
 81%|████████  | 4033/5000 [6:10:30<1:10:23,  4.37s/it]
 81%|████████  | 4034/5000 [6:10:34<1:07:34,  4.20s/it]
 81%|████████  | 4035/5000 [6:10:40<1:15:46,  4.71s/it]
 81%|████████  | 4036/5000 [6:10:46<1:25:54,  5.35s/it]
 81%|████████  | 4037/5000 [6:10:50<1:18:20,  4.88s/it]
 81%|████████  | 4038/5000 [6:10:55<1:16:48,  4.79s/it]
 81%|████████  | 4039/5000 [6:11:00<1:17:01,  4.81s/it]
 81%|████████  | 4040/5000 [6:11:04<1:13:41,  4.61s/it]
 81%|████████  | 4041/5000 [6:11:08<1:11:37,  4.48s/it]
 81%|████████  | 4042/5000 [6:11:15<1:23:53,  5.25s/it]
 81%|████████  | 4043/5000 [6:11:19<1:17:01,  4.83s/it]
 81%|████████  | 4044/5000 [6:11:23<1:12:15,  4.53s/it]
 81%|████████  | 4045/5000 [6:11:27<1:09:09,  4.35s/it]
 81%|████████  | 4046/5000 [6:11:31<1:07:22,  4.24s/it]
 81%|████████  | 4047/5000 [6:11:35<1:08:31,  4.31s/it]
 81%|████████  | 4048/5000 [6:11:39<1:06:17,  4.18s/it]
 81%|████████  | 4049/5000 [6:11:44<1:11:43,  4.52s/it]
 81%|████████  | 4050/5000 [6:11:48<1:08:22,  4.32s/it]
                                                       
 81%|████████  | 4050/5000 [6:11:48<1:08:22,  4.32s/it]
 81%|████████  | 4051/5000 [6:11:52<1:07:39,  4.28s/it]
 81%|████████  | 4052/5000 [6:11:56<1:05:35,  4.15s/it]
 81%|████████  | 4053/5000 [6:12:00<1:04:18,  4.07s/it]
 81%|████████  | 4054/5000 [6:12:04<1:03:02,  4.00s/it]
 81%|████████  | 4055/5000 [6:12:08<1:02:20,  3.96s/it]
 81%|████████  | 4056/5000 [6:12:14<1:11:35,  4.55s/it]
 81%|████████  | 4057/5000 [6:12:18<1:09:51,  4.44s/it]
 81%|████████  | 4058/5000 [6:12:23<1:11:57,  4.58s/it]
 81%|████████  | 4059/5000 [6:12:27<1:10:43,  4.51s/it]
 81%|████████  | 4060/5000 [6:12:31<1:09:46,  4.45s/it]
 81%|████████  | 4061/5000 [6:12:36<1:10:40,  4.52s/it]
 81%|█��██████  | 4062/5000 [6:12:41<1:11:40,  4.58s/it]
 81%|████████▏ | 4063/5000 [6:12:49<1:29:21,  5.72s/it]
 81%|████████▏ | 4064/5000 [6:12:53<1:20:22,  5.15s/it]
 81%|████████▏ | 4065/5000 [6:12:58<1:19:01,  5.07s/it]
 81%|████████▏ | 4066/5000 [6:13:02<1:16:13,  4.90s/it]
 81%|████████▏ | 4067/5000 [6:13:07<1:13:46,  4.74s/it]
 81%|████████▏ | 4068/5000 [6:13:11<1:13:02,  4.70s/it]
 81%|████████▏ | 4069/5000 [6:13:17<1:15:31,  4.87s/it]
 81%|████████▏ | 4070/5000 [6:13:23<1:21:36,  5.27s/it]
 81%|████████▏ | 4071/5000 [6:13:27<1:14:34,  4.82s/it]
 81%|████████▏ | 4072/5000 [6:13:32<1:18:21,  5.07s/it]
 81%|████████▏ | 4073/5000 [6:13:36<1:12:23,  4.69s/it]
 81%|████████▏ | 4074/5000 [6:13:40<1:10:33,  4.57s/it]
 82%|████████▏ | 4075/5000 [6:13:46<1:13:25,  4.76s/it]
                                                       
 82%|████████▏ | 4075/5000 [6:13:46<1:13:25,  4.76s/it]
 82%|████████▏ | 4076/5000 [6:13:50<1:12:36,  4.71s/it]
 82%|████████▏ | 4077/5000 [6:13:55<1:12:26,  4.71s/it]
 82%|████████▏ | 4078/5000 [6:14:00<1:12:45,  4.73s/it]
 82%|████████▏ | 4079/5000 [6:14:03<1:08:19,  4.45s/it]
 82%|████████▏ | 4080/5000 [6:14:09<1:12:43,  4.74s/it]
 82%|████████▏ | 4081/5000 [6:14:14<1:12:50,  4.76s/it]
 82%|████████▏ | 4082/5000 [6:14:18<1:11:28,  4.67s/it]
 82%|████████▏ | 4083/5000 [6:14:22<1:08:54,  4.51s/it]
 82%|████████▏ | 4084/5000 [6:14:26<1:05:37,  4.30s/it]
 82%|████████▏ | 4085/5000 [6:14:30<1:06:15,  4.35s/it]
 82%|████████▏ | 4086/5000 [6:14:35<1:08:15,  4.48s/it]
 82%|████████▏ | 4087/5000 [6:14:41<1:14:22,  4.89s/it]
 82%|████████▏ | 4088/5000 [6:14:46<1:15:43,  4.98s/it]
 82%|████████▏ | 4089/5000 [6:14:52<1:20:03,  5.27s/it]
 82%|████████▏ | 4090/5000 [6:14:56<1:13:54,  4.87s/it]
 82%|████████▏ | 4091/5000 [6:15:00<1:09:34,  4.59s/it]
 82%|████████▏ | 4092/5000 [6:15:04<1:07:54,  4.49s/it]
 82%|████████▏ | 4093/5000 [6:15:09<1:08:50,  4.55s/it]
 82%|████████▏ | 4094/5000 [6:15:14<1:11:16,  4.72s/it]
 82%|████████▏ | 4095/5000 [6:15:19<1:12:35,  4.81s/it]
 82%|████████▏ | 4096/5000 [6:15:24<1:11:32,  4.75s/it]
 82%|████████▏ | 4097/5000 [6:15:29<1:13:00,  4.85s/it]
 82%|████████▏ | 4098/5000 [6:15:33<1:08:27,  4.55s/it]
 82%|████████▏ | 4099/5000 [6:15:37<1:05:09,  4.34s/it]
 82%|████████▏ | 4100/5000 [6:15:40<1:02:51,  4.19s/it]
                                                       
 82%|████████▏ | 4100/5000 [6:15:40<1:02:51,  4.19s/it]
 82%|████████▏ | 4101/5000 [6:15:45<1:03:59,  4.27s/it]
 82%|████████▏ | 4102/5000 [6:15:50<1:05:32,  4.38s/it]
 82%|████████▏ | 4103/5000 [6:15:54<1:06:21,  4.44s/it]
 82%|████████▏ | 4104/5000 [6:15:58<1:03:51,  4.28s/it]
 82%|████████▏ | 4105/5000 [6:16:01<58:00,  3.89s/it]  
 82%|████████▏ | 4106/5000 [6:16:03<49:39,  3.33s/it]
 82%|████████▏ | 4107/5000 [6:16:05<43:52,  2.95s/it]
 82%|████████▏ | 4108/5000 [6:16:07<39:46,  2.68s/it]
 82%|████████▏ | 4109/5000 [6:16:09<36:54,  2.49s/it]
 82%|████████▏ | 4110/5000 [6:16:11<34:55,  2.35s/it]
 82%|████████▏ | 4111/5000 [6:16:13<33:31,  2.26s/it]
 82%|████████▏ | 4112/5000 [6:16:15<32:30,  2.20s/it]
 82%|████████▏ | 4113/5000 [6:16:17<31:46,  2.15s/it]
 82%|████████▏ | 4114/5000 [6:16:19<31:17,  2.12s/it]
 82%|████████▏ | 4115/5000 [6:16:21<30:56,  2.10s/it]
 82%|████████▏ | 4116/5000 [6:16:23<30:41,  2.08s/it]
 82%|████████▏ | 4117/5000 [6:16:26<30:29,  2.07s/it]
 82%|████████▏ | 4118/5000 [6:16:28<30:22,  2.07s/it]
 82%|████████▏ | 4119/5000 [6:16:30<30:16,  2.06s/it]
 82%|████████▏ | 4120/5000 [6:16:32<29:36,  2.02s/it]{'eval_loss': 0.3812163174152374, 'eval_wer': 18.775568066750374, 'eval_runtime': 968.0397, 'eval_samples_per_second': 6.809, 'eval_steps_per_second': 0.426, 'epoch': 9.06}
+{'loss': 0.0016, 'learning_rate': 2.1733333333333334e-06, 'epoch': 9.06}
+{'loss': 0.0015, 'learning_rate': 2.117777777777778e-06, 'epoch': 9.07}
+{'loss': 0.0015, 'learning_rate': 2.0622222222222223e-06, 'epoch': 9.07}
+{'loss': 0.0015, 'learning_rate': 2.006666666666667e-06, 'epoch': 9.08}
+
+
+
+
+
+
+
 82%|████████▏ | 4121/5000 [6:17:24<4:13:00, 17.27s/it]
 82%|████████▏ | 4122/5000 [6:17:28<3:13:46, 13.24s/it]
 82%|████████▏ | 4123/5000 [6:17:32<2:32:23, 10.43s/it]
 82%|████████▏ | 4124/5000 [6:17:36<2:03:10,  8.44s/it]
 82%|████████▎ | 4125/5000 [6:17:41<1:48:00,  7.41s/it]
                                                       
 82%|████████▎ | 4125/5000 [6:17:41<1:48:00,  7.41s/it]
 83%|████████▎ | 4126/5000 [6:17:46<1:38:14,  6.74s/it]
 83%|████████▎ | 4127/5000 [6:17:50<1:25:18,  5.86s/it]
 83%|████████▎ | 4128/5000 [6:17:54<1:19:14,  5.45s/it]
 83%|████████▎ | 4129/5000 [6:17:58<1:12:35,  5.00s/it]
 83%|████████▎ | 4130/5000 [6:18:02<1:07:46,  4.67s/it]
 83%|████████▎ | 4131/5000 [6:18:07<1:07:47,  4.68s/it]
 83%|████████▎ | 4132/5000 [6:18:12<1:09:52,  4.83s/it]
 83%|████████▎ | 4133/5000 [6:18:18<1:14:01,  5.12s/it]
 83%|████████▎ | 4134/5000 [6:18:22<1:08:19,  4.73s/it]
 83%|████████▎ | 4135/5000 [6:18:27<1:09:09,  4.80s/it]
 83%|████████▎ | 4136/5000 [6:18:31<1:04:51,  4.50s/it]
 83%|████████▎ | 4137/5000 [6:18:34<1:01:38,  4.29s/it]
 83%|████████▎ | 4138/5000 [6:18:38<59:21,  4.13s/it]  
 83%|████████▎ | 4139/5000 [6:18:43<1:00:39,  4.23s/it]
 83%|████████▎ | 4140/5000 [6:18:47<1:03:43,  4.45s/it]
 83%|████████▎ | 4141/5000 [6:18:53<1:06:44,  4.66s/it]
 83%|████████▎ | 4142/5000 [6:18:57<1:06:50,  4.67s/it]
 83%|████████▎ | 4143/5000 [6:19:03<1:11:03,  4.97s/it]
 83%|████████▎ | 4144/5000 [6:19:08<1:11:22,  5.00s/it]
 83%|████████▎ | 4145/5000 [6:19:13<1:08:47,  4.83s/it]
 83%|████████▎ | 4146/5000 [6:19:16<1:04:22,  4.52s/it]
 83%|████████▎ | 4147/5000 [6:19:20<1:01:38,  4.34s/it]
 83%|████████▎ | 4148/5000 [6:19:25<1:04:42,  4.56s/it]
 83%|████████▎ | 4149/5000 [6:19:29<1:01:45,  4.35s/it]
 83%|████████▎ | 4150/5000 [6:19:34<1:02:44,  4.43s/it]
                                                       
 83%|████████▎ | 4150/5000 [6:19:34<1:02:44,  4.43s/it]
 83%|████████▎ | 4151/5000 [6:19:38<1:00:15,  4.26s/it]
 83%|████████▎ | 4152/5000 [6:19:42<1:02:12,  4.40s/it]
 83%|████████▎ | 4153/5000 [6:19:47<1:03:12,  4.48s/it]
 83%|████████▎ | 4154/5000 [6:19:51<1:01:04,  4.33s/it]
 83%|████████▎ | 4155/5000 [6:19:55<59:03,  4.19s/it]  
 83%|████████▎ | 4156/5000 [6:19:59<57:52,  4.11s/it]
 83%|████████▎ | 4157/5000 [6:20:05<1:07:23,  4.80s/it]
 83%|████████▎ | 4158/5000 [6:20:10<1:08:38,  4.89s/it]
 83%|████████▎ | 4159/5000 [6:20:16<1:12:14,  5.15s/it]
 83%|████████▎ | 4160/5000 [6:20:20<1:06:50,  4.77s/it]
 83%|████████▎ | 4161/5000 [6:20:25<1:08:16,  4.88s/it]
 83%|████████▎ | 4162/5000 [6:20:30<1:09:17,  4.96s/it]
 83%|████████▎ | 4163/5000 [6:20:36<1:10:30,  5.05s/it]
 83%|████████▎ | 4164/5000 [6:20:42<1:15:07,  5.39s/it]
 83%|████████▎ | 4165/5000 [6:20:46<1:10:47,  5.09s/it]
 83%|████████▎ | 4166/5000 [6:20:50<1:05:22,  4.70s/it]
 83%|████████▎ | 4167/5000 [6:20:54<1:01:41,  4.44s/it]
 83%|████████▎ | 4168/5000 [6:21:00<1:07:59,  4.90s/it]
 83%|████████▎ | 4169/5000 [6:21:04<1:03:28,  4.58s/it]
 83%|████████▎ | 4170/5000 [6:21:07<1:00:19,  4.36s/it]
 83%|████████▎ | 4171/5000 [6:21:13<1:07:03,  4.85s/it]
 83%|████████▎ | 4172/5000 [6:21:17<1:02:59,  4.57s/it]
 83%|████████▎ | 4173/5000 [6:21:22<1:02:00,  4.50s/it]
 83%|████████▎ | 4174/5000 [6:21:26<1:01:29,  4.47s/it]
 84%|████████▎ | 4175/5000 [6:21:31<1:02:30,  4.55s/it]
                                                       
 84%|████████▎ | 4175/5000 [6:21:31<1:02:30,  4.55s/it]
 84%|████████▎ | 4176/5000 [6:21:36<1:03:47,  4.64s/it]
 84%|████████▎ | 4177/5000 [6:21:40<1:02:25,  4.55s/it]
 84%|████████▎ | 4178/5000 [6:21:46<1:07:40,  4.94s/it]
 84%|████████▎ | 4179/5000 [6:21:51<1:08:30,  5.01s/it]
 84%|████████▎ | 4180/5000 [6:21:56<1:07:04,  4.91s/it]
 84%|████████▎ | 4181/5000 [6:22:00<1:02:53,  4.61s/it]
 84%|████████▎ | 4182/5000 [6:22:03<59:42,  4.38s/it]  
 84%|████████▎ | 4183/5000 [6:22:08<1:02:28,  4.59s/it]
 84%|████████▎ | 4184/5000 [6:22:12<59:33,  4.38s/it]  
 84%|████████▎ | 4185/5000 [6:22:18<1:05:05,  4.79s/it]
 84%|████████▎ | 4186/5000 [6:22:22<1:01:30,  4.53s/it]
 84%|████████▎ | 4187/5000 [6:22:27<1:01:05,  4.51s/it]
 84%|████████▍ | 4188/5000 [6:22:31<58:58,  4.36s/it]  
 84%|████████▍ | 4189/5000 [6:22:36<1:05:18,  4.83s/it]
 84%|████████▍ | 4190/5000 [6:22:42<1:06:47,  4.95s/it]
 84%|████████▍ | 4191/5000 [6:22:46<1:03:39,  4.72s/it]
 84%|████████▍ | 4192/5000 [6:22:51<1:03:36,  4.72s/it]
 84%|████████▍ | 4193/5000 [6:22:55<1:01:25,  4.57s/it]
 84%|████████▍ | 4194/5000 [6:22:59<1:00:00,  4.47s/it]
 84%|████████▍ | 4195/5000 [6:23:04<1:01:33,  4.59s/it]
 84%|████████▍ | 4196/5000 [6:23:10<1:05:57,  4.92s/it]
 84%|████████▍ | 4197/5000 [6:23:13<1:01:41,  4.61s/it]
 84%|████████▍ | 4198/5000 [6:23:17<58:39,  4.39s/it]  
 84%|████████▍ | 4199/5000 [6:23:23<1:03:31,  4.76s/it]
 84%|████████▍ | 4200/5000 [6:23:28<1:04:40,  4.85s/it]
                                                       
 84%|████████▍ | 4200/5000 [6:23:28<1:04:40,  4.85s/it]
 84%|████████▍ | 4201/5000 [6:23:33<1:05:59,  4.96s/it]
 84%|████████▍ | 4202/5000 [6:23:38<1:06:51,  5.03s/it]
 84%|████████▍ | 4203/5000 [6:23:45<1:10:52,  5.34s/it]
 84%|████████▍ | 4204/5000 [6:23:49<1:07:38,  5.10s/it]
 84%|████████▍ | 4205/5000 [6:23:54<1:05:24,  4.94s/it]
 84%|████████▍ | 4206/5000 [6:24:00<1:09:42,  5.27s/it]
 84%|████████▍ | 4207/5000 [6:24:05<1:08:26,  5.18s/it]
 84%|████████▍ | 4208/5000 [6:24:09<1:06:34,  5.04s/it]
 84%|████████▍ | 4209/5000 [6:24:13<1:02:05,  4.71s/it]
 84%|████████▍ | 4210/5000 [6:24:19<1:04:27,  4.90s/it]
 84%|████████▍ | 4211/5000 [6:24:23<1:04:00,  4.87s/it]
 84%|████████▍ | 4212/5000 [6:24:29<1:05:17,  4.97s/it]
 84%|████████▍ | 4213/5000 [6:24:34<1:06:44,  5.09s/it]
 84%|████████▍ | 4214/5000 [6:24:38<1:01:52,  4.72s/it]
 84%|████████▍ | 4215/5000 [6:24:42<58:20,  4.46s/it]  
 84%|████████▍ | 4216/5000 [6:24:46<55:48,  4.27s/it]
 84%|████████▍ | 4217/5000 [6:24:49<54:03,  4.14s/it]
 84%|████████▍ | 4218/5000 [6:24:55<57:55,  4.44s/it]
 84%|████████▍ | 4219/5000 [6:25:00<1:02:13,  4.78s/it]
 84%|████████▍ | 4220/5000 [6:25:05<1:01:23,  4.72s/it]
 84%|████████▍ | 4221/5000 [6:25:10<1:02:45,  4.83s/it]
 84%|████████▍ | 4222/5000 [6:25:15<1:04:08,  4.95s/it]
 84%|████████▍ | 4223/5000 [6:25:20<1:04:08,  4.95s/it]
 84%|████████▍ | 4224/5000 [6:25:24<1:00:37,  4.69s/it]
 84%|████████▍ | 4225/5000 [6:25:28<57:31,  4.45s/it]  
                                                     
 84%|████████▍ | 4225/5000 [6:25:28<57:31,  4.45s/it]
 85%|████████▍ | 4226/5000 [6:25:33<59:29,  4.61s/it]
 85%|████████▍ | 4227/5000 [6:25:37<56:32,  4.39s/it]
 85%|████████▍ | 4228/5000 [6:25:42<59:21,  4.61s/it]
 85%|████████▍ | 4229/5000 [6:25:46<57:20,  4.46s/it]
 85%|████████▍ | 4230/5000 [6:25:51<57:54,  4.51s/it]
 85%|████████▍ | 4231/5000 [6:25:54<55:11,  4.31s/it]
 85%|████████▍ | 4232/5000 [6:25:58<53:11,  4.16s/it]
 85%|████████▍ | 4233/5000 [6:26:03<55:53,  4.37s/it]
 85%|████████▍ | 4234/5000 [6:26:07<53:47,  4.21s/it]
 85%|████████▍ | 4235/5000 [6:26:11<52:18,  4.10s/it]
 85%|████████▍ | 4236/5000 [6:26:16<55:16,  4.34s/it]
 85%|████████▍ | 4237/5000 [6:26:20<56:15,  4.42s/it]
 85%|████████▍ | 4238/5000 [6:26:25<55:39,  4.38s/it]
 85%|████████▍ | 4239/5000 [6:26:29<53:45,  4.24s/it]
 85%|████████▍ | 4240/5000 [6:26:34<56:59,  4.50s/it]
 85%|████████▍ | 4241/5000 [6:26:38<57:42,  4.56s/it]
 85%|████████▍ | 4242/5000 [6:26:42<54:50,  4.34s/it]
 85%|████████▍ | 4243/5000 [6:26:47<54:48,  4.34s/it]
 85%|████████▍ | 4244/5000 [6:26:50<52:51,  4.19s/it]
 85%|████████▍ | 4245/5000 [6:26:56<56:25,  4.48s/it]
 85%|████████▍ | 4246/5000 [6:27:00<57:09,  4.55s/it]
 85%|████████▍ | 4247/5000 [6:27:05<57:47,  4.61s/it]
 85%|████���███▍ | 4248/5000 [6:27:10<59:51,  4.78s/it]
 85%|████████▍ | 4249/5000 [6:27:15<59:41,  4.77s/it]
 85%|████████▌ | 4250/5000 [6:27:19<56:03,  4.48s/it]
                                                     
 85%|████████▌ | 4250/5000 [6:27:19<56:03,  4.48s/it]
 85%|████████▌ | 4251/5000 [6:27:23<53:36,  4.29s/it]
 85%|████████▌ | 4252/5000 [6:27:27<52:15,  4.19s/it]
 85%|████████▌ | 4253/5000 [6:27:31<54:30,  4.38s/it]
 85%|████████▌ | 4254/5000 [6:27:37<57:34,  4.63s/it]
 85%|████████▌ | 4255/5000 [6:27:42<1:00:55,  4.91s/it]
 85%|████████▌ | 4256/5000 [6:27:47<1:01:43,  4.98s/it]
 85%|████████▌ | 4257/5000 [6:27:53<1:02:56,  5.08s/it]
 85%|████████▌ | 4258/5000 [6:27:58<1:03:22,  5.12s/it]
 85%|████████▌ | 4259/5000 [6:28:03<1:03:38,  5.15s/it]
 85%|████████▌ | 4260/5000 [6:28:08<1:03:18,  5.13s/it]
 85%|████████▌ | 4261/5000 [6:28:12<59:20,  4.82s/it]  
 85%|████████▌ | 4262/5000 [6:28:18<1:02:32,  5.08s/it]
 85%|████████▌ | 4263/5000 [6:28:22<58:00,  4.72s/it]  
 85%|████████▌ | 4264/5000 [6:28:27<58:20,  4.76s/it]
 85%|████████▌ | 4265/5000 [6:28:32<1:01:24,  5.01s/it]
 85%|████████▌ | 4266/5000 [6:28:36<57:55,  4.73s/it]  
 85%|████████▌ | 4267/5000 [6:28:41<59:17,  4.85s/it]
 85%|████████▌ | 4268/5000 [6:28:45<55:44,  4.57s/it]
 85%|████████▌ | 4269/5000 [6:28:50<56:33,  4.64s/it]
 85%|████████▌ | 4270/5000 [6:28:54<54:02,  4.44s/it]
 85%|████████▌ | 4271/5000 [6:28:58<51:57,  4.28s/it]
 85%|████████▌ | 4272/5000 [6:29:02<50:43,  4.18s/it]
 85%|████████▌ | 4273/5000 [6:29:07<54:28,  4.50s/it]
 85%|████████▌ | 4274/5000 [6:29:11<52:46,  4.36s/it]
 86%|████████▌ | 4275/5000 [6:29:16<53:15,  4.41s/it]
                                                     
 86%|████████▌ | 4275/5000 [6:29:16<53:15,  4.41s/it]
 86%|████████▌ | 4276/5000 [6:29:20<51:02,  4.23s/it]
 86%|████████▌ | 4277/5000 [6:29:23<49:39,  4.12s/it]
 86%|████████▌ | 4278/5000 [6:29:27<48:33,  4.04s/it]
 86%|████████▌ | 4279/5000 [6:29:31<47:52,  3.98s/it]
 86%|████████▌ | 4280/5000 [6:29:35<47:21,  3.95s/it]
 86%|████████▌ | 4281/5000 [6:29:40<52:06,  4.35s/it]
 86%|████████▌ | 4282/5000 [6:29:44<50:55,  4.26s/it]
 86%|████████▌ | 4283/5000 [6:29:49<51:19,  4.30s/it]
 86%|████████▌ | 4284/5000 [6:29:54<54:55,  4.60s/it]
 86%|████████▌ | 4285/5000 [6:29:58<53:58,  4.53s/it]
 86%|████████▌ | 4286/5000 [6:30:02<51:26,  4.32s/it]
 86%|████████▌ | 4287/5000 [6:30:06<49:29,  4.16s/it]
 86%|████████▌ | 4288/5000 [6:30:10<48:22,  4.08s/it]
 86%|████████▌ | 4289/5000 [6:30:15<51:01,  4.31s/it]
 86%|████████▌ | 4290/5000 [6:30:20<53:10,  4.49s/it]
 86%|████████▌ | 4291/5000 [6:30:26<58:10,  4.92s/it]
 86%|████████▌ | 4292/5000 [6:30:30<57:04,  4.84s/it]
 86%|████████▌ | 4293/5000 [6:30:35<55:22,  4.70s/it]
 86%|████████▌ | 4294/5000 [6:30:40<56:31,  4.80s/it]
 86%|████████▌ | 4295/5000 [6:30:45<57:40,  4.91s/it]
 86%|████████▌ | 4296/5000 [6:30:51<1:00:26,  5.15s/it]
 86%|████████▌ | 4297/5000 [6:30:54<55:53,  4.77s/it]  
 86%|████████▌ | 4298/5000 [6:30:58<52:41,  4.50s/it]
 86%|████████▌ | 4299/5000 [6:31:04<56:06,  4.80s/it]
 86%|████████▌ | 4300/5000 [6:31:08<52:50,  4.53s/it]
                                                     
 86%|████████▌ | 4300/5000 [6:31:08<52:50,  4.53s/it]
 86%|████████▌ | 4301/5000 [6:31:13<54:51,  4.71s/it]
 86%|████████▌ | 4302/5000 [6:31:17<52:28,  4.51s/it]
 86%|████████▌ | 4303/5000 [6:31:22<56:08,  4.83s/it]
 86%|████████▌ | 4304/5000 [6:31:27<55:01,  4.74s/it]
 86%|████████▌ | 4305/5000 [6:31:31<52:35,  4.54s/it]
 86%|████████▌ | 4306/5000 [6:31:36<53:25,  4.62s/it]
 86%|████████▌ | 4307/5000 [6:31:42<57:59,  5.02s/it]
 86%|████████▌ | 4308/5000 [6:31:47<58:25,  5.07s/it]
 86%|████████▌ | 4309/5000 [6:31:52<57:40,  5.01s/it]
 86%|████████▌ | 4310/5000 [6:31:56<53:40,  4.67s/it]
 86%|████████▌ | 4311/5000 [6:32:00<50:47,  4.42s/it]
 86%|████████▌ | 4312/5000 [6:32:03<48:32,  4.23s/it]
 86%|████████▋ | 4313/5000 [6:32:07<46:55,  4.10s/it]
 86%|████████▋ | 4314/5000 [6:32:12<49:14,  4.31s/it]
 86%|████████▋ | 4315/5000 [6:32:17<50:07,  4.39s/it]
 86%|████████▋ | 4316/5000 [6:32:22<52:54,  4.64s/it]
 86%|████████▋ | 4317/5000 [6:32:26<50:09,  4.41s/it]
 86%|████████▋ | 4318/5000 [6:32:30<48:23,  4.26s/it]
 86%|████████▋ | 4319/5000 [6:32:34<47:43,  4.21s/it]
 86%|████████▋ | 4320/5000 [6:32:38<48:24,  4.27s/it]
 86%|████████▋ | 4321/5000 [6:32:42<47:00,  4.15s/it]
 86%|████████▋ | 4322/5000 [6:32:48<54:04,  4.79s/it]
 86%|████████▋ | 4323/5000 [6:32:52<50:51,  4.51s/it]
 86%|████████▋ | 4324/5000 [6:32:58<54:28,  4.83s/it]
 86%|████████▋ | 4325/5000 [6:33:01<50:59,  4.53s/it]
                                                     
 86%|████████▋ | 4325/5000 [6:33:01<50:59,  4.53s/it]
 87%|████████▋ | 4326/5000 [6:33:05<48:35,  4.33s/it]
 87%|████████▋ | 4327/5000 [6:33:09<46:55,  4.18s/it]
 87%|████████▋ | 4328/5000 [6:33:13<45:38,  4.08s/it]
 87%|████████▋ | 4329/5000 [6:33:17<44:45,  4.00s/it]
 87%|████████▋ | 4330/5000 [6:33:21<44:07,  3.95s/it]
 87%|████████▋ | 4331/5000 [6:33:26<47:33,  4.27s/it]
 87%|████████▋ | 4332/5000 [6:33:30<48:23,  4.35s/it]
 87%|████████▋ | 4333/5000 [6:33:34<46:41,  4.20s/it]
 87%|████████▋ | 4334/5000 [6:33:38<45:28,  4.10s/it]
 87%|████████▋ | 4335/5000 [6:33:43<48:20,  4.36s/it]
 87%|████████▋ | 4336/5000 [6:33:48<50:29,  4.56s/it]
 87%|████████▋ | 4337/5000 [6:33:53<52:16,  4.73s/it]
 87%|████████▋ | 4338/5000 [6:33:58<53:09,  4.82s/it]
 87%|████████▋ | 4339/5000 [6:34:03<51:53,  4.71s/it]
 87%|████████▋ | 4340/5000 [6:34:09<57:37,  5.24s/it]
 87%|████████▋ | 4341/5000 [6:34:13<54:01,  4.92s/it]
 87%|████████▋ | 4342/5000 [6:34:17<50:33,  4.61s/it]
 87%|████████▋ | 4343/5000 [6:34:21<48:00,  4.39s/it]
 87%|████████▋ | 4344/5000 [6:34:25<48:28,  4.43s/it]
 87%|████████▋ | 4345/5000 [6:34:29<46:30,  4.26s/it]
 87%|████████▋ | 4346/5000 [6:34:34<48:55,  4.49s/it]
 87%|████████▋ | 4347/5000 [6:34:38<46:52,  4.31s/it]
 87%|████████▋ | 4348/5000 [6:34:42<45:27,  4.18s/it]
 87%|████████▋ | 4349/5000 [6:34:48<50:29,  4.65s/it]
 87%|████████▋ | 4350/5000 [6:34:53<51:58,  4.80s/it]
                                                     
 87%|████████▋ | 4350/5000 [6:34:53<51:58,  4.80s/it]
 87%|████████▋ | 4351/5000 [6:34:58<52:21,  4.84s/it]
 87%|████████▋ | 4352/5000 [6:35:02<49:11,  4.56s/it]
 87%|████████▋ | 4353/5000 [6:35:07<51:59,  4.82s/it]
 87%|████████▋ | 4354/5000 [6:35:11<49:11,  4.57s/it]
 87%|████████▋ | 4355/5000 [6:35:15<46:57,  4.37s/it]
 87%|████████▋ | 4356/5000 [6:35:20<48:06,  4.48s/it]
 87%|████████▋ | 4357/5000 [6:35:24<46:11,  4.31s/it]
 87%|████████▋ | 4358/5000 [6:35:28<44:50,  4.19s/it]
 87%|████████▋ | 4359/5000 [6:35:32<43:55,  4.11s/it]
 87%|████████▋ | 4360/5000 [6:35:37<48:38,  4.56s/it]
 87%|████████▋ | 4361/5000 [6:35:42<49:23,  4.64s/it]
 87%|████████▋ | 4362/5000 [6:35:47<49:06,  4.62s/it]
 87%|████████▋ | 4363/5000 [6:35:53<53:09,  5.01s/it]
 87%|████████▋ | 4364/5000 [6:35:57<50:53,  4.80s/it]
 87%|████████▋ | 4365/5000 [6:36:01<48:03,  4.54s/it]
 87%|████████▋ | 4366/5000 [6:36:05<45:59,  4.35s/it]
 87%|████████▋ | 4367/5000 [6:36:09<47:03,  4.46s/it]
 87%|████████▋ | 4368/5000 [6:36:13<45:13,  4.29s/it]
 87%|████████▋ | 4369/5000 [6:36:17<44:28,  4.23s/it]
 87%|████████▋ | 4370/5000 [6:36:22<46:23,  4.42s/it]
 87%|████████▋ | 4371/5000 [6:36:26<44:29,  4.24s/it]
 87%|████████▋ | 4372/5000 [6:36:30<43:11,  4.13s/it]
 87%|████████▋ | 4373/5000 [6:36:34<42:22,  4.05s/it]
 87%|████████▋ | 4374/5000 [6:36:39<44:26,  4.26s/it]
 88%|████████▊ | 4375/5000 [6:36:43<43:28,  4.17s/it]
                                                     
 88%|████████▊ | 4375/5000 [6:36:43<43:28,  4.17s/it]
 88%|████████▊ | 4376/5000 [6:36:46<42:35,  4.10s/it]
 88%|████████▊ | 4377/5000 [6:36:50<41:50,  4.03s/it]
 88%|████████▊ | 4378/5000 [6:36:55<44:28,  4.29s/it]
 88%|████████▊ | 4379/5000 [6:37:00<45:25,  4.39s/it]
 88%|████████▊ | 4380/5000 [6:37:06<49:29,  4.79s/it]
 88%|████████▊ | 4381/5000 [6:37:11<50:06,  4.86s/it]
 88%|████████▊ | 4382/5000 [6:37:16<51:06,  4.96s/it]
 88%|████████▊ | 4383/5000 [6:37:21<51:43,  5.03s/it]
 88%|████████▊ | 4384/5000 [6:37:25<48:26,  4.72s/it]
 88%|████████▊ | 4385/5000 [6:37:30<49:04,  4.79s/it]
 88%|████████▊ | 4386/5000 [6:37:34<47:48,  4.67s/it]
 88%|████████▊ | 4387/5000 [6:37:38<45:17,  4.43s/it]
 88%|████████▊ | 4388/5000 [6:37:43<46:44,  4.58s/it]
 88%|████████▊ | 4389/5000 [6:37:47<44:26,  4.36s/it]
 88%|████████▊ | 4390/5000 [6:37:51<42:51,  4.21s/it]
 88%|████████▊ | 4391/5000 [6:37:55<41:42,  4.11s/it]
 88%|████████▊ | 4392/5000 [6:37:59<42:50,  4.23s/it]
 88%|████████▊ | 4393/5000 [6:38:04<44:36,  4.41s/it]
 88%|████████▊ | 4394/5000 [6:38:08<42:57,  4.25s/it]
 88%|████████▊ | 4395/5000 [6:38:12<43:42,  4.34s/it]
 88%|████████▊ | 4396/5000 [6:38:16<42:03,  4.18s/it]
 88%|████████▊ | 4397/5000 [6:38:20<41:28,  4.13s/it]
 88%|████████▊ | 4398/5000 [6:38:25<43:30,  4.34s/it]
 88%|████████▊ | 4399/5000 [6:38:29<41:58,  4.19s/it]
 88%|████████▊ | 4400/5000 [6:38:33<40:55,  4.09s/it]
                                                     
 88%|████████▊ | 4400/5000 [6:38:33<40:55,  4.09s/it]
 88%|████████▊ | 4401/5000 [6:38:38<43:14,  4.33s/it]
 88%|████████▊ | 4402/5000 [6:38:43<44:52,  4.50s/it]
 88%|████████▊ | 4403/5000 [6:38:48<48:43,  4.90s/it]
 88%|████████▊ | 4404/5000 [6:38:54<49:36,  4.99s/it]
 88%|████████▊ | 4405/5000 [6:38:59<49:37,  5.00s/it]
 88%|████████▊ | 4406/5000 [6:39:03<48:08,  4.86s/it]
 88%|████████▊ | 4407/5000 [6:39:08<46:59,  4.75s/it]
 88%|████████▊ | 4408/5000 [6:39:12<44:40,  4.53s/it]
 88%|████████▊ | 4409/5000 [6:39:16<45:10,  4.59s/it]
 88%|████████▊ | 4410/5000 [6:39:21<45:07,  4.59s/it]
 88%|████████▊ | 4411/5000 [6:39:25<43:14,  4.40s/it]
 88%|████████▊ | 4412/5000 [6:39:29<41:26,  4.23s/it]
 88%|████████▊ | 4413/5000 [6:39:33<40:12,  4.11s/it]
 88%|████████▊ | 4414/5000 [6:39:37<39:31,  4.05s/it]
 88%|████████▊ | 4415/5000 [6:39:42<42:32,  4.36s/it]
 88%|████████▊ | 4416/5000 [6:39:48<47:28,  4.88s/it]
 88%|████████▊ | 4417/5000 [6:39:52<44:37,  4.59s/it]
 88%|████████▊ | 4418/5000 [6:39:57<46:25,  4.79s/it]
 88%|████████▊ | 4419/5000 [6:40:01<43:53,  4.53s/it]
 88%|████████▊ | 4420/5000 [6:40:05<41:54,  4.33s/it]
 88%|████████▊ | 4421/5000 [6:40:09<40:32,  4.20s/it]
 88%|████████▊ | 4422/5000 [6:40:13<40:17,  4.18s/it]
 88%|████████▊ | 4423/5000 [6:40:17<39:16,  4.08s/it]
 88%|████████▊ | 4424/5000 [6:40:20<38:34,  4.02s/it]
 88%|████████▊ | 4425/5000 [6:40:26<43:35,  4.55s/it]
                                                     
 88%|████████▊ | 4425/5000 [6:40:26<43:35,  4.55s/it]
 89%|████████▊ | 4426/5000 [6:40:32<47:11,  4.93s/it]
 89%|████████▊ | 4427/5000 [6:40:36<45:14,  4.74s/it]
 89%|████████▊ | 4428/5000 [6:40:41<44:53,  4.71s/it]
 89%|████████▊ | 4429/5000 [6:40:45<42:36,  4.48s/it]
 89%|████████▊ | 4430/5000 [6:40:49<40:43,  4.29s/it]
 89%|████████▊ | 4431/5000 [6:40:53<39:26,  4.16s/it]
 89%|████████▊ | 4432/5000 [6:40:57<41:08,  4.35s/it]
 89%|████████▊ | 4433/5000 [6:41:02<41:27,  4.39s/it]
 89%|████████▊ | 4434/5000 [6:41:06<41:31,  4.40s/it]
 89%|████████▊ | 4435/5000 [6:41:12<43:53,  4.66s/it]
 89%|████████▊ | 4436/5000 [6:41:17<44:34,  4.74s/it]
 89%|████████▊ | 4437/5000 [6:41:21<44:57,  4.79s/it]
 89%|████████▉ | 4438/5000 [6:41:26<42:56,  4.58s/it]
 89%|████████▉ | 4439/5000 [6:41:29<40:46,  4.36s/it]
 89%|████████▉ | 4440/5000 [6:41:34<42:43,  4.58s/it]
 89%|████████▉ | 4441/5000 [6:41:39<42:49,  4.60s/it]
 89%|████████▉ | 4442/5000 [6:41:44<43:52,  4.72s/it]
 89%|████████▉ | 4443/5000 [6:41:49<42:57,  4.63s/it]
 89%|████████▉ | 4444/5000 [6:41:54<44:30,  4.80s/it]
 89%|████████▉ | 4445/5000 [6:41:58<42:37,  4.61s/it]
 89%|████████▉ | 4446/5000 [6:42:02<41:58,  4.55s/it]
 89%|████████▉ | 4447/5000 [6:42:08<45:05,  4.89s/it]
 89%|████████▉ | 4448/5000 [6:42:13<46:29,  5.05s/it]
 89%|████████▉ | 4449/5000 [6:42:17<43:19,  4.72s/it]
 89%|████████▉ | 4450/5000 [6:42:22<43:48,  4.78s/it]
                                                     
 89%|████████▉ | 4450/5000 [6:42:22<43:48,  4.78s/it]
 89%|████████▉ | 4451/5000 [6:42:27<44:04,  4.82s/it]
 89%|████████▉ | 4452/5000 [6:42:31<42:08,  4.61s/it]
 89%|████████▉ | 4453/5000 [6:42:35<40:17,  4.42s/it]
 89%|████████▉ | 4454/5000 [6:42:41<42:32,  4.68s/it]
 89%|████████▉ | 4455/5000 [6:42:45<40:26,  4.45s/it]
 89%|████████▉ | 4456/5000 [6:42:49<40:29,  4.47s/it]
 89%|████████▉ | 4457/5000 [6:42:54<40:37,  4.49s/it]
 89%|████████▉ | 4458/5000 [6:42:57<39:00,  4.32s/it]
 89%|████████▉ | 4459/5000 [6:43:01<37:40,  4.18s/it]
 89%|████████▉ | 4460/5000 [6:43:06<38:14,  4.25s/it]
 89%|████████▉ | 4461/5000 [6:43:11<41:13,  4.59s/it]
 89%|████████▉ | 4462/5000 [6:43:15<39:15,  4.38s/it]
 89%|████████▉ | 4463/5000 [6:43:19<37:54,  4.24s/it]
 89%|████████▉ | 4464/5000 [6:43:24<40:23,  4.52s/it]
 89%|████████▉ | 4465/5000 [6:43:28<39:20,  4.41s/it]
 89%|████████▉ | 4466/5000 [6:43:32<37:44,  4.24s/it]
 89%|████████▉ | 4467/5000 [6:43:37<39:52,  4.49s/it]
 89%|████████▉ | 4468/5000 [6:43:43<43:10,  4.87s/it]
 89%|████████▉ | 4469/5000 [6:43:48<43:42,  4.94s/it]
 89%|████████▉ | 4470/5000 [6:43:52<42:21,  4.80s/it]
 89%|████████▉ | 4471/5000 [6:43:57<41:21,  4.69s/it]
 89%|████████▉ | 4472/5000 [6:44:01<39:41,  4.51s/it]
 89%|████████▉ | 4473/5000 [6:44:05<38:00,  4.33s/it]
 89%|████████▉ | 4474/5000 [6:44:09<36:40,  4.18s/it]
 90%|████████▉ | 4475/5000 [6:44:15<41:41,  4.76s/it]
                                                     
 90%|████████▉ | 4475/5000 [6:44:15<41:41,  4.76s/it]
 90%|████████▉ | 4476/5000 [6:44:20<42:53,  4.91s/it]
 90%|████████▉ | 4477/5000 [6:44:24<40:42,  4.67s/it]
 90%|████████▉ | 4478/5000 [6:44:29<41:48,  4.81s/it]
 90%|████████▉ | 4479/5000 [6:44:33<39:54,  4.60s/it]
 90%|████████▉ | 4480/5000 [6:44:38<40:28,  4.67s/it]
 90%|████████▉ | 4481/5000 [6:44:42<38:25,  4.44s/it]
 90%|████████▉ | 4482/5000 [6:44:47<38:54,  4.51s/it]
 90%|████████▉ | 4483/5000 [6:44:51<37:13,  4.32s/it]
 90%|████████▉ | 4484/5000 [6:44:57<43:12,  5.02s/it]
 90%|████████▉ | 4485/5000 [6:45:02<43:07,  5.02s/it]
 90%|████████▉ | 4486/5000 [6:45:08<43:39,  5.10s/it]
 90%|████████▉ | 4487/5000 [6:45:12<42:03,  4.92s/it]
 90%|████████▉ | 4488/5000 [6:45:16<39:02,  4.58s/it]
 90%|████████▉ | 4489/5000 [6:45:20<37:16,  4.38s/it]
 90%|████████▉ | 4490/5000 [6:45:25<38:17,  4.51s/it]
 90%|████████▉ | 4491/5000 [6:45:29<36:38,  4.32s/it]
 90%|████████▉ | 4492/5000 [6:45:34<38:49,  4.59s/it]
 90%|████████▉ | 4493/5000 [6:45:38<38:26,  4.55s/it]
 90%|████████▉ | 4494/5000 [6:45:43<39:54,  4.73s/it]
 90%|████████▉ | 4495/5000 [6:45:48<39:37,  4.71s/it]
 90%|████████▉ | 4496/5000 [6:45:52<37:58,  4.52s/it]
 90%|████████▉ | 4497/5000 [6:45:57<37:29,  4.47s/it]
 90%|████████▉ | 4498/5000 [6:46:00<35:47,  4.28s/it]
 90%|████████▉ | 4499/5000 [6:46:05<37:16,  4.46s/it]
 90%|█████████ | 4500/5000 [6:46:10<37:28,  4.50s/it]
                                                     
 90%|█████████ | 4500/5000 [6:46:10<37:28,  4.50s/it]
 90%|█████████ | 4501/5000 [6:46:15<39:15,  4.72s/it]
 90%|█████████ | 4502/5000 [6:46:19<37:51,  4.56s/it]
 90%|█████████ | 4503/5000 [6:46:23<35:55,  4.34s/it]
 90%|█████████ | 4504/5000 [6:46:27<34:41,  4.20s/it]
 90%|█████████ | 4505/5000 [6:46:31<33:43,  4.09s/it]
 90%|█████████ | 4506/5000 [6:46:35<33:32,  4.07s/it]
 90%|█████████ | 4507/5000 [6:46:40<35:06,  4.27s/it]
 90%|█████████ | 4508/5000 [6:46:43<34:02,  4.15s/it]
 90%|█████████ | 4509/5000 [6:46:49<36:25,  4.45s/it]
 90%|█████████ | 4510/5000 [6:46:53<36:11,  4.43s/it]
 90%|█████████ | 4511/5000 [6:46:57<35:17,  4.33s/it]
 90%|█████████ | 4512/5000 [6:47:02<35:38,  4.38s/it]
 90%|█████████ | 4513/5000 [6:47:07<37:29,  4.62s/it]
 90%|█████████ | 4514/5000 [6:47:12<39:01,  4.82s/it]
 90%|█████████ | 4515/5000 [6:47:16<36:36,  4.53s/it]
 90%|█████████ | 4516/5000 [6:47:20<34:57,  4.33s/it]
 90%|█████████ | 4517/5000 [6:47:22<30:41,  3.81s/it]
 90%|█████████ | 4518/5000 [6:47:24<26:21,  3.28s/it]
 90%|█████████ | 4519/5000 [6:47:26<23:19,  2.91s/it]
 90%|█████████ | 4520/5000 [6:47:28<21:12,  2.65s/it]
 90%|█████████ | 4521/5000 [6:47:31<19:42,  2.47s/it]
 90%|█████████ | 4522/5000 [6:47:33<18:39,  2.34s/it]
 90%|█████████ | 4523/5000 [6:47:35<17:54,  2.25s/it]
 90%|█████████ | 4524/5000 [6:47:37<17:24,  2.19s/it]
 90%|█████████ | 4525/5000 [6:47:39<17:01,  2.15s/it]
                                                     
 90%|█████████ | 4525/5000 [6:47:39<17:01,  2.15s/it]
 91%|█████████ | 4526/5000 [6:47:41<16:44,  2.12s/it]
 91%|█████████ | 4527/5000 [6:47:43<16:32,  2.10s/it]
 91%|█████████ | 4528/5000 [6:47:45<16:23,  2.08s/it]
 91%|█████████ | 4529/5000 [6:47:47<16:16,  2.07s/it]
 91%|█████████ | 4530/5000 [6:47:49<16:12,  2.07s/it]
 91%|█████████ | 4531/5000 [6:47:51<16:08,  2.06s/it]
 91%|█████████ | 4532/5000 [6:47:53<15:46,  2.02s/it]{'loss': 0.0015, 'learning_rate': 1.9511111111111113e-06, 'epoch': 10.0}
+{'loss': 0.0016, 'learning_rate': 1.8955555555555557e-06, 'epoch': 10.01}
+{'loss': 0.0015, 'learning_rate': 1.8400000000000002e-06, 'epoch': 10.01}
+{'loss': 0.0015, 'learning_rate': 1.7844444444444444e-06, 'epoch': 10.02}
+{'loss': 0.0014, 'learning_rate': 1.728888888888889e-06, 'epoch': 10.02}
+{'loss': 0.0016, 'learning_rate': 1.6733333333333335e-06, 'epoch': 10.03}
+{'loss': 0.0015, 'learning_rate': 1.6177777777777778e-06, 'epoch': 10.03}
+{'loss': 0.0015, 'learning_rate': 1.5622222222222225e-06, 'epoch': 10.04}
+{'loss': 0.0016, 'learning_rate': 1.506666666666667e-06, 'epoch': 10.04}
+{'loss': 0.0015, 'learning_rate': 1.4511111111111112e-06, 'epoch': 10.05}
+{'loss': 0.0014, 'learning_rate': 1.3955555555555556e-06, 'epoch': 10.05}
+{'loss': 0.0014, 'learning_rate': 1.34e-06, 'epoch': 10.06}
+{'loss': 0.0013, 'learning_rate': 1.2844444444444445e-06, 'epoch': 10.06}
+{'loss': 0.0013, 'learning_rate': 1.228888888888889e-06, 'epoch': 10.07}
+{'loss': 0.0013, 'learning_rate': 1.1733333333333335e-06, 'epoch': 10.07}
+{'loss': 0.0013, 'learning_rate': 1.117777777777778e-06, 'epoch': 10.08}
+{'loss': 0.0013, 'learning_rate': 1.0622222222222222e-06, 'epoch': 10.08}
+
+
+
+
+
+
+
 91%|█████████ | 4533/5000 [6:48:42<2:04:25, 15.99s/it]
 91%|█████████ | 4534/5000 [6:48:46<1:37:03, 12.50s/it]
 91%|█████████ | 4535/5000 [6:48:50<1:16:45,  9.90s/it]
 91%|█████████ | 4536/5000 [6:48:55<1:05:40,  8.49s/it]
 91%|█████████ | 4537/5000 [6:49:00<56:30,  7.32s/it]  
 91%|█████████ | 4538/5000 [6:49:05<52:36,  6.83s/it]
 91%|█████████ | 4539/5000 [6:49:10<48:20,  6.29s/it]
 91%|█████████ | 4540/5000 [6:49:15<44:37,  5.82s/it]
 91%|█████████ | 4541/5000 [6:49:19<40:14,  5.26s/it]
 91%|█████████ | 4542/5000 [6:49:24<38:59,  5.11s/it]
 91%|█████████ | 4543/5000 [6:49:28<36:00,  4.73s/it]
 91%|█████████ | 4544/5000 [6:49:31<34:01,  4.48s/it]
 91%|█████████ | 4545/5000 [6:49:37<36:40,  4.84s/it]
 91%|█████████ | 4546/5000 [6:49:41<34:19,  4.54s/it]
 91%|█████████ | 4547/5000 [6:49:47<38:03,  5.04s/it]
 91%|█████████ | 4548/5000 [6:49:52<38:03,  5.05s/it]
 91%|█████████ | 4549/5000 [6:49:57<38:11,  5.08s/it]
 91%|█████████ | 4550/5000 [6:50:03<38:20,  5.11s/it]
                                                     
 91%|█████████ | 4550/5000 [6:50:03<38:20,  5.11s/it]
 91%|█████████ | 4551/5000 [6:50:08<38:28,  5.14s/it]
 91%|█████████ | 4552/5000 [6:50:13<38:39,  5.18s/it]
 91%|█████████ | 4553/5000 [6:50:17<35:34,  4.78s/it]
 91%|█████████ | 4554/5000 [6:50:23<37:31,  5.05s/it]
 91%|█████████ | 4555/5000 [6:50:28<38:33,  5.20s/it]
 91%|█████████ | 4556/5000 [6:50:32<35:29,  4.80s/it]
 91%|█████████ | 4557/5000 [6:50:36<34:13,  4.63s/it]
 91%|█████████ | 4558/5000 [6:50:40<32:11,  4.37s/it]
 91%|█████████ | 4559/5000 [6:50:44<30:59,  4.22s/it]
 91%|█████████ | 4560/5000 [6:50:48<30:02,  4.10s/it]
 91%|█████████ | 4561/5000 [6:50:52<29:48,  4.08s/it]
 91%|█████████ | 4562/5000 [6:50:58<33:46,  4.63s/it]
 91%|█████████▏| 4563/5000 [6:51:02<32:26,  4.45s/it]
 91%|█████████▏| 4564/5000 [6:51:07<34:55,  4.81s/it]
 91%|█████████▏| 4565/5000 [6:51:11<33:36,  4.63s/it]
 91%|█████████▏| 4566/5000 [6:51:15<31:58,  4.42s/it]
 91%|█████████▏| 4567/5000 [6:51:19<30:39,  4.25s/it]
 91%|█████████▏| 4568/5000 [6:51:24<30:44,  4.27s/it]
 91%|█████████▏| 4569/5000 [6:51:29<32:14,  4.49s/it]
 91%|█████████▏| 4570/5000 [6:51:33<31:01,  4.33s/it]
 91%|█████████▏| 4571/5000 [6:51:37<31:22,  4.39s/it]
 91%|█████████▏| 4572/5000 [6:51:42<31:38,  4.44s/it]
 91%|█████████▏| 4573/5000 [6:51:47<33:08,  4.66s/it]
 91%|█████████▏| 4574/5000 [6:51:52<33:56,  4.78s/it]
 92%|█████████▏| 4575/5000 [6:51:56<31:59,  4.52s/it]
                                                     
 92%|█████████▏| 4575/5000 [6:51:56<31:59,  4.52s/it]
 92%|█████████▏| 4576/5000 [6:52:00<32:15,  4.57s/it]
 92%|█████████▏| 4577/5000 [6:52:04<30:44,  4.36s/it]
 92%|█████████▏| 4578/5000 [6:52:09<32:17,  4.59s/it]
 92%|█████████▏| 4579/5000 [6:52:13<30:48,  4.39s/it]
 92%|█████████▏| 4580/5000 [6:52:18<31:34,  4.51s/it]
 92%|█████████▏| 4581/5000 [6:52:22<30:09,  4.32s/it]
 92%|█████████▏| 4582/5000 [6:52:26<29:03,  4.17s/it]
 92%|█████████▏| 4583/5000 [6:52:31<30:52,  4.44s/it]
 92%|█████████▏| 4584/5000 [6:52:35<30:52,  4.45s/it]
 92%|█████████▏| 4585/5000 [6:52:40<30:21,  4.39s/it]
 92%|█████████▏| 4586/5000 [6:52:43<29:06,  4.22s/it]
 92%|█████████▏| 4587/5000 [6:52:47<28:31,  4.14s/it]
 92%|█████████▏| 4588/5000 [6:52:53<32:02,  4.67s/it]
 92%|█████████▏| 4589/5000 [6:52:58<32:57,  4.81s/it]
 92%|█████████▏| 4590/5000 [6:53:04<33:58,  4.97s/it]
 92%|█████████▏| 4591/5000 [6:53:08<31:38,  4.64s/it]
 92%|█████████▏| 4592/5000 [6:53:12<30:06,  4.43s/it]
 92%|█████████▏| 4593/5000 [6:53:15<28:57,  4.27s/it]
 92%|█████████▏| 4594/5000 [6:53:20<28:20,  4.19s/it]
 92%|█████████▏| 4595/5000 [6:53:26<32:15,  4.78s/it]
 92%|█████████▏| 4596/5000 [6:53:30<30:20,  4.51s/it]
 92%|█████████▏| 4597/5000 [6:53:35<32:24,  4.82s/it]
 92%|█████████▏| 4598/5000 [6:53:40<31:37,  4.72s/it]
 92%|█████████▏| 4599/5000 [6:53:44<29:59,  4.49s/it]
 92%|█████████▏| 4600/5000 [6:53:47<28:52,  4.33s/it]
                                                     
 92%|█████████▏| 4600/5000 [6:53:47<28:52,  4.33s/it]
 92%|█████████▏| 4601/5000 [6:53:53<31:56,  4.80s/it]
 92%|█████████▏| 4602/5000 [6:53:58<31:47,  4.79s/it]
 92%|█████████▏| 4603/5000 [6:54:02<30:46,  4.65s/it]
 92%|█████████▏| 4604/5000 [6:54:09<33:40,  5.10s/it]
 92%|█████████▏| 4605/5000 [6:54:13<32:09,  4.89s/it]
 92%|█████████▏| 4606/5000 [6:54:17<30:25,  4.63s/it]
 92%|█████████▏| 4607/5000 [6:54:22<31:37,  4.83s/it]
 92%|█████████▏| 4608/5000 [6:54:29<35:34,  5.44s/it]
 92%|█████████▏| 4609/5000 [6:54:34<34:54,  5.36s/it]
 92%|█████████▏| 4610/5000 [6:54:39<33:13,  5.11s/it]
 92%|█████████▏| 4611/5000 [6:54:45<34:13,  5.28s/it]
 92%|█████████▏| 4612/5000 [6:54:49<32:45,  5.06s/it]
 92%|█████████▏| 4613/5000 [6:54:53<31:16,  4.85s/it]
 92%|█████████▏| 4614/5000 [6:54:59<31:57,  4.97s/it]
 92%|█████████▏| 4615/5000 [6:55:08<39:21,  6.13s/it]
 92%|█████████▏| 4616/5000 [6:55:13<37:32,  5.87s/it]
 92%|█████████▏| 4617/5000 [6:55:17<34:36,  5.42s/it]
 92%|█████████▏| 4618/5000 [6:55:23<34:35,  5.43s/it]
 92%|█████████▏| 4619/5000 [6:55:27<31:28,  4.96s/it]
 92%|█████████▏| 4620/5000 [6:55:30<29:21,  4.64s/it]
 92%|█████████▏| 4621/5000 [6:55:34<27:51,  4.41s/it]
 92%|█████████▏| 4622/5000 [6:55:39<29:02,  4.61s/it]
 92%|█████████▏| 4623/5000 [6:55:44<28:52,  4.60s/it]
 92%|█████████▏| 4624/5000 [6:55:48<27:21,  4.36s/it]
 92%|█████████▎| 4625/5000 [6:55:53<28:12,  4.51s/it]
                                                     
 92%|█████████▎| 4625/5000 [6:55:53<28:12,  4.51s/it]
 93%|█████████▎| 4626/5000 [6:55:58<29:25,  4.72s/it]
 93%|█████████▎| 4627/5000 [6:56:03<30:13,  4.86s/it]
 93%|█████████▎| 4628/5000 [6:56:08<30:37,  4.94s/it]
 93%|█████████▎| 4629/5000 [6:56:12<29:05,  4.71s/it]
 93%|█████████▎| 4630/5000 [6:56:17<28:40,  4.65s/it]
 93%|█████████▎| 4631/5000 [6:56:22<28:49,  4.69s/it]
 93%|█████████▎| 4632/5000 [6:56:26<28:21,  4.62s/it]
 93%|█████████▎| 4633/5000 [6:56:30<26:50,  4.39s/it]
 93%|█████████▎| 4634/5000 [6:56:34<25:45,  4.22s/it]
 93%|█████████▎| 4635/5000 [6:56:38<25:15,  4.15s/it]
 93%|█████████▎| 4636/5000 [6:56:42<24:38,  4.06s/it]
 93%|█████████▎| 4637/5000 [6:56:45<24:10,  4.00s/it]
 93%|█████████▎| 4638/5000 [6:56:50<25:19,  4.20s/it]
 93%|█████████▎| 4639/5000 [6:56:54<24:38,  4.10s/it]
 93%|█████████▎| 4640/5000 [6:56:58<24:05,  4.02s/it]
 93%|█████████▎| 4641/5000 [6:57:02<24:15,  4.05s/it]
 93%|█████████▎| 4642/5000 [6:57:07<25:40,  4.30s/it]
 93%|█████████▎| 4643/5000 [6:57:11<24:45,  4.16s/it]
 93%|█████████▎| 4644/5000 [6:57:14<24:09,  4.07s/it]
 93%|█████████▎| 4645/5000 [6:57:20<26:38,  4.50s/it]
 93%|█████████▎| 4646/5000 [6:57:24<25:28,  4.32s/it]
 93%|█████████▎| 4647/5000 [6:57:28<24:41,  4.20s/it]
 93%|█████████▎| 4648/5000 [6:57:32<25:13,  4.30s/it]
 93%|█████████▎| 4649/5000 [6:57:37<25:52,  4.42s/it]
 93%|█████████▎| 4650/5000 [6:57:42<26:02,  4.46s/it]
                                                     
 93%|█████████▎| 4650/5000 [6:57:42<26:02,  4.46s/it]
 93%|█████████▎| 4651/5000 [6:57:46<25:24,  4.37s/it]
 93%|█████████▎| 4652/5000 [6:57:51<26:15,  4.53s/it]
 93%|█████████▎| 4653/5000 [6:57:55<26:07,  4.52s/it]
 93%|█████████▎| 4654/5000 [6:57:59<25:10,  4.37s/it]
 93%|█████████▎| 4655/5000 [6:58:03<24:27,  4.25s/it]
 93%|█████████▎| 4656/5000 [6:58:07<23:43,  4.14s/it]
 93%|█████████▎| 4657/5000 [6:58:11<23:07,  4.05s/it]
 93%|█████████▎| 4658/5000 [6:58:16<24:15,  4.26s/it]
 93%|█████████▎| 4659/5000 [6:58:21<25:28,  4.48s/it]
 93%|█████████▎| 4660/5000 [6:58:24<24:18,  4.29s/it]
 93%|█████████▎| 4661/5000 [6:58:29<24:32,  4.34s/it]
 93%|█████████▎| 4662/5000 [6:58:33<23:39,  4.20s/it]
 93%|█████████▎| 4663/5000 [6:58:38<24:30,  4.36s/it]
 93%|█████████▎| 4664/5000 [6:58:42<24:44,  4.42s/it]
 93%|█████████▎| 4665/5000 [6:58:47<25:58,  4.65s/it]
 93%|█████████▎| 4666/5000 [6:58:52<26:33,  4.77s/it]
 93%|█████████▎| 4667/5000 [6:58:57<26:31,  4.78s/it]
 93%|█████████▎| 4668/5000 [6:59:02<25:55,  4.69s/it]
 93%|█████████▎| 4669/5000 [6:59:07<27:15,  4.94s/it]
 93%|█████████▎| 4670/5000 [6:59:12<27:30,  5.00s/it]
 93%|█████████▎| 4671/5000 [6:59:17<26:47,  4.88s/it]
 93%|█████████▎| 4672/5000 [6:59:22<26:33,  4.86s/it]
 93%|█████████▎| 4673/5000 [6:59:26<26:14,  4.81s/it]
 93%|█████████▎| 4674/5000 [6:59:31<25:59,  4.78s/it]
 94%|█████████▎| 4675/5000 [6:59:35<24:19,  4.49s/it]
                                                     
 94%|█████████▎| 4675/5000 [6:59:35<24:19,  4.49s/it]
 94%|█████████▎| 4676/5000 [6:59:39<23:39,  4.38s/it]
 94%|█████████▎| 4677/5000 [6:59:44<24:04,  4.47s/it]
 94%|█████████▎| 4678/5000 [6:59:48<23:19,  4.34s/it]
 94%|█████████▎| 4679/5000 [6:59:52<22:36,  4.23s/it]
 94%|█████████▎| 4680/5000 [6:59:56<21:58,  4.12s/it]
 94%|█████████▎| 4681/5000 [7:00:01<23:18,  4.38s/it]
 94%|█████████▎| 4682/5000 [7:00:04<22:29,  4.24s/it]
 94%|█████████▎| 4683/5000 [7:00:08<21:51,  4.14s/it]
 94%|█████████▎| 4684/5000 [7:00:12<21:24,  4.07s/it]
 94%|█████████▎| 4685/5000 [7:00:17<22:25,  4.27s/it]
 94%|█████████▎| 4686/5000 [7:00:22<22:42,  4.34s/it]
 94%|█████████▎| 4687/5000 [7:00:27<24:52,  4.77s/it]
 94%|█████████▍| 4688/5000 [7:00:31<23:21,  4.49s/it]
 94%|█████████▍| 4689/5000 [7:00:35<22:16,  4.30s/it]
 94%|█████████▍| 4690/5000 [7:00:40<22:46,  4.41s/it]
 94%|█████████▍| 4691/5000 [7:00:45<23:48,  4.62s/it]
 94%|█████████▍| 4692/5000 [7:00:50<23:54,  4.66s/it]
 94%|█████████▍| 4693/5000 [7:00:55<25:04,  4.90s/it]
 94%|█████████▍| 4694/5000 [7:00:59<23:41,  4.65s/it]
 94%|█████████▍| 4695/5000 [7:01:03<22:25,  4.41s/it]
 94%|█████████▍| 4696/5000 [7:01:08<22:46,  4.49s/it]
 94%|█████████▍| 4697/5000 [7:01:11<21:41,  4.30s/it]
 94%|█████████▍| 4698/5000 [7:01:15<21:05,  4.19s/it]
 94%|█████████▍| 4699/5000 [7:01:20<21:19,  4.25s/it]
 94%|█████████▍| 4700/5000 [7:01:24<20:39,  4.13s/it]
                                                     
 94%|█████████▍| 4700/5000 [7:01:24<20:39,  4.13s/it]
 94%|█████████▍| 4701/5000 [7:01:29<22:59,  4.61s/it]
 94%|█████████▍| 4702/5000 [7:01:34<23:32,  4.74s/it]
 94%|█████████▍| 4703/5000 [7:01:40<24:36,  4.97s/it]
 94%|█████████▍| 4704/5000 [7:01:44<22:52,  4.64s/it]
 94%|█████████▍| 4705/5000 [7:01:48<21:39,  4.40s/it]
 94%|█████████▍| 4706/5000 [7:01:51<20:42,  4.23s/it]
 94%|█████████▍| 4707/5000 [7:01:57<22:10,  4.54s/it]
 94%|█████████▍| 4708/5000 [7:02:02<22:35,  4.64s/it]
 94%|█████████▍| 4709/5000 [7:02:05<21:22,  4.41s/it]
 94%|█████████▍| 4710/5000 [7:02:09<20:28,  4.24s/it]
 94%|█████████▍| 4711/5000 [7:02:14<21:04,  4.38s/it]
 94%|█████████▍| 4712/5000 [7:02:18<20:14,  4.22s/it]
 94%|█████████▍| 4713/5000 [7:02:22<19:38,  4.11s/it]
 94%|█████████▍| 4714/5000 [7:02:26<20:11,  4.24s/it]
 94%|█████████▍| 4715/5000 [7:02:32<22:52,  4.81s/it]
 94%|█████████▍| 4716/5000 [7:02:37<22:36,  4.78s/it]
 94%|█████████▍| 4717/5000 [7:02:42<22:53,  4.85s/it]
 94%|█████████▍| 4718/5000 [7:02:47<23:23,  4.98s/it]
 94%|█████████▍| 4719/5000 [7:02:53<24:03,  5.14s/it]
 94%|█████████▍| 4720/5000 [7:02:57<22:13,  4.76s/it]
 94%|█████████▍| 4721/5000 [7:03:01<22:01,  4.74s/it]
 94%|█████████▍| 4722/5000 [7:03:05<20:43,  4.47s/it]
 94%|█████████▍| 4723/5000 [7:03:10<20:50,  4.52s/it]
 94%|█████████▍| 4724/5000 [7:03:15<21:44,  4.73s/it]
 94%|█████████▍| 4725/5000 [7:03:20<21:22,  4.66s/it]
                                                     
 94%|█████████▍| 4725/5000 [7:03:20<21:22,  4.66s/it]
 95%|█████████▍| 4726/5000 [7:03:24<20:12,  4.42s/it]
 95%|█████████▍| 4727/5000 [7:03:27<19:29,  4.28s/it]
 95%|█████████▍| 4728/5000 [7:03:33<21:02,  4.64s/it]
 95%|█████████▍| 4729/5000 [7:03:38<21:38,  4.79s/it]
 95%|█████████▍| 4730/5000 [7:03:42<20:25,  4.54s/it]
 95%|█████████▍| 4731/5000 [7:03:46<19:38,  4.38s/it]
 95%|█████████▍| 4732/5000 [7:03:50<18:56,  4.24s/it]
 95%|█████████▍| 4733/5000 [7:03:55<19:27,  4.37s/it]
 95%|█████████▍| 4734/5000 [7:04:00<20:06,  4.54s/it]
 95%|█████████▍| 4735/5000 [7:04:04<20:25,  4.62s/it]
 95%|█████████▍| 4736/5000 [7:04:09<20:57,  4.76s/it]
 95%|█████████▍| 4737/5000 [7:04:13<19:34,  4.47s/it]
 95%|█████████▍| 4738/5000 [7:04:17<18:37,  4.27s/it]
 95%|█████████▍| 4739/5000 [7:04:21<17:57,  4.13s/it]
 95%|█████████▍| 4740/5000 [7:04:25<17:57,  4.15s/it]
 95%|█████████▍| 4741/5000 [7:04:29<17:31,  4.06s/it]
 95%|█████████▍| 4742/5000 [7:04:33<17:24,  4.05s/it]
 95%|█████████▍| 4743/5000 [7:04:38<19:15,  4.50s/it]
 95%|█████████▍| 4744/5000 [7:04:43<19:47,  4.64s/it]
 95%|█████████▍| 4745/5000 [7:04:48<19:16,  4.54s/it]
 95%|█████████▍| 4746/5000 [7:04:52<18:16,  4.32s/it]
 95%|█████████▍| 4747/5000 [7:04:56<18:43,  4.44s/it]
 95%|█████████▍| 4748/5000 [7:05:01<19:30,  4.65s/it]
 95%|█████████▍| 4749/5000 [7:05:07<20:07,  4.81s/it]
 95%|█████████▌| 4750/5000 [7:05:11<19:03,  4.58s/it]
                                                     
 95%|█████████▌| 4750/5000 [7:05:11<19:03,  4.58s/it]
 95%|█████████▌| 4751/5000 [7:05:15<18:14,  4.40s/it]
 95%|█████████▌| 4752/5000 [7:05:20<19:13,  4.65s/it]
 95%|█████████▌| 4753/5000 [7:05:24<18:07,  4.40s/it]
 95%|█████████▌| 4754/5000 [7:05:28<17:39,  4.31s/it]
 95%|█████████▌| 4755/5000 [7:05:32<17:55,  4.39s/it]
 95%|█████████▌| 4756/5000 [7:05:37<18:39,  4.59s/it]
 95%|█████████▌| 4757/5000 [7:05:42<19:04,  4.71s/it]
 95%|█████████▌| 4758/5000 [7:05:48<20:36,  5.11s/it]
 95%|█████████▌| 4759/5000 [7:05:52<19:11,  4.78s/it]
 95%|█████████▌| 4760/5000 [7:05:56<18:01,  4.51s/it]
 95%|█████████▌| 4761/5000 [7:06:01<18:17,  4.59s/it]
 95%|█████████▌| 4762/5000 [7:06:06<18:22,  4.63s/it]
 95%|█████████▌| 4763/5000 [7:06:10<17:55,  4.54s/it]
 95%|█████████▌| 4764/5000 [7:06:14<17:02,  4.33s/it]
 95%|█████████▌| 4765/5000 [7:06:19<17:27,  4.46s/it]
 95%|█████████▌| 4766/5000 [7:06:23<17:05,  4.38s/it]
 95%|█████████▌| 4767/5000 [7:06:27<16:25,  4.23s/it]
 95%|█████████▌| 4768/5000 [7:06:32<17:05,  4.42s/it]
 95%|█████████▌| 4769/5000 [7:06:37<17:57,  4.66s/it]
 95%|█████████▌| 4770/5000 [7:06:41<17:03,  4.45s/it]
 95%|█████████▌| 4771/5000 [7:06:45<16:25,  4.30s/it]
 95%|█████████▌| 4772/5000 [7:06:50<17:49,  4.69s/it]
 95%|█████████▌| 4773/5000 [7:06:55<18:08,  4.80s/it]
 95%|█████████▌| 4774/5000 [7:07:01<18:30,  4.91s/it]
 96%|█████████▌| 4775/5000 [7:07:06<19:06,  5.10s/it]
                                                     
 96%|█████████▌| 4775/5000 [7:07:06<19:06,  5.10s/it]
 96%|█████████▌| 4776/5000 [7:07:10<17:43,  4.75s/it]
 96%|█████████▌| 4777/5000 [7:07:14<16:43,  4.50s/it]
 96%|█████████▌| 4778/5000 [7:07:18<15:58,  4.32s/it]
 96%|█████████▌| 4779/5000 [7:07:23<16:54,  4.59s/it]
 96%|█████████▌| 4780/5000 [7:07:28<17:37,  4.81s/it]
 96%|█████████▌| 4781/5000 [7:07:34<17:59,  4.93s/it]
 96%|█████████▌| 4782/5000 [7:07:39<18:31,  5.10s/it]
 96%|█████████▌| 4783/5000 [7:07:44<18:32,  5.13s/it]
 96%|█████████▌| 4784/5000 [7:07:50<18:29,  5.13s/it]
 96%|█████████▌| 4785/5000 [7:07:55<18:24,  5.14s/it]
 96%|█████████▌| 4786/5000 [7:08:00<18:23,  5.16s/it]
 96%|█████████▌| 4787/5000 [7:08:04<16:53,  4.76s/it]
 96%|█████████▌| 4788/5000 [7:08:08<16:49,  4.76s/it]
 96%|█████████▌| 4789/5000 [7:08:13<16:42,  4.75s/it]
 96%|█████████▌| 4790/5000 [7:08:18<16:30,  4.72s/it]
 96%|█████████▌| 4791/5000 [7:08:22<15:32,  4.46s/it]
 96%|█████████▌| 4792/5000 [7:08:26<15:27,  4.46s/it]
 96%|█████████▌| 4793/5000 [7:08:30<14:45,  4.28s/it]
 96%|█████████▌| 4794/5000 [7:08:34<14:50,  4.32s/it]
 96%|█████████▌| 4795/5000 [7:08:40<15:36,  4.57s/it]
 96%|█████████▌| 4796/5000 [7:08:45<16:10,  4.76s/it]
 96%|█████████▌| 4797/5000 [7:08:49<16:04,  4.75s/it]
 96%|█████████▌| 4798/5000 [7:08:54<15:17,  4.54s/it]
 96%|█████████▌| 4799/5000 [7:08:57<14:29,  4.33s/it]
 96%|█████████▌| 4800/5000 [7:09:02<14:49,  4.45s/it]
                                                     
 96%|█████████▌| 4800/5000 [7:09:02<14:49,  4.45s/it]
 96%|█████████▌| 4801/5000 [7:09:06<14:09,  4.27s/it]
 96%|█████████▌| 4802/5000 [7:09:10<13:43,  4.16s/it]
 96%|█████████▌| 4803/5000 [7:09:15<14:34,  4.44s/it]
 96%|█████████▌| 4804/5000 [7:09:19<14:27,  4.43s/it]
 96%|█████████▌| 4805/5000 [7:09:25<16:03,  4.94s/it]
 96%|█████████▌| 4806/5000 [7:09:31<16:04,  4.97s/it]
 96%|█████████▌| 4807/5000 [7:09:36<16:50,  5.24s/it]
 96%|█████████▌| 4808/5000 [7:09:41<16:00,  5.00s/it]
 96%|█████████▌| 4809/5000 [7:09:45<14:55,  4.69s/it]
 96%|█████████▌| 4810/5000 [7:09:49<14:04,  4.45s/it]
 96%|█████████▌| 4811/5000 [7:09:53<13:29,  4.28s/it]
 96%|█████████▌| 4812/5000 [7:09:58<14:17,  4.56s/it]
 96%|█████████▋| 4813/5000 [7:10:03<14:47,  4.74s/it]
 96%|█████████▋| 4814/5000 [7:10:07<14:05,  4.54s/it]
 96%|█████████▋| 4815/5000 [7:10:12<14:02,  4.56s/it]
 96%|█████████▋| 4816/5000 [7:10:15<13:20,  4.35s/it]
 96%|█████████▋| 4817/5000 [7:10:19<12:50,  4.21s/it]
 96%|█████��███▋| 4818/5000 [7:10:24<13:09,  4.34s/it]
 96%|█████████▋| 4819/5000 [7:10:28<12:39,  4.20s/it]
 96%|█████████▋| 4820/5000 [7:10:32<12:17,  4.10s/it]
 96%|█████████▋| 4821/5000 [7:10:36<12:46,  4.28s/it]
 96%|█████████▋| 4822/5000 [7:10:41<12:58,  4.37s/it]
 96%|█████████▋| 4823/5000 [7:10:46<13:31,  4.58s/it]
 96%|█████████▋| 4824/5000 [7:10:51<13:58,  4.76s/it]
 96%|█████████▋| 4825/5000 [7:10:56<13:53,  4.76s/it]
                                                     
 96%|█████████▋| 4825/5000 [7:10:56<13:53,  4.76s/it]
 97%|█████████▋| 4826/5000 [7:11:01<14:11,  4.89s/it]
 97%|█████████▋| 4827/5000 [7:11:07<14:30,  5.03s/it]
 97%|█████████▋| 4828/5000 [7:11:12<14:22,  5.01s/it]
 97%|█████████▋| 4829/5000 [7:11:17<14:30,  5.09s/it]
 97%|█████████▋| 4830/5000 [7:11:23<14:54,  5.26s/it]
 97%|█████████▋| 4831/5000 [7:11:28<14:41,  5.22s/it]
 97%|█████████▋| 4832/5000 [7:11:32<13:37,  4.87s/it]
 97%|█████████▋| 4833/5000 [7:11:36<12:50,  4.62s/it]
 97%|█████████▋| 4834/5000 [7:11:41<13:01,  4.71s/it]
 97%|█████████▋| 4835/5000 [7:11:45<12:32,  4.56s/it]
 97%|█████████▋| 4836/5000 [7:11:50<13:02,  4.77s/it]
 97%|█████████▋| 4837/5000 [7:11:55<13:10,  4.85s/it]
 97%|█████████▋| 4838/5000 [7:12:00<13:14,  4.91s/it]
 97%|█████████▋| 4839/5000 [7:12:05<13:19,  4.96s/it]
 97%|█████████▋| 4840/5000 [7:12:10<13:22,  5.02s/it]
 97%|█████████▋| 4841/5000 [7:12:16<13:28,  5.08s/it]
 97%|█████████▋| 4842/5000 [7:12:21<13:12,  5.02s/it]
 97%|█████████▋| 4843/5000 [7:12:25<12:43,  4.86s/it]
 97%|█████████▋| 4844/5000 [7:12:31<13:13,  5.08s/it]
 97%|█████████▋| 4845/5000 [7:12:35<12:47,  4.95s/it]
 97%|█████████▋| 4846/5000 [7:12:39<12:02,  4.69s/it]
 97%|█████████▋| 4847/5000 [7:12:43<11:23,  4.47s/it]
 97%|█████████▋| 4848/5000 [7:12:47<10:48,  4.27s/it]
 97%|█████████▋| 4849/5000 [7:12:51<10:24,  4.14s/it]
 97%|█████████▋| 4850/5000 [7:12:55<10:07,  4.05s/it]
                                                     
 97%|█████████▋| 4850/5000 [7:12:55<10:07,  4.05s/it]
 97%|█████████▋| 4851/5000 [7:12:59<09:56,  4.00s/it]
 97%|█████████▋| 4852/5000 [7:13:03<10:22,  4.21s/it]
 97%|█████████▋| 4853/5000 [7:13:08<10:50,  4.42s/it]
 97%|█████████▋| 4854/5000 [7:13:13<10:48,  4.44s/it]
 97%|█████████▋| 4855/5000 [7:13:17<10:53,  4.51s/it]
 97%|█████████▋| 4856/5000 [7:13:21<10:21,  4.32s/it]
 97%|█████████▋| 4857/5000 [7:13:26<10:39,  4.47s/it]
 97%|█████████▋| 4858/5000 [7:13:31<11:08,  4.71s/it]
 97%|█████████▋| 4859/5000 [7:13:37<11:25,  4.86s/it]
 97%|█████████▋| 4860/5000 [7:13:41<11:14,  4.82s/it]
 97%|█████████▋| 4861/5000 [7:13:46<10:54,  4.71s/it]
 97%|█████████▋| 4862/5000 [7:13:51<11:07,  4.84s/it]
 97%|█████████▋| 4863/5000 [7:13:56<11:03,  4.84s/it]
 97%|█████████▋| 4864/5000 [7:14:00<10:19,  4.56s/it]
 97%|█████████▋| 4865/5000 [7:14:04<09:49,  4.36s/it]
 97%|█████████▋| 4866/5000 [7:14:09<10:23,  4.65s/it]
 97%|█████████▋| 4867/5000 [7:14:14<10:17,  4.64s/it]
 97%|█████████▋| 4868/5000 [7:14:19<10:26,  4.75s/it]
 97%|█████████▋| 4869/5000 [7:14:23<10:23,  4.76s/it]
 97%|█████████▋| 4870/5000 [7:14:27<09:43,  4.49s/it]
 97%|█████████▋| 4871/5000 [7:14:31<09:14,  4.30s/it]
 97%|█████████▋| 4872/5000 [7:14:35<09:07,  4.28s/it]
 97%|█████████▋| 4873/5000 [7:14:41<09:43,  4.60s/it]
 97%|█████████▋| 4874/5000 [7:14:44<09:11,  4.38s/it]
 98%|█████████▊| 4875/5000 [7:14:48<08:48,  4.23s/it]
                                                     
 98%|█████████▊| 4875/5000 [7:14:48<08:48,  4.23s/it]
 98%|█████████▊| 4876/5000 [7:14:52<08:30,  4.12s/it]
 98%|█████████▊| 4877/5000 [7:14:56<08:19,  4.06s/it]
 98%|█████████▊| 4878/5000 [7:15:00<08:13,  4.04s/it]
 98%|█████████▊| 4879/5000 [7:15:04<08:03,  3.99s/it]
 98%|█████████▊| 4880/5000 [7:15:09<08:43,  4.37s/it]
 98%|█████████▊| 4881/5000 [7:15:14<08:39,  4.37s/it]
 98%|████��████▊| 4882/5000 [7:15:18<08:41,  4.42s/it]
 98%|█████████▊| 4883/5000 [7:15:22<08:18,  4.26s/it]
 98%|█████████▊| 4884/5000 [7:15:26<07:56,  4.11s/it]
 98%|█████████▊| 4885/5000 [7:15:30<07:50,  4.09s/it]
 98%|█████████▊| 4886/5000 [7:15:35<08:10,  4.30s/it]
 98%|█████████▊| 4887/5000 [7:15:40<08:43,  4.64s/it]
 98%|█████████▊| 4888/5000 [7:15:45<08:57,  4.80s/it]
 98%|█████████▊| 4889/5000 [7:15:50<09:06,  4.92s/it]
 98%|█████████▊| 4890/5000 [7:15:55<09:03,  4.94s/it]
 98%|█████████▊| 4891/5000 [7:15:59<08:20,  4.60s/it]
 98%|█████████▊| 4892/5000 [7:16:03<07:51,  4.36s/it]
 98%|█████████▊| 4893/5000 [7:16:07<07:28,  4.20s/it]
 98%|█████████▊| 4894/5000 [7:16:11<07:38,  4.32s/it]
 98%|█████████▊| 4895/5000 [7:16:15<07:15,  4.15s/it]
 98%|█████████▊| 4896/5000 [7:16:20<07:20,  4.24s/it]
 98%|█████████▊| 4897/5000 [7:16:24<07:17,  4.24s/it]
 98%|█████████▊| 4898/5000 [7:16:28<07:00,  4.13s/it]
 98%|█████████▊| 4899/5000 [7:16:32<06:50,  4.07s/it]
 98%|█████████▊| 4900/5000 [7:16:36<06:50,  4.10s/it]
                                                     
 98%|█████████▊| 4900/5000 [7:16:36<06:50,  4.10s/it]
 98%|█████████▊| 4901/5000 [7:16:40<06:38,  4.02s/it]
 98%|█████████▊| 4902/5000 [7:16:45<07:09,  4.39s/it]
 98%|█████████▊| 4903/5000 [7:16:49<06:50,  4.23s/it]
 98%|█████████▊| 4904/5000 [7:16:53<06:53,  4.31s/it]
 98%|█████████▊| 4905/5000 [7:16:57<06:36,  4.17s/it]
 98%|█████████▊| 4906/5000 [7:17:01<06:23,  4.08s/it]
 98%|█████████▊| 4907/5000 [7:17:05<06:12,  4.00s/it]
 98%|█████████▊| 4908/5000 [7:17:09<06:03,  3.95s/it]
 98%|█████████▊| 4909/5000 [7:17:12<05:55,  3.91s/it]
 98%|█████████▊| 4910/5000 [7:17:16<05:49,  3.88s/it]
 98%|█████████▊| 4911/5000 [7:17:22<06:40,  4.50s/it]
 98%|█████████▊| 4912/5000 [7:17:27<06:45,  4.60s/it]
 98%|█████████▊| 4913/5000 [7:17:32<06:45,  4.66s/it]
 98%|█████████▊| 4914/5000 [7:17:36<06:22,  4.45s/it]
 98%|█████████▊| 4915/5000 [7:17:40<06:02,  4.27s/it]
 98%|█████████▊| 4916/5000 [7:17:44<05:48,  4.15s/it]
 98%|█████████▊| 4917/5000 [7:17:47<05:36,  4.05s/it]
 98%|█████████▊| 4918/5000 [7:17:51<05:27,  3.99s/it]
 98%|█████████▊| 4919/5000 [7:17:56<05:36,  4.16s/it]
 98%|█████████▊| 4920/5000 [7:18:00<05:24,  4.06s/it]
 98%|█████████▊| 4921/5000 [7:18:04<05:28,  4.16s/it]
 98%|█████████▊| 4922/5000 [7:18:08<05:17,  4.07s/it]
 98%|█████████▊| 4923/5000 [7:18:12<05:14,  4.08s/it]
 98%|█████████▊| 4924/5000 [7:18:16<05:12,  4.11s/it]
 98%|█████████▊| 4925/5000 [7:18:20<05:04,  4.05s/it]
                                                     
 98%|█████████▊| 4925/5000 [7:18:20<05:04,  4.05s/it]
 99%|█████████▊| 4926/5000 [7:18:26<05:44,  4.65s/it]
 99%|█████████▊| 4927/5000 [7:18:31<05:51,  4.81s/it]
 99%|█████████▊| 4928/5000 [7:18:36<05:47,  4.82s/it]
 99%|█████████▊| 4929/5000 [7:18:39<04:55,  4.16s/it]
 99%|█████████▊| 4930/5000 [7:18:41<04:06,  3.52s/it]
 99%|█████████▊| 4931/5000 [7:18:43<03:32,  3.08s/it]
 99%|█████████▊| 4932/5000 [7:18:45<03:07,  2.76s/it]
 99%|█████████▊| 4933/5000 [7:18:47<02:50,  2.55s/it]
 99%|█████████▊| 4934/5000 [7:18:49<02:38,  2.40s/it]
 99%|█████████▊| 4935/5000 [7:18:51<02:29,  2.29s/it]
 99%|█████████▊| 4936/5000 [7:18:53<02:22,  2.22s/it]
 99%|█████████▊| 4937/5000 [7:18:55<02:16,  2.17s/it]
 99%|█████████▉| 4938/5000 [7:18:57<02:12,  2.13s/it]
 99%|█████████▉| 4939/5000 [7:18:59<02:08,  2.11s/it]
 99%|█████████▉| 4940/5000 [7:19:01<02:05,  2.09s/it]
 99%|█████████▉| 4941/5000 [7:19:03<02:02,  2.07s/it]
 99%|█████████▉| 4942/5000 [7:19:05<01:59,  2.07s/it]
 99%|█████████▉| 4943/5000 [7:19:07<01:57,  2.06s/it]
 99%|█████████▉| 4944/5000 [7:19:09<01:53,  2.02s/it]{'loss': 0.0014, 'learning_rate': 1.0066666666666668e-06, 'epoch': 11.0}
+{'loss': 0.0014, 'learning_rate': 9.511111111111111e-07, 'epoch': 11.01}
+{'loss': 0.0013, 'learning_rate': 8.955555555555557e-07, 'epoch': 11.01}
+{'loss': 0.0013, 'learning_rate': 8.400000000000001e-07, 'epoch': 11.02}
+{'loss': 0.0014, 'learning_rate': 7.844444444444445e-07, 'epoch': 11.02}
+{'loss': 0.0015, 'learning_rate': 7.28888888888889e-07, 'epoch': 11.03}
+{'loss': 0.0013, 'learning_rate': 6.733333333333334e-07, 'epoch': 11.03}
+{'loss': 0.0013, 'learning_rate': 6.177777777777778e-07, 'epoch': 11.04}
+{'loss': 0.0013, 'learning_rate': 5.622222222222223e-07, 'epoch': 11.04}
+{'loss': 0.0013, 'learning_rate': 5.066666666666667e-07, 'epoch': 11.05}
+{'loss': 0.0013, 'learning_rate': 4.511111111111111e-07, 'epoch': 11.05}
+{'loss': 0.0013, 'learning_rate': 3.9555555555555557e-07, 'epoch': 11.06}
+{'loss': 0.0013, 'learning_rate': 3.4000000000000003e-07, 'epoch': 11.06}
+{'loss': 0.0013, 'learning_rate': 2.844444444444445e-07, 'epoch': 11.07}
+{'loss': 0.0012, 'learning_rate': 2.2888888888888892e-07, 'epoch': 11.07}
+{'loss': 0.0012, 'learning_rate': 1.7333333333333335e-07, 'epoch': 11.08}
+
+
+
+
+
+
+
 99%|█████████▉| 4945/5000 [7:19:57<14:26, 15.75s/it]
 99%|█████████▉| 4946/5000 [7:20:01<10:57, 12.18s/it]
 99%|█████████▉| 4947/5000 [7:20:05<08:32,  9.68s/it]
 99%|█████████▉| 4948/5000 [7:20:09<06:55,  8.00s/it]
 99%|█████████▉| 4949/5000 [7:20:13<05:55,  6.97s/it]
 99%|█████████▉| 4950/5000 [7:20:19<05:33,  6.67s/it]
                                                     
 99%|█████████▉| 4950/5000 [7:20:19<05:33,  6.67s/it]
 99%|█████████▉| 4951/5000 [7:20:24<05:02,  6.17s/it]
 99%|█████████▉| 4952/5000 [7:20:29<04:34,  5.71s/it]
 99%|█████████▉| 4953/5000 [7:20:33<04:01,  5.13s/it]
 99%|█████████▉| 4954/5000 [7:20:37<03:38,  4.75s/it]
 99%|█████████▉| 4955/5000 [7:20:40<03:21,  4.48s/it]
 99%|█████████▉| 4956/5000 [7:20:44<03:09,  4.31s/it]
 99%|█████████▉| 4957/5000 [7:20:50<03:17,  4.60s/it]
 99%|█████████▉| 4958/5000 [7:20:54<03:03,  4.37s/it]
 99%|█████████▉| 4959/5000 [7:20:58<02:59,  4.39s/it]
 99%|█████████▉| 4960/5000 [7:21:02<02:48,  4.22s/it]
 99%|█████████▉| 4961/5000 [7:21:06<02:43,  4.19s/it]
 99%|█████████▉| 4962/5000 [7:21:10<02:34,  4.06s/it]
 99%|█████████▉| 4963/5000 [7:21:13<02:27,  3.99s/it]
 99%|█████████▉| 4964/5000 [7:21:17<02:21,  3.93s/it]
 99%|█████████▉| 4965/5000 [7:21:21<02:16,  3.90s/it]
 99%|█████████▉| 4966/5000 [7:21:27<02:32,  4.48s/it]
 99%|█████████▉| 4967/5000 [7:21:33<02:38,  4.81s/it]
 99%|█████████▉| 4968/5000 [7:21:37<02:34,  4.83s/it]
 99%|█████████▉| 4969/5000 [7:21:42<02:26,  4.73s/it]
 99%|█████████▉| 4970/5000 [7:21:46<02:13,  4.46s/it]
 99%|█████████▉| 4971/5000 [7:21:50<02:03,  4.27s/it]
 99%|█████████▉| 4972/5000 [7:21:53<01:55,  4.14s/it]
 99%|█████████▉| 4973/5000 [7:21:57<01:49,  4.05s/it]
 99%|█████████▉| 4974/5000 [7:22:02<01:51,  4.27s/it]
                                                     
                                                     
+[INFO|trainer.py:2959] 2023-07-20 18:29:28,451 >>   Num examples: Unknown
+[INFO|trainer.py:2960] 2023-07-20 18:29:28,451 >>   Batch size = 16
+{'loss': 0.0013, 'learning_rate': 1.1777777777777778e-07, 'epoch': 12.0}
+{'loss': 0.0013, 'learning_rate': 6.222222222222223e-08, 'epoch': 12.01}
+{'loss': 0.0012, 'learning_rate': 6.666666666666667e-09, 'epoch': 12.01}
+
+
+
+[INFO|trainer_utils.py:689] 2023-07-20 18:29:31,403 >> The following columns in the evaluation set don't have a corresponding argument in `WhisperForConditionalGeneration.forward` and have been ignored: input_length. If input_length are not expected by `WhisperForConditionalGeneration.forward`,  you can safely ignore this message.
+
                                                     
+[INFO|configuration_utils.py:447] 2023-07-20 18:45:41,667 >> Configuration saved in ./checkpoint-5000/config.json
+[INFO|modeling_utils.py:1693] 2023-07-20 18:45:42,938 >> Model weights saved in ./checkpoint-5000/pytorch_model.bin
+[INFO|feature_extraction_utils.py:368] 2023-07-20 18:45:42,945 >> Feature extractor saved in ./checkpoint-5000/preprocessor_config.json
+[INFO|feature_extraction_utils.py:368] 2023-07-20 18:45:48,327 >> Feature extractor saved in ./preprocessor_config.json

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:400ef1cf675e326f8a41fe32d853d1cc826596315b5408a6dac28fcd769d3c96
+oid sha256:8a0428f91590b138a162dd67eca790da7e06b2156badfd66eb467731ee328948
 size 967102601

runs/Jul20_11-05-05_tknadmin-System-Product-Name/events.out.tfevents.1689843926.tknadmin-System-Product-Name.2399.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1862c33141ce1593fb96440ee07a7730c2c5173bfab820c2244beada3759cedd
-size 30658
+oid sha256:a3070c14f660e9ff8da8f60a6009fc3fdb5db3bbe1ef8c774730e65d2e674f66
+size 37256