2022-12-04 00:34:39 - r - INFO: - Hyperparameters: 2022-12-04 00:34:39 - r - INFO: - ================================================================================ 2022-12-04 00:34:39 - r - INFO: - Name Value Type 2022-12-04 00:34:39 - r - INFO: - env_name CartPole-v1 2022-12-04 00:34:39 - r - INFO: - new_step_api 1 2022-12-04 00:34:39 - r - INFO: - wrapper None 2022-12-04 00:34:39 - r - INFO: - render 0 2022-12-04 00:34:39 - r - INFO: - algo_name A2C 2022-12-04 00:34:39 - r - INFO: - mode train 2022-12-04 00:34:39 - r - INFO: - seed 1 2022-12-04 00:34:39 - r - INFO: - device cpu 2022-12-04 00:34:39 - r - INFO: - train_eps 1000 2022-12-04 00:34:39 - r - INFO: - test_eps 10 2022-12-04 00:34:39 - r - INFO: - eval_eps 10 2022-12-04 00:34:39 - r - INFO: - eval_per_episode 5 2022-12-04 00:34:39 - r - INFO: - max_steps 200 2022-12-04 00:34:39 - r - INFO: - load_checkpoint 0 2022-12-04 00:34:39 - r - INFO: - load_path Train_CartPole-v1_DQN_20221026-054757 2022-12-04 00:34:39 - r - INFO: - show_fig 0 2022-12-04 00:34:39 - r - INFO: - save_fig 1 2022-12-04 00:34:39 - r - INFO: - continuous 0 2022-12-04 00:34:39 - r - INFO: - gamma 0.99 2022-12-04 00:34:39 - r - INFO: - actor_lr 0.0003 2022-12-04 00:34:39 - r - INFO: - critic_lr 0.001 2022-12-04 00:34:39 - r - INFO: - actor_hidden_dim 256 2022-12-04 00:34:39 - r - INFO: - critic_hidden_dim 256 2022-12-04 00:34:39 - r - INFO: - entropy_coef 0.001 2022-12-04 00:34:39 - r - INFO: - update_freq 20 2022-12-04 00:34:39 - r - INFO: - ================================================================================ 2022-12-04 00:34:40 - r - INFO: - n_states: 4, n_actions: 2 2022-12-04 00:34:40 - r - INFO: - Start training! 2022-12-04 00:34:40 - r - INFO: - Env: CartPole-v1, Algorithm: A2C, Device: cpu 2022-12-04 00:34:40 - r - INFO: - Episode: 1/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:40 - r - INFO: - Episode: 2/1000, Reward: 30.000, Step: 30 2022-12-04 00:34:40 - r - INFO: - Episode: 3/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:40 - r - INFO: - Episode: 4/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:40 - r - INFO: - Episode: 5/1000, Reward: 38.000, Step: 38 2022-12-04 00:34:40 - r - INFO: - Current episode 5 has the best eval reward: 18.800 2022-12-04 00:34:40 - r - INFO: - Episode: 6/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:40 - r - INFO: - Episode: 7/1000, Reward: 20.000, Step: 20 2022-12-04 00:34:40 - r - INFO: - Episode: 8/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:40 - r - INFO: - Episode: 9/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:40 - r - INFO: - Episode: 10/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:40 - r - INFO: - Current episode 10 has the best eval reward: 20.700 2022-12-04 00:34:40 - r - INFO: - Episode: 11/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:40 - r - INFO: - Episode: 12/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:41 - r - INFO: - Episode: 13/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:41 - r - INFO: - Episode: 14/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:41 - r - INFO: - Episode: 15/1000, Reward: 26.000, Step: 26 2022-12-04 00:34:41 - r - INFO: - Current episode 15 has the best eval reward: 24.200 2022-12-04 00:34:41 - r - INFO: - Episode: 16/1000, Reward: 25.000, Step: 25 2022-12-04 00:34:41 - r - INFO: - Episode: 17/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:41 - r - INFO: - Episode: 18/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:41 - r - INFO: - Episode: 19/1000, Reward: 23.000, Step: 23 2022-12-04 00:34:41 - r - INFO: - Episode: 20/1000, Reward: 35.000, Step: 35 2022-12-04 00:34:41 - r - INFO: - Episode: 21/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:41 - r - INFO: - Episode: 22/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:41 - r - INFO: - Episode: 23/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:41 - r - INFO: - Episode: 24/1000, Reward: 20.000, Step: 20 2022-12-04 00:34:41 - r - INFO: - Episode: 25/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:41 - r - INFO: - Current episode 25 has the best eval reward: 24.600 2022-12-04 00:34:41 - r - INFO: - Episode: 26/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:41 - r - INFO: - Episode: 27/1000, Reward: 9.000, Step: 9 2022-12-04 00:34:41 - r - INFO: - Episode: 28/1000, Reward: 37.000, Step: 37 2022-12-04 00:34:41 - r - INFO: - Episode: 29/1000, Reward: 25.000, Step: 25 2022-12-04 00:34:41 - r - INFO: - Episode: 30/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:41 - r - INFO: - Episode: 31/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:41 - r - INFO: - Episode: 32/1000, Reward: 25.000, Step: 25 2022-12-04 00:34:41 - r - INFO: - Episode: 33/1000, Reward: 30.000, Step: 30 2022-12-04 00:34:41 - r - INFO: - Episode: 34/1000, Reward: 31.000, Step: 31 2022-12-04 00:34:41 - r - INFO: - Episode: 35/1000, Reward: 9.000, Step: 9 2022-12-04 00:34:41 - r - INFO: - Episode: 36/1000, Reward: 31.000, Step: 31 2022-12-04 00:34:41 - r - INFO: - Episode: 37/1000, Reward: 24.000, Step: 24 2022-12-04 00:34:41 - r - INFO: - Episode: 38/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:41 - r - INFO: - Episode: 39/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:41 - r - INFO: - Episode: 40/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:41 - r - INFO: - Episode: 41/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:41 - r - INFO: - Episode: 42/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:41 - r - INFO: - Episode: 43/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:41 - r - INFO: - Episode: 44/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:41 - r - INFO: - Episode: 45/1000, Reward: 20.000, Step: 20 2022-12-04 00:34:41 - r - INFO: - Episode: 46/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:41 - r - INFO: - Episode: 47/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:42 - r - INFO: - Episode: 48/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:42 - r - INFO: - Episode: 49/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:42 - r - INFO: - Episode: 50/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:42 - r - INFO: - Episode: 51/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:42 - r - INFO: - Episode: 52/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:42 - r - INFO: - Episode: 53/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:42 - r - INFO: - Episode: 54/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:42 - r - INFO: - Episode: 55/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:42 - r - INFO: - Episode: 56/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:42 - r - INFO: - Episode: 57/1000, Reward: 24.000, Step: 24 2022-12-04 00:34:42 - r - INFO: - Episode: 58/1000, Reward: 38.000, Step: 38 2022-12-04 00:34:42 - r - INFO: - Episode: 59/1000, Reward: 39.000, Step: 39 2022-12-04 00:34:42 - r - INFO: - Episode: 60/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:42 - r - INFO: - Current episode 60 has the best eval reward: 26.700 2022-12-04 00:34:42 - r - INFO: - Episode: 61/1000, Reward: 23.000, Step: 23 2022-12-04 00:34:42 - r - INFO: - Episode: 62/1000, Reward: 24.000, Step: 24 2022-12-04 00:34:42 - r - INFO: - Episode: 63/1000, Reward: 34.000, Step: 34 2022-12-04 00:34:42 - r - INFO: - Episode: 64/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:42 - r - INFO: - Episode: 65/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:42 - r - INFO: - Episode: 66/1000, Reward: 40.000, Step: 40 2022-12-04 00:34:42 - r - INFO: - Episode: 67/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:42 - r - INFO: - Episode: 68/1000, Reward: 22.000, Step: 22 2022-12-04 00:34:42 - r - INFO: - Episode: 69/1000, Reward: 23.000, Step: 23 2022-12-04 00:34:42 - r - INFO: - Episode: 70/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:42 - r - INFO: - Current episode 70 has the best eval reward: 26.800 2022-12-04 00:34:42 - r - INFO: - Episode: 71/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:42 - r - INFO: - Episode: 72/1000, Reward: 24.000, Step: 24 2022-12-04 00:34:42 - r - INFO: - Episode: 73/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:42 - r - INFO: - Episode: 74/1000, Reward: 24.000, Step: 24 2022-12-04 00:34:42 - r - INFO: - Episode: 75/1000, Reward: 24.000, Step: 24 2022-12-04 00:34:42 - r - INFO: - Episode: 76/1000, Reward: 20.000, Step: 20 2022-12-04 00:34:42 - r - INFO: - Episode: 77/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:42 - r - INFO: - Episode: 78/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:42 - r - INFO: - Episode: 79/1000, Reward: 43.000, Step: 43 2022-12-04 00:34:42 - r - INFO: - Episode: 80/1000, Reward: 9.000, Step: 9 2022-12-04 00:34:42 - r - INFO: - Episode: 81/1000, Reward: 43.000, Step: 43 2022-12-04 00:34:42 - r - INFO: - Episode: 82/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:42 - r - INFO: - Episode: 83/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:42 - r - INFO: - Episode: 84/1000, Reward: 9.000, Step: 9 2022-12-04 00:34:42 - r - INFO: - Episode: 85/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:43 - r - INFO: - Current episode 85 has the best eval reward: 26.800 2022-12-04 00:34:43 - r - INFO: - Episode: 86/1000, Reward: 40.000, Step: 40 2022-12-04 00:34:43 - r - INFO: - Episode: 87/1000, Reward: 35.000, Step: 35 2022-12-04 00:34:43 - r - INFO: - Episode: 88/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:43 - r - INFO: - Episode: 89/1000, Reward: 22.000, Step: 22 2022-12-04 00:34:43 - r - INFO: - Episode: 90/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:43 - r - INFO: - Episode: 91/1000, Reward: 26.000, Step: 26 2022-12-04 00:34:43 - r - INFO: - Episode: 92/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:43 - r - INFO: - Episode: 93/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:43 - r - INFO: - Episode: 94/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:43 - r - INFO: - Episode: 95/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:43 - r - INFO: - Episode: 96/1000, Reward: 19.000, Step: 19 2022-12-04 00:34:43 - r - INFO: - Episode: 97/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:43 - r - INFO: - Episode: 98/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:43 - r - INFO: - Episode: 99/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:43 - r - INFO: - Episode: 100/1000, Reward: 22.000, Step: 22 2022-12-04 00:34:43 - r - INFO: - Episode: 101/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:43 - r - INFO: - Episode: 102/1000, Reward: 34.000, Step: 34 2022-12-04 00:34:43 - r - INFO: - Episode: 103/1000, Reward: 47.000, Step: 47 2022-12-04 00:34:43 - r - INFO: - Episode: 104/1000, Reward: 24.000, Step: 24 2022-12-04 00:34:43 - r - INFO: - Episode: 105/1000, Reward: 28.000, Step: 28 2022-12-04 00:34:43 - r - INFO: - Episode: 106/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:43 - r - INFO: - Episode: 107/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:43 - r - INFO: - Episode: 108/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:43 - r - INFO: - Episode: 109/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:43 - r - INFO: - Episode: 110/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:43 - r - INFO: - Episode: 111/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:43 - r - INFO: - Episode: 112/1000, Reward: 27.000, Step: 27 2022-12-04 00:34:43 - r - INFO: - Episode: 113/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:43 - r - INFO: - Episode: 114/1000, Reward: 20.000, Step: 20 2022-12-04 00:34:43 - r - INFO: - Episode: 115/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:43 - r - INFO: - Episode: 116/1000, Reward: 37.000, Step: 37 2022-12-04 00:34:43 - r - INFO: - Episode: 117/1000, Reward: 9.000, Step: 9 2022-12-04 00:34:43 - r - INFO: - Episode: 118/1000, Reward: 23.000, Step: 23 2022-12-04 00:34:43 - r - INFO: - Episode: 119/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:43 - r - INFO: - Episode: 120/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:43 - r - INFO: - Episode: 121/1000, Reward: 39.000, Step: 39 2022-12-04 00:34:43 - r - INFO: - Episode: 122/1000, Reward: 19.000, Step: 19 2022-12-04 00:34:43 - r - INFO: - Episode: 123/1000, Reward: 20.000, Step: 20 2022-12-04 00:34:43 - r - INFO: - Episode: 124/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:43 - r - INFO: - Episode: 125/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:44 - r - INFO: - Episode: 126/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:44 - r - INFO: - Episode: 127/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:44 - r - INFO: - Episode: 128/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:44 - r - INFO: - Episode: 129/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:44 - r - INFO: - Episode: 130/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:44 - r - INFO: - Episode: 131/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:44 - r - INFO: - Episode: 132/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:44 - r - INFO: - Episode: 133/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:44 - r - INFO: - Episode: 134/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:44 - r - INFO: - Episode: 135/1000, Reward: 26.000, Step: 26 2022-12-04 00:34:44 - r - INFO: - Episode: 136/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:44 - r - INFO: - Episode: 137/1000, Reward: 9.000, Step: 9 2022-12-04 00:34:44 - r - INFO: - Episode: 138/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:44 - r - INFO: - Episode: 139/1000, Reward: 9.000, Step: 9 2022-12-04 00:34:44 - r - INFO: - Episode: 140/1000, Reward: 31.000, Step: 31 2022-12-04 00:34:44 - r - INFO: - Episode: 141/1000, Reward: 20.000, Step: 20 2022-12-04 00:34:44 - r - INFO: - Episode: 142/1000, Reward: 20.000, Step: 20 2022-12-04 00:34:44 - r - INFO: - Episode: 143/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:44 - r - INFO: - Episode: 144/1000, Reward: 9.000, Step: 9 2022-12-04 00:34:44 - r - INFO: - Episode: 145/1000, Reward: 9.000, Step: 9 2022-12-04 00:34:44 - r - INFO: - Episode: 146/1000, Reward: 26.000, Step: 26 2022-12-04 00:34:44 - r - INFO: - Episode: 147/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:44 - r - INFO: - Episode: 148/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:44 - r - INFO: - Episode: 149/1000, Reward: 25.000, Step: 25 2022-12-04 00:34:44 - r - INFO: - Episode: 150/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:44 - r - INFO: - Episode: 151/1000, Reward: 20.000, Step: 20 2022-12-04 00:34:44 - r - INFO: - Episode: 152/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:44 - r - INFO: - Episode: 153/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:44 - r - INFO: - Episode: 154/1000, Reward: 9.000, Step: 9 2022-12-04 00:34:44 - r - INFO: - Episode: 155/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:44 - r - INFO: - Episode: 156/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:44 - r - INFO: - Episode: 157/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:44 - r - INFO: - Episode: 158/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:44 - r - INFO: - Episode: 159/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:44 - r - INFO: - Episode: 160/1000, Reward: 9.000, Step: 9 2022-12-04 00:34:44 - r - INFO: - Episode: 161/1000, Reward: 31.000, Step: 31 2022-12-04 00:34:44 - r - INFO: - Episode: 162/1000, Reward: 9.000, Step: 9 2022-12-04 00:34:44 - r - INFO: - Episode: 163/1000, Reward: 47.000, Step: 47 2022-12-04 00:34:44 - r - INFO: - Episode: 164/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:44 - r - INFO: - Episode: 165/1000, Reward: 9.000, Step: 9 2022-12-04 00:34:44 - r - INFO: - Episode: 166/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:44 - r - INFO: - Episode: 167/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:44 - r - INFO: - Episode: 168/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:45 - r - INFO: - Episode: 169/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:45 - r - INFO: - Episode: 170/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:45 - r - INFO: - Episode: 171/1000, Reward: 19.000, Step: 19 2022-12-04 00:34:45 - r - INFO: - Episode: 172/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:45 - r - INFO: - Episode: 173/1000, Reward: 18.000, Step: 18 2022-12-04 00:34:45 - r - INFO: - Episode: 174/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:45 - r - INFO: - Episode: 175/1000, Reward: 18.000, Step: 18 2022-12-04 00:34:45 - r - INFO: - Episode: 176/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:45 - r - INFO: - Episode: 177/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:45 - r - INFO: - Episode: 178/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:45 - r - INFO: - Episode: 179/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:45 - r - INFO: - Episode: 180/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:45 - r - INFO: - Episode: 181/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:45 - r - INFO: - Episode: 182/1000, Reward: 26.000, Step: 26 2022-12-04 00:34:45 - r - INFO: - Episode: 183/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:45 - r - INFO: - Episode: 184/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:45 - r - INFO: - Episode: 185/1000, Reward: 9.000, Step: 9 2022-12-04 00:34:45 - r - INFO: - Episode: 186/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:45 - r - INFO: - Episode: 187/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:45 - r - INFO: - Episode: 188/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:45 - r - INFO: - Episode: 189/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:45 - r - INFO: - Episode: 190/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:45 - r - INFO: - Episode: 191/1000, Reward: 9.000, Step: 9 2022-12-04 00:34:45 - r - INFO: - Episode: 192/1000, Reward: 29.000, Step: 29 2022-12-04 00:34:45 - r - INFO: - Episode: 193/1000, Reward: 43.000, Step: 43 2022-12-04 00:34:45 - r - INFO: - Episode: 194/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:45 - r - INFO: - Episode: 195/1000, Reward: 35.000, Step: 35 2022-12-04 00:34:45 - r - INFO: - Episode: 196/1000, Reward: 31.000, Step: 31 2022-12-04 00:34:45 - r - INFO: - Episode: 197/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:45 - r - INFO: - Episode: 198/1000, Reward: 49.000, Step: 49 2022-12-04 00:34:45 - r - INFO: - Episode: 199/1000, Reward: 9.000, Step: 9 2022-12-04 00:34:45 - r - INFO: - Episode: 200/1000, Reward: 26.000, Step: 26 2022-12-04 00:34:45 - r - INFO: - Episode: 201/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:45 - r - INFO: - Episode: 202/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:45 - r - INFO: - Episode: 203/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:45 - r - INFO: - Episode: 204/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:45 - r - INFO: - Episode: 205/1000, Reward: 29.000, Step: 29 2022-12-04 00:34:45 - r - INFO: - Episode: 206/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:45 - r - INFO: - Episode: 207/1000, Reward: 25.000, Step: 25 2022-12-04 00:34:45 - r - INFO: - Episode: 208/1000, Reward: 23.000, Step: 23 2022-12-04 00:34:45 - r - INFO: - Episode: 209/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:45 - r - INFO: - Episode: 210/1000, Reward: 9.000, Step: 9 2022-12-04 00:34:45 - r - INFO: - Episode: 211/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:45 - r - INFO: - Episode: 212/1000, Reward: 31.000, Step: 31 2022-12-04 00:34:45 - r - INFO: - Episode: 213/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:45 - r - INFO: - Episode: 214/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:45 - r - INFO: - Episode: 215/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:46 - r - INFO: - Episode: 216/1000, Reward: 26.000, Step: 26 2022-12-04 00:34:46 - r - INFO: - Episode: 217/1000, Reward: 19.000, Step: 19 2022-12-04 00:34:46 - r - INFO: - Episode: 218/1000, Reward: 26.000, Step: 26 2022-12-04 00:34:46 - r - INFO: - Episode: 219/1000, Reward: 18.000, Step: 18 2022-12-04 00:34:46 - r - INFO: - Episode: 220/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:46 - r - INFO: - Episode: 221/1000, Reward: 19.000, Step: 19 2022-12-04 00:34:46 - r - INFO: - Episode: 222/1000, Reward: 24.000, Step: 24 2022-12-04 00:34:46 - r - INFO: - Episode: 223/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:46 - r - INFO: - Episode: 224/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:46 - r - INFO: - Episode: 225/1000, Reward: 20.000, Step: 20 2022-12-04 00:34:46 - r - INFO: - Current episode 225 has the best eval reward: 27.300 2022-12-04 00:34:46 - r - INFO: - Episode: 226/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:46 - r - INFO: - Episode: 227/1000, Reward: 24.000, Step: 24 2022-12-04 00:34:46 - r - INFO: - Episode: 228/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:46 - r - INFO: - Episode: 229/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:46 - r - INFO: - Episode: 230/1000, Reward: 28.000, Step: 28 2022-12-04 00:34:46 - r - INFO: - Episode: 231/1000, Reward: 26.000, Step: 26 2022-12-04 00:34:46 - r - INFO: - Episode: 232/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:46 - r - INFO: - Episode: 233/1000, Reward: 26.000, Step: 26 2022-12-04 00:34:46 - r - INFO: - Episode: 234/1000, Reward: 19.000, Step: 19 2022-12-04 00:34:46 - r - INFO: - Episode: 235/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:46 - r - INFO: - Episode: 236/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:46 - r - INFO: - Episode: 237/1000, Reward: 25.000, Step: 25 2022-12-04 00:34:46 - r - INFO: - Episode: 238/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:46 - r - INFO: - Episode: 239/1000, Reward: 24.000, Step: 24 2022-12-04 00:34:46 - r - INFO: - Episode: 240/1000, Reward: 33.000, Step: 33 2022-12-04 00:34:46 - r - INFO: - Current episode 240 has the best eval reward: 28.300 2022-12-04 00:34:46 - r - INFO: - Episode: 241/1000, Reward: 31.000, Step: 31 2022-12-04 00:34:46 - r - INFO: - Episode: 242/1000, Reward: 37.000, Step: 37 2022-12-04 00:34:46 - r - INFO: - Episode: 243/1000, Reward: 32.000, Step: 32 2022-12-04 00:34:46 - r - INFO: - Episode: 244/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:46 - r - INFO: - Episode: 245/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:46 - r - INFO: - Episode: 246/1000, Reward: 42.000, Step: 42 2022-12-04 00:34:46 - r - INFO: - Episode: 247/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:46 - r - INFO: - Episode: 248/1000, Reward: 30.000, Step: 30 2022-12-04 00:34:46 - r - INFO: - Episode: 249/1000, Reward: 27.000, Step: 27 2022-12-04 00:34:46 - r - INFO: - Episode: 250/1000, Reward: 35.000, Step: 35 2022-12-04 00:34:46 - r - INFO: - Episode: 251/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:46 - r - INFO: - Episode: 252/1000, Reward: 22.000, Step: 22 2022-12-04 00:34:46 - r - INFO: - Episode: 253/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:46 - r - INFO: - Episode: 254/1000, Reward: 18.000, Step: 18 2022-12-04 00:34:47 - r - INFO: - Episode: 255/1000, Reward: 25.000, Step: 25 2022-12-04 00:34:47 - r - INFO: - Current episode 255 has the best eval reward: 28.800 2022-12-04 00:34:47 - r - INFO: - Episode: 256/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:47 - r - INFO: - Episode: 257/1000, Reward: 19.000, Step: 19 2022-12-04 00:34:47 - r - INFO: - Episode: 258/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:47 - r - INFO: - Episode: 259/1000, Reward: 51.000, Step: 51 2022-12-04 00:34:47 - r - INFO: - Episode: 260/1000, Reward: 53.000, Step: 53 2022-12-04 00:34:47 - r - INFO: - Current episode 260 has the best eval reward: 29.100 2022-12-04 00:34:47 - r - INFO: - Episode: 261/1000, Reward: 35.000, Step: 35 2022-12-04 00:34:47 - r - INFO: - Episode: 262/1000, Reward: 26.000, Step: 26 2022-12-04 00:34:47 - r - INFO: - Episode: 263/1000, Reward: 47.000, Step: 47 2022-12-04 00:34:47 - r - INFO: - Episode: 264/1000, Reward: 24.000, Step: 24 2022-12-04 00:34:47 - r - INFO: - Episode: 265/1000, Reward: 25.000, Step: 25 2022-12-04 00:34:47 - r - INFO: - Episode: 266/1000, Reward: 22.000, Step: 22 2022-12-04 00:34:47 - r - INFO: - Episode: 267/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:47 - r - INFO: - Episode: 268/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:47 - r - INFO: - Episode: 269/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:47 - r - INFO: - Episode: 270/1000, Reward: 56.000, Step: 56 2022-12-04 00:34:47 - r - INFO: - Current episode 270 has the best eval reward: 31.600 2022-12-04 00:34:47 - r - INFO: - Episode: 271/1000, Reward: 38.000, Step: 38 2022-12-04 00:34:47 - r - INFO: - Episode: 272/1000, Reward: 44.000, Step: 44 2022-12-04 00:34:47 - r - INFO: - Episode: 273/1000, Reward: 38.000, Step: 38 2022-12-04 00:34:47 - r - INFO: - Episode: 274/1000, Reward: 46.000, Step: 46 2022-12-04 00:34:47 - r - INFO: - Episode: 275/1000, Reward: 35.000, Step: 35 2022-12-04 00:34:47 - r - INFO: - Episode: 276/1000, Reward: 35.000, Step: 35 2022-12-04 00:34:47 - r - INFO: - Episode: 277/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:47 - r - INFO: - Episode: 278/1000, Reward: 37.000, Step: 37 2022-12-04 00:34:47 - r - INFO: - Episode: 279/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:47 - r - INFO: - Episode: 280/1000, Reward: 20.000, Step: 20 2022-12-04 00:34:47 - r - INFO: - Episode: 281/1000, Reward: 19.000, Step: 19 2022-12-04 00:34:47 - r - INFO: - Episode: 282/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:47 - r - INFO: - Episode: 283/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:47 - r - INFO: - Episode: 284/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:47 - r - INFO: - Episode: 285/1000, Reward: 36.000, Step: 36 2022-12-04 00:34:48 - r - INFO: - Episode: 286/1000, Reward: 24.000, Step: 24 2022-12-04 00:34:48 - r - INFO: - Episode: 287/1000, Reward: 51.000, Step: 51 2022-12-04 00:34:48 - r - INFO: - Episode: 288/1000, Reward: 19.000, Step: 19 2022-12-04 00:34:48 - r - INFO: - Episode: 289/1000, Reward: 36.000, Step: 36 2022-12-04 00:34:48 - r - INFO: - Episode: 290/1000, Reward: 49.000, Step: 49 2022-12-04 00:34:48 - r - INFO: - Current episode 290 has the best eval reward: 39.400 2022-12-04 00:34:48 - r - INFO: - Episode: 291/1000, Reward: 54.000, Step: 54 2022-12-04 00:34:48 - r - INFO: - Episode: 292/1000, Reward: 47.000, Step: 47 2022-12-04 00:34:48 - r - INFO: - Episode: 293/1000, Reward: 62.000, Step: 62 2022-12-04 00:34:48 - r - INFO: - Episode: 294/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:48 - r - INFO: - Episode: 295/1000, Reward: 54.000, Step: 54 2022-12-04 00:34:48 - r - INFO: - Episode: 296/1000, Reward: 30.000, Step: 30 2022-12-04 00:34:48 - r - INFO: - Episode: 297/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:48 - r - INFO: - Episode: 298/1000, Reward: 12.000, Step: 12 2022-12-04 00:34:48 - r - INFO: - Episode: 299/1000, Reward: 18.000, Step: 18 2022-12-04 00:34:48 - r - INFO: - Episode: 300/1000, Reward: 61.000, Step: 61 2022-12-04 00:34:48 - r - INFO: - Current episode 300 has the best eval reward: 40.500 2022-12-04 00:34:48 - r - INFO: - Episode: 301/1000, Reward: 30.000, Step: 30 2022-12-04 00:34:48 - r - INFO: - Episode: 302/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:48 - r - INFO: - Episode: 303/1000, Reward: 24.000, Step: 24 2022-12-04 00:34:48 - r - INFO: - Episode: 304/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:48 - r - INFO: - Episode: 305/1000, Reward: 54.000, Step: 54 2022-12-04 00:34:48 - r - INFO: - Episode: 306/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:48 - r - INFO: - Episode: 307/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:48 - r - INFO: - Episode: 308/1000, Reward: 50.000, Step: 50 2022-12-04 00:34:48 - r - INFO: - Episode: 309/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:48 - r - INFO: - Episode: 310/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:48 - r - INFO: - Episode: 311/1000, Reward: 46.000, Step: 46 2022-12-04 00:34:48 - r - INFO: - Episode: 312/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:48 - r - INFO: - Episode: 313/1000, Reward: 28.000, Step: 28 2022-12-04 00:34:48 - r - INFO: - Episode: 314/1000, Reward: 28.000, Step: 28 2022-12-04 00:34:48 - r - INFO: - Episode: 315/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:49 - r - INFO: - Episode: 316/1000, Reward: 22.000, Step: 22 2022-12-04 00:34:49 - r - INFO: - Episode: 317/1000, Reward: 35.000, Step: 35 2022-12-04 00:34:49 - r - INFO: - Episode: 318/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:49 - r - INFO: - Episode: 319/1000, Reward: 20.000, Step: 20 2022-12-04 00:34:49 - r - INFO: - Episode: 320/1000, Reward: 37.000, Step: 37 2022-12-04 00:34:49 - r - INFO: - Episode: 321/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:49 - r - INFO: - Episode: 322/1000, Reward: 20.000, Step: 20 2022-12-04 00:34:49 - r - INFO: - Episode: 323/1000, Reward: 20.000, Step: 20 2022-12-04 00:34:49 - r - INFO: - Episode: 324/1000, Reward: 39.000, Step: 39 2022-12-04 00:34:49 - r - INFO: - Episode: 325/1000, Reward: 32.000, Step: 32 2022-12-04 00:34:49 - r - INFO: - Episode: 326/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:49 - r - INFO: - Episode: 327/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:49 - r - INFO: - Episode: 328/1000, Reward: 35.000, Step: 35 2022-12-04 00:34:49 - r - INFO: - Episode: 329/1000, Reward: 22.000, Step: 22 2022-12-04 00:34:49 - r - INFO: - Episode: 330/1000, Reward: 40.000, Step: 40 2022-12-04 00:34:49 - r - INFO: - Episode: 331/1000, Reward: 36.000, Step: 36 2022-12-04 00:34:49 - r - INFO: - Episode: 332/1000, Reward: 23.000, Step: 23 2022-12-04 00:34:49 - r - INFO: - Episode: 333/1000, Reward: 30.000, Step: 30 2022-12-04 00:34:49 - r - INFO: - Episode: 334/1000, Reward: 30.000, Step: 30 2022-12-04 00:34:49 - r - INFO: - Episode: 335/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:49 - r - INFO: - Episode: 336/1000, Reward: 33.000, Step: 33 2022-12-04 00:34:49 - r - INFO: - Episode: 337/1000, Reward: 38.000, Step: 38 2022-12-04 00:34:49 - r - INFO: - Episode: 338/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:49 - r - INFO: - Episode: 339/1000, Reward: 25.000, Step: 25 2022-12-04 00:34:49 - r - INFO: - Episode: 340/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:49 - r - INFO: - Episode: 341/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:49 - r - INFO: - Episode: 342/1000, Reward: 27.000, Step: 27 2022-12-04 00:34:49 - r - INFO: - Episode: 343/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:49 - r - INFO: - Episode: 344/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:49 - r - INFO: - Episode: 345/1000, Reward: 14.000, Step: 14 2022-12-04 00:34:49 - r - INFO: - Episode: 346/1000, Reward: 35.000, Step: 35 2022-12-04 00:34:49 - r - INFO: - Episode: 347/1000, Reward: 22.000, Step: 22 2022-12-04 00:34:49 - r - INFO: - Episode: 348/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:49 - r - INFO: - Episode: 349/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:49 - r - INFO: - Episode: 350/1000, Reward: 38.000, Step: 38 2022-12-04 00:34:49 - r - INFO: - Episode: 351/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:49 - r - INFO: - Episode: 352/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:49 - r - INFO: - Episode: 353/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:49 - r - INFO: - Episode: 354/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:49 - r - INFO: - Episode: 355/1000, Reward: 23.000, Step: 23 2022-12-04 00:34:50 - r - INFO: - Episode: 356/1000, Reward: 29.000, Step: 29 2022-12-04 00:34:50 - r - INFO: - Episode: 357/1000, Reward: 19.000, Step: 19 2022-12-04 00:34:50 - r - INFO: - Episode: 358/1000, Reward: 35.000, Step: 35 2022-12-04 00:34:50 - r - INFO: - Episode: 359/1000, Reward: 39.000, Step: 39 2022-12-04 00:34:50 - r - INFO: - Episode: 360/1000, Reward: 13.000, Step: 13 2022-12-04 00:34:50 - r - INFO: - Episode: 361/1000, Reward: 24.000, Step: 24 2022-12-04 00:34:50 - r - INFO: - Episode: 362/1000, Reward: 11.000, Step: 11 2022-12-04 00:34:50 - r - INFO: - Episode: 363/1000, Reward: 27.000, Step: 27 2022-12-04 00:34:50 - r - INFO: - Episode: 364/1000, Reward: 38.000, Step: 38 2022-12-04 00:34:50 - r - INFO: - Episode: 365/1000, Reward: 78.000, Step: 78 2022-12-04 00:34:50 - r - INFO: - Episode: 366/1000, Reward: 18.000, Step: 18 2022-12-04 00:34:50 - r - INFO: - Episode: 367/1000, Reward: 28.000, Step: 28 2022-12-04 00:34:50 - r - INFO: - Episode: 368/1000, Reward: 27.000, Step: 27 2022-12-04 00:34:50 - r - INFO: - Episode: 369/1000, Reward: 10.000, Step: 10 2022-12-04 00:34:50 - r - INFO: - Episode: 370/1000, Reward: 31.000, Step: 31 2022-12-04 00:34:50 - r - INFO: - Episode: 371/1000, Reward: 22.000, Step: 22 2022-12-04 00:34:50 - r - INFO: - Episode: 372/1000, Reward: 44.000, Step: 44 2022-12-04 00:34:50 - r - INFO: - Episode: 373/1000, Reward: 77.000, Step: 77 2022-12-04 00:34:50 - r - INFO: - Episode: 374/1000, Reward: 57.000, Step: 57 2022-12-04 00:34:50 - r - INFO: - Episode: 375/1000, Reward: 23.000, Step: 23 2022-12-04 00:34:50 - r - INFO: - Episode: 376/1000, Reward: 25.000, Step: 25 2022-12-04 00:34:50 - r - INFO: - Episode: 377/1000, Reward: 44.000, Step: 44 2022-12-04 00:34:50 - r - INFO: - Episode: 378/1000, Reward: 19.000, Step: 19 2022-12-04 00:34:50 - r - INFO: - Episode: 379/1000, Reward: 22.000, Step: 22 2022-12-04 00:34:50 - r - INFO: - Episode: 380/1000, Reward: 27.000, Step: 27 2022-12-04 00:34:50 - r - INFO: - Episode: 381/1000, Reward: 43.000, Step: 43 2022-12-04 00:34:50 - r - INFO: - Episode: 382/1000, Reward: 28.000, Step: 28 2022-12-04 00:34:50 - r - INFO: - Episode: 383/1000, Reward: 28.000, Step: 28 2022-12-04 00:34:50 - r - INFO: - Episode: 384/1000, Reward: 34.000, Step: 34 2022-12-04 00:34:50 - r - INFO: - Episode: 385/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:51 - r - INFO: - Episode: 386/1000, Reward: 48.000, Step: 48 2022-12-04 00:34:51 - r - INFO: - Episode: 387/1000, Reward: 18.000, Step: 18 2022-12-04 00:34:51 - r - INFO: - Episode: 388/1000, Reward: 39.000, Step: 39 2022-12-04 00:34:51 - r - INFO: - Episode: 389/1000, Reward: 58.000, Step: 58 2022-12-04 00:34:51 - r - INFO: - Episode: 390/1000, Reward: 84.000, Step: 84 2022-12-04 00:34:51 - r - INFO: - Episode: 391/1000, Reward: 28.000, Step: 28 2022-12-04 00:34:51 - r - INFO: - Episode: 392/1000, Reward: 26.000, Step: 26 2022-12-04 00:34:51 - r - INFO: - Episode: 393/1000, Reward: 48.000, Step: 48 2022-12-04 00:34:51 - r - INFO: - Episode: 394/1000, Reward: 23.000, Step: 23 2022-12-04 00:34:51 - r - INFO: - Episode: 395/1000, Reward: 24.000, Step: 24 2022-12-04 00:34:51 - r - INFO: - Episode: 396/1000, Reward: 31.000, Step: 31 2022-12-04 00:34:51 - r - INFO: - Episode: 397/1000, Reward: 54.000, Step: 54 2022-12-04 00:34:51 - r - INFO: - Episode: 398/1000, Reward: 37.000, Step: 37 2022-12-04 00:34:51 - r - INFO: - Episode: 399/1000, Reward: 31.000, Step: 31 2022-12-04 00:34:51 - r - INFO: - Episode: 400/1000, Reward: 44.000, Step: 44 2022-12-04 00:34:51 - r - INFO: - Current episode 400 has the best eval reward: 42.400 2022-12-04 00:34:51 - r - INFO: - Episode: 401/1000, Reward: 60.000, Step: 60 2022-12-04 00:34:51 - r - INFO: - Episode: 402/1000, Reward: 20.000, Step: 20 2022-12-04 00:34:51 - r - INFO: - Episode: 403/1000, Reward: 25.000, Step: 25 2022-12-04 00:34:51 - r - INFO: - Episode: 404/1000, Reward: 29.000, Step: 29 2022-12-04 00:34:51 - r - INFO: - Episode: 405/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:51 - r - INFO: - Episode: 406/1000, Reward: 36.000, Step: 36 2022-12-04 00:34:51 - r - INFO: - Episode: 407/1000, Reward: 32.000, Step: 32 2022-12-04 00:34:51 - r - INFO: - Episode: 408/1000, Reward: 54.000, Step: 54 2022-12-04 00:34:51 - r - INFO: - Episode: 409/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:51 - r - INFO: - Episode: 410/1000, Reward: 75.000, Step: 75 2022-12-04 00:34:52 - r - INFO: - Episode: 411/1000, Reward: 74.000, Step: 74 2022-12-04 00:34:52 - r - INFO: - Episode: 412/1000, Reward: 68.000, Step: 68 2022-12-04 00:34:52 - r - INFO: - Episode: 413/1000, Reward: 114.000, Step: 114 2022-12-04 00:34:52 - r - INFO: - Episode: 414/1000, Reward: 38.000, Step: 38 2022-12-04 00:34:52 - r - INFO: - Episode: 415/1000, Reward: 22.000, Step: 22 2022-12-04 00:34:52 - r - INFO: - Current episode 415 has the best eval reward: 48.400 2022-12-04 00:34:52 - r - INFO: - Episode: 416/1000, Reward: 41.000, Step: 41 2022-12-04 00:34:52 - r - INFO: - Episode: 417/1000, Reward: 37.000, Step: 37 2022-12-04 00:34:52 - r - INFO: - Episode: 418/1000, Reward: 67.000, Step: 67 2022-12-04 00:34:52 - r - INFO: - Episode: 419/1000, Reward: 16.000, Step: 16 2022-12-04 00:34:52 - r - INFO: - Episode: 420/1000, Reward: 33.000, Step: 33 2022-12-04 00:34:52 - r - INFO: - Current episode 420 has the best eval reward: 61.900 2022-12-04 00:34:52 - r - INFO: - Episode: 421/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:52 - r - INFO: - Episode: 422/1000, Reward: 78.000, Step: 78 2022-12-04 00:34:52 - r - INFO: - Episode: 423/1000, Reward: 24.000, Step: 24 2022-12-04 00:34:52 - r - INFO: - Episode: 424/1000, Reward: 22.000, Step: 22 2022-12-04 00:34:52 - r - INFO: - Episode: 425/1000, Reward: 37.000, Step: 37 2022-12-04 00:34:52 - r - INFO: - Episode: 426/1000, Reward: 20.000, Step: 20 2022-12-04 00:34:52 - r - INFO: - Episode: 427/1000, Reward: 39.000, Step: 39 2022-12-04 00:34:52 - r - INFO: - Episode: 428/1000, Reward: 94.000, Step: 94 2022-12-04 00:34:52 - r - INFO: - Episode: 429/1000, Reward: 184.000, Step: 184 2022-12-04 00:34:52 - r - INFO: - Episode: 430/1000, Reward: 61.000, Step: 61 2022-12-04 00:34:53 - r - INFO: - Current episode 430 has the best eval reward: 63.200 2022-12-04 00:34:53 - r - INFO: - Episode: 431/1000, Reward: 36.000, Step: 36 2022-12-04 00:34:53 - r - INFO: - Episode: 432/1000, Reward: 28.000, Step: 28 2022-12-04 00:34:53 - r - INFO: - Episode: 433/1000, Reward: 132.000, Step: 132 2022-12-04 00:34:53 - r - INFO: - Episode: 434/1000, Reward: 70.000, Step: 70 2022-12-04 00:34:53 - r - INFO: - Episode: 435/1000, Reward: 52.000, Step: 52 2022-12-04 00:34:53 - r - INFO: - Episode: 436/1000, Reward: 23.000, Step: 23 2022-12-04 00:34:53 - r - INFO: - Episode: 437/1000, Reward: 28.000, Step: 28 2022-12-04 00:34:53 - r - INFO: - Episode: 438/1000, Reward: 41.000, Step: 41 2022-12-04 00:34:53 - r - INFO: - Episode: 439/1000, Reward: 61.000, Step: 61 2022-12-04 00:34:53 - r - INFO: - Episode: 440/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:53 - r - INFO: - Episode: 441/1000, Reward: 22.000, Step: 22 2022-12-04 00:34:53 - r - INFO: - Episode: 442/1000, Reward: 99.000, Step: 99 2022-12-04 00:34:53 - r - INFO: - Episode: 443/1000, Reward: 82.000, Step: 82 2022-12-04 00:34:53 - r - INFO: - Episode: 444/1000, Reward: 63.000, Step: 63 2022-12-04 00:34:53 - r - INFO: - Episode: 445/1000, Reward: 68.000, Step: 68 2022-12-04 00:34:53 - r - INFO: - Current episode 445 has the best eval reward: 74.500 2022-12-04 00:34:53 - r - INFO: - Episode: 446/1000, Reward: 51.000, Step: 51 2022-12-04 00:34:53 - r - INFO: - Episode: 447/1000, Reward: 28.000, Step: 28 2022-12-04 00:34:54 - r - INFO: - Episode: 448/1000, Reward: 79.000, Step: 79 2022-12-04 00:34:54 - r - INFO: - Episode: 449/1000, Reward: 61.000, Step: 61 2022-12-04 00:34:54 - r - INFO: - Episode: 450/1000, Reward: 46.000, Step: 46 2022-12-04 00:34:54 - r - INFO: - Episode: 451/1000, Reward: 49.000, Step: 49 2022-12-04 00:34:54 - r - INFO: - Episode: 452/1000, Reward: 110.000, Step: 110 2022-12-04 00:34:54 - r - INFO: - Episode: 453/1000, Reward: 69.000, Step: 69 2022-12-04 00:34:54 - r - INFO: - Episode: 454/1000, Reward: 27.000, Step: 27 2022-12-04 00:34:54 - r - INFO: - Episode: 455/1000, Reward: 52.000, Step: 52 2022-12-04 00:34:54 - r - INFO: - Episode: 456/1000, Reward: 44.000, Step: 44 2022-12-04 00:34:54 - r - INFO: - Episode: 457/1000, Reward: 35.000, Step: 35 2022-12-04 00:34:54 - r - INFO: - Episode: 458/1000, Reward: 25.000, Step: 25 2022-12-04 00:34:54 - r - INFO: - Episode: 459/1000, Reward: 34.000, Step: 34 2022-12-04 00:34:54 - r - INFO: - Episode: 460/1000, Reward: 26.000, Step: 26 2022-12-04 00:34:54 - r - INFO: - Episode: 461/1000, Reward: 34.000, Step: 34 2022-12-04 00:34:54 - r - INFO: - Episode: 462/1000, Reward: 29.000, Step: 29 2022-12-04 00:34:54 - r - INFO: - Episode: 463/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:54 - r - INFO: - Episode: 464/1000, Reward: 28.000, Step: 28 2022-12-04 00:34:54 - r - INFO: - Episode: 465/1000, Reward: 52.000, Step: 52 2022-12-04 00:34:54 - r - INFO: - Episode: 466/1000, Reward: 49.000, Step: 49 2022-12-04 00:34:54 - r - INFO: - Episode: 467/1000, Reward: 31.000, Step: 31 2022-12-04 00:34:54 - r - INFO: - Episode: 468/1000, Reward: 35.000, Step: 35 2022-12-04 00:34:54 - r - INFO: - Episode: 469/1000, Reward: 45.000, Step: 45 2022-12-04 00:34:54 - r - INFO: - Episode: 470/1000, Reward: 55.000, Step: 55 2022-12-04 00:34:55 - r - INFO: - Episode: 471/1000, Reward: 17.000, Step: 17 2022-12-04 00:34:55 - r - INFO: - Episode: 472/1000, Reward: 61.000, Step: 61 2022-12-04 00:34:55 - r - INFO: - Episode: 473/1000, Reward: 55.000, Step: 55 2022-12-04 00:34:55 - r - INFO: - Episode: 474/1000, Reward: 31.000, Step: 31 2022-12-04 00:34:55 - r - INFO: - Episode: 475/1000, Reward: 43.000, Step: 43 2022-12-04 00:34:55 - r - INFO: - Episode: 476/1000, Reward: 77.000, Step: 77 2022-12-04 00:34:55 - r - INFO: - Episode: 477/1000, Reward: 75.000, Step: 75 2022-12-04 00:34:55 - r - INFO: - Episode: 478/1000, Reward: 146.000, Step: 146 2022-12-04 00:34:55 - r - INFO: - Episode: 479/1000, Reward: 19.000, Step: 19 2022-12-04 00:34:55 - r - INFO: - Episode: 480/1000, Reward: 61.000, Step: 61 2022-12-04 00:34:55 - r - INFO: - Episode: 481/1000, Reward: 44.000, Step: 44 2022-12-04 00:34:55 - r - INFO: - Episode: 482/1000, Reward: 53.000, Step: 53 2022-12-04 00:34:55 - r - INFO: - Episode: 483/1000, Reward: 124.000, Step: 124 2022-12-04 00:34:55 - r - INFO: - Episode: 484/1000, Reward: 45.000, Step: 45 2022-12-04 00:34:55 - r - INFO: - Episode: 485/1000, Reward: 97.000, Step: 97 2022-12-04 00:34:55 - r - INFO: - Current episode 485 has the best eval reward: 76.400 2022-12-04 00:34:56 - r - INFO: - Episode: 486/1000, Reward: 98.000, Step: 98 2022-12-04 00:34:56 - r - INFO: - Episode: 487/1000, Reward: 101.000, Step: 101 2022-12-04 00:34:56 - r - INFO: - Episode: 488/1000, Reward: 42.000, Step: 42 2022-12-04 00:34:56 - r - INFO: - Episode: 489/1000, Reward: 86.000, Step: 86 2022-12-04 00:34:56 - r - INFO: - Episode: 490/1000, Reward: 39.000, Step: 39 2022-12-04 00:34:56 - r - INFO: - Current episode 490 has the best eval reward: 96.000 2022-12-04 00:34:56 - r - INFO: - Episode: 491/1000, Reward: 96.000, Step: 96 2022-12-04 00:34:56 - r - INFO: - Episode: 492/1000, Reward: 177.000, Step: 177 2022-12-04 00:34:56 - r - INFO: - Episode: 493/1000, Reward: 46.000, Step: 46 2022-12-04 00:34:56 - r - INFO: - Episode: 494/1000, Reward: 196.000, Step: 196 2022-12-04 00:34:56 - r - INFO: - Episode: 495/1000, Reward: 157.000, Step: 157 2022-12-04 00:34:56 - r - INFO: - Episode: 496/1000, Reward: 34.000, Step: 34 2022-12-04 00:34:56 - r - INFO: - Episode: 497/1000, Reward: 60.000, Step: 60 2022-12-04 00:34:57 - r - INFO: - Episode: 498/1000, Reward: 102.000, Step: 102 2022-12-04 00:34:57 - r - INFO: - Episode: 499/1000, Reward: 53.000, Step: 53 2022-12-04 00:34:57 - r - INFO: - Episode: 500/1000, Reward: 52.000, Step: 52 2022-12-04 00:34:57 - r - INFO: - Episode: 501/1000, Reward: 32.000, Step: 32 2022-12-04 00:34:57 - r - INFO: - Episode: 502/1000, Reward: 114.000, Step: 114 2022-12-04 00:34:57 - r - INFO: - Episode: 503/1000, Reward: 33.000, Step: 33 2022-12-04 00:34:57 - r - INFO: - Episode: 504/1000, Reward: 112.000, Step: 112 2022-12-04 00:34:57 - r - INFO: - Episode: 505/1000, Reward: 59.000, Step: 59 2022-12-04 00:34:57 - r - INFO: - Episode: 506/1000, Reward: 122.000, Step: 122 2022-12-04 00:34:57 - r - INFO: - Episode: 507/1000, Reward: 128.000, Step: 128 2022-12-04 00:34:57 - r - INFO: - Episode: 508/1000, Reward: 99.000, Step: 99 2022-12-04 00:34:57 - r - INFO: - Episode: 509/1000, Reward: 28.000, Step: 28 2022-12-04 00:34:57 - r - INFO: - Episode: 510/1000, Reward: 200.000, Step: 200 2022-12-04 00:34:58 - r - INFO: - Current episode 510 has the best eval reward: 101.700 2022-12-04 00:34:58 - r - INFO: - Episode: 511/1000, Reward: 137.000, Step: 137 2022-12-04 00:34:58 - r - INFO: - Episode: 512/1000, Reward: 24.000, Step: 24 2022-12-04 00:34:58 - r - INFO: - Episode: 513/1000, Reward: 101.000, Step: 101 2022-12-04 00:34:58 - r - INFO: - Episode: 514/1000, Reward: 150.000, Step: 150 2022-12-04 00:34:58 - r - INFO: - Episode: 515/1000, Reward: 15.000, Step: 15 2022-12-04 00:34:58 - r - INFO: - Episode: 516/1000, Reward: 43.000, Step: 43 2022-12-04 00:34:58 - r - INFO: - Episode: 517/1000, Reward: 39.000, Step: 39 2022-12-04 00:34:58 - r - INFO: - Episode: 518/1000, Reward: 43.000, Step: 43 2022-12-04 00:34:58 - r - INFO: - Episode: 519/1000, Reward: 26.000, Step: 26 2022-12-04 00:34:58 - r - INFO: - Episode: 520/1000, Reward: 22.000, Step: 22 2022-12-04 00:34:58 - r - INFO: - Episode: 521/1000, Reward: 51.000, Step: 51 2022-12-04 00:34:58 - r - INFO: - Episode: 522/1000, Reward: 21.000, Step: 21 2022-12-04 00:34:58 - r - INFO: - Episode: 523/1000, Reward: 71.000, Step: 71 2022-12-04 00:34:58 - r - INFO: - Episode: 524/1000, Reward: 53.000, Step: 53 2022-12-04 00:34:58 - r - INFO: - Episode: 525/1000, Reward: 164.000, Step: 164 2022-12-04 00:34:59 - r - INFO: - Episode: 526/1000, Reward: 36.000, Step: 36 2022-12-04 00:34:59 - r - INFO: - Episode: 527/1000, Reward: 97.000, Step: 97 2022-12-04 00:34:59 - r - INFO: - Episode: 528/1000, Reward: 58.000, Step: 58 2022-12-04 00:34:59 - r - INFO: - Episode: 529/1000, Reward: 28.000, Step: 28 2022-12-04 00:34:59 - r - INFO: - Episode: 530/1000, Reward: 116.000, Step: 116 2022-12-04 00:34:59 - r - INFO: - Current episode 530 has the best eval reward: 125.400 2022-12-04 00:34:59 - r - INFO: - Episode: 531/1000, Reward: 123.000, Step: 123 2022-12-04 00:34:59 - r - INFO: - Episode: 532/1000, Reward: 138.000, Step: 138 2022-12-04 00:34:59 - r - INFO: - Episode: 533/1000, Reward: 60.000, Step: 60 2022-12-04 00:34:59 - r - INFO: - Episode: 534/1000, Reward: 126.000, Step: 126 2022-12-04 00:34:59 - r - INFO: - Episode: 535/1000, Reward: 133.000, Step: 133 2022-12-04 00:35:00 - r - INFO: - Current episode 535 has the best eval reward: 128.800 2022-12-04 00:35:00 - r - INFO: - Episode: 536/1000, Reward: 145.000, Step: 145 2022-12-04 00:35:00 - r - INFO: - Episode: 537/1000, Reward: 39.000, Step: 39 2022-12-04 00:35:00 - r - INFO: - Episode: 538/1000, Reward: 64.000, Step: 64 2022-12-04 00:35:00 - r - INFO: - Episode: 539/1000, Reward: 106.000, Step: 106 2022-12-04 00:35:00 - r - INFO: - Episode: 540/1000, Reward: 54.000, Step: 54 2022-12-04 00:35:00 - r - INFO: - Current episode 540 has the best eval reward: 137.700 2022-12-04 00:35:00 - r - INFO: - Episode: 541/1000, Reward: 51.000, Step: 51 2022-12-04 00:35:00 - r - INFO: - Episode: 542/1000, Reward: 131.000, Step: 131 2022-12-04 00:35:00 - r - INFO: - Episode: 543/1000, Reward: 140.000, Step: 140 2022-12-04 00:35:00 - r - INFO: - Episode: 544/1000, Reward: 138.000, Step: 138 2022-12-04 00:35:00 - r - INFO: - Episode: 545/1000, Reward: 123.000, Step: 123 2022-12-04 00:35:01 - r - INFO: - Episode: 546/1000, Reward: 145.000, Step: 145 2022-12-04 00:35:01 - r - INFO: - Episode: 547/1000, Reward: 173.000, Step: 173 2022-12-04 00:35:01 - r - INFO: - Episode: 548/1000, Reward: 77.000, Step: 77 2022-12-04 00:35:01 - r - INFO: - Episode: 549/1000, Reward: 159.000, Step: 159 2022-12-04 00:35:01 - r - INFO: - Episode: 550/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:01 - r - INFO: - Current episode 550 has the best eval reward: 166.700 2022-12-04 00:35:02 - r - INFO: - Episode: 551/1000, Reward: 89.000, Step: 89 2022-12-04 00:35:02 - r - INFO: - Episode: 552/1000, Reward: 180.000, Step: 180 2022-12-04 00:35:02 - r - INFO: - Episode: 553/1000, Reward: 138.000, Step: 138 2022-12-04 00:35:02 - r - INFO: - Episode: 554/1000, Reward: 65.000, Step: 65 2022-12-04 00:35:02 - r - INFO: - Episode: 555/1000, Reward: 64.000, Step: 64 2022-12-04 00:35:02 - r - INFO: - Episode: 556/1000, Reward: 120.000, Step: 120 2022-12-04 00:35:02 - r - INFO: - Episode: 557/1000, Reward: 50.000, Step: 50 2022-12-04 00:35:02 - r - INFO: - Episode: 558/1000, Reward: 105.000, Step: 105 2022-12-04 00:35:02 - r - INFO: - Episode: 559/1000, Reward: 46.000, Step: 46 2022-12-04 00:35:02 - r - INFO: - Episode: 560/1000, Reward: 128.000, Step: 128 2022-12-04 00:35:02 - r - INFO: - Episode: 561/1000, Reward: 62.000, Step: 62 2022-12-04 00:35:03 - r - INFO: - Episode: 562/1000, Reward: 92.000, Step: 92 2022-12-04 00:35:03 - r - INFO: - Episode: 563/1000, Reward: 125.000, Step: 125 2022-12-04 00:35:03 - r - INFO: - Episode: 564/1000, Reward: 62.000, Step: 62 2022-12-04 00:35:03 - r - INFO: - Episode: 565/1000, Reward: 60.000, Step: 60 2022-12-04 00:35:03 - r - INFO: - Episode: 566/1000, Reward: 78.000, Step: 78 2022-12-04 00:35:03 - r - INFO: - Episode: 567/1000, Reward: 48.000, Step: 48 2022-12-04 00:35:03 - r - INFO: - Episode: 568/1000, Reward: 68.000, Step: 68 2022-12-04 00:35:03 - r - INFO: - Episode: 569/1000, Reward: 126.000, Step: 126 2022-12-04 00:35:03 - r - INFO: - Episode: 570/1000, Reward: 75.000, Step: 75 2022-12-04 00:35:03 - r - INFO: - Episode: 571/1000, Reward: 84.000, Step: 84 2022-12-04 00:35:03 - r - INFO: - Episode: 572/1000, Reward: 87.000, Step: 87 2022-12-04 00:35:03 - r - INFO: - Episode: 573/1000, Reward: 68.000, Step: 68 2022-12-04 00:35:03 - r - INFO: - Episode: 574/1000, Reward: 27.000, Step: 27 2022-12-04 00:35:03 - r - INFO: - Episode: 575/1000, Reward: 55.000, Step: 55 2022-12-04 00:35:04 - r - INFO: - Episode: 576/1000, Reward: 123.000, Step: 123 2022-12-04 00:35:04 - r - INFO: - Episode: 577/1000, Reward: 137.000, Step: 137 2022-12-04 00:35:04 - r - INFO: - Episode: 578/1000, Reward: 48.000, Step: 48 2022-12-04 00:35:04 - r - INFO: - Episode: 579/1000, Reward: 17.000, Step: 17 2022-12-04 00:35:04 - r - INFO: - Episode: 580/1000, Reward: 18.000, Step: 18 2022-12-04 00:35:04 - r - INFO: - Episode: 581/1000, Reward: 22.000, Step: 22 2022-12-04 00:35:04 - r - INFO: - Episode: 582/1000, Reward: 26.000, Step: 26 2022-12-04 00:35:04 - r - INFO: - Episode: 583/1000, Reward: 40.000, Step: 40 2022-12-04 00:35:04 - r - INFO: - Episode: 584/1000, Reward: 14.000, Step: 14 2022-12-04 00:35:04 - r - INFO: - Episode: 585/1000, Reward: 130.000, Step: 130 2022-12-04 00:35:04 - r - INFO: - Episode: 586/1000, Reward: 118.000, Step: 118 2022-12-04 00:35:04 - r - INFO: - Episode: 587/1000, Reward: 46.000, Step: 46 2022-12-04 00:35:04 - r - INFO: - Episode: 588/1000, Reward: 125.000, Step: 125 2022-12-04 00:35:05 - r - INFO: - Episode: 589/1000, Reward: 33.000, Step: 33 2022-12-04 00:35:05 - r - INFO: - Episode: 590/1000, Reward: 158.000, Step: 158 2022-12-04 00:35:05 - r - INFO: - Episode: 591/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:05 - r - INFO: - Episode: 592/1000, Reward: 141.000, Step: 141 2022-12-04 00:35:05 - r - INFO: - Episode: 593/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:05 - r - INFO: - Episode: 594/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:05 - r - INFO: - Episode: 595/1000, Reward: 122.000, Step: 122 2022-12-04 00:35:06 - r - INFO: - Episode: 596/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:06 - r - INFO: - Episode: 597/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:06 - r - INFO: - Episode: 598/1000, Reward: 162.000, Step: 162 2022-12-04 00:35:06 - r - INFO: - Episode: 599/1000, Reward: 27.000, Step: 27 2022-12-04 00:35:06 - r - INFO: - Episode: 600/1000, Reward: 18.000, Step: 18 2022-12-04 00:35:06 - r - INFO: - Episode: 601/1000, Reward: 28.000, Step: 28 2022-12-04 00:35:06 - r - INFO: - Episode: 602/1000, Reward: 164.000, Step: 164 2022-12-04 00:35:06 - r - INFO: - Episode: 603/1000, Reward: 18.000, Step: 18 2022-12-04 00:35:06 - r - INFO: - Episode: 604/1000, Reward: 11.000, Step: 11 2022-12-04 00:35:06 - r - INFO: - Episode: 605/1000, Reward: 146.000, Step: 146 2022-12-04 00:35:07 - r - INFO: - Episode: 606/1000, Reward: 128.000, Step: 128 2022-12-04 00:35:07 - r - INFO: - Episode: 607/1000, Reward: 13.000, Step: 13 2022-12-04 00:35:07 - r - INFO: - Episode: 608/1000, Reward: 15.000, Step: 15 2022-12-04 00:35:07 - r - INFO: - Episode: 609/1000, Reward: 131.000, Step: 131 2022-12-04 00:35:07 - r - INFO: - Episode: 610/1000, Reward: 191.000, Step: 191 2022-12-04 00:35:07 - r - INFO: - Episode: 611/1000, Reward: 18.000, Step: 18 2022-12-04 00:35:07 - r - INFO: - Episode: 612/1000, Reward: 101.000, Step: 101 2022-12-04 00:35:07 - r - INFO: - Episode: 613/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:07 - r - INFO: - Episode: 614/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:07 - r - INFO: - Episode: 615/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:08 - r - INFO: - Episode: 616/1000, Reward: 65.000, Step: 65 2022-12-04 00:35:08 - r - INFO: - Episode: 617/1000, Reward: 172.000, Step: 172 2022-12-04 00:35:08 - r - INFO: - Episode: 618/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:08 - r - INFO: - Episode: 619/1000, Reward: 190.000, Step: 190 2022-12-04 00:35:08 - r - INFO: - Episode: 620/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:08 - r - INFO: - Episode: 621/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:09 - r - INFO: - Episode: 622/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:09 - r - INFO: - Episode: 623/1000, Reward: 58.000, Step: 58 2022-12-04 00:35:09 - r - INFO: - Episode: 624/1000, Reward: 57.000, Step: 57 2022-12-04 00:35:09 - r - INFO: - Episode: 625/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:09 - r - INFO: - Episode: 626/1000, Reward: 74.000, Step: 74 2022-12-04 00:35:09 - r - INFO: - Episode: 627/1000, Reward: 61.000, Step: 61 2022-12-04 00:35:09 - r - INFO: - Episode: 628/1000, Reward: 129.000, Step: 129 2022-12-04 00:35:09 - r - INFO: - Episode: 629/1000, Reward: 114.000, Step: 114 2022-12-04 00:35:09 - r - INFO: - Episode: 630/1000, Reward: 157.000, Step: 157 2022-12-04 00:35:10 - r - INFO: - Episode: 631/1000, Reward: 62.000, Step: 62 2022-12-04 00:35:10 - r - INFO: - Episode: 632/1000, Reward: 36.000, Step: 36 2022-12-04 00:35:10 - r - INFO: - Episode: 633/1000, Reward: 37.000, Step: 37 2022-12-04 00:35:10 - r - INFO: - Episode: 634/1000, Reward: 103.000, Step: 103 2022-12-04 00:35:10 - r - INFO: - Episode: 635/1000, Reward: 190.000, Step: 190 2022-12-04 00:35:10 - r - INFO: - Current episode 635 has the best eval reward: 167.400 2022-12-04 00:35:10 - r - INFO: - Episode: 636/1000, Reward: 74.000, Step: 74 2022-12-04 00:35:10 - r - INFO: - Episode: 637/1000, Reward: 141.000, Step: 141 2022-12-04 00:35:10 - r - INFO: - Episode: 638/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:11 - r - INFO: - Episode: 639/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:11 - r - INFO: - Episode: 640/1000, Reward: 143.000, Step: 143 2022-12-04 00:35:11 - r - INFO: - Episode: 641/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:11 - r - INFO: - Episode: 642/1000, Reward: 141.000, Step: 141 2022-12-04 00:35:11 - r - INFO: - Episode: 643/1000, Reward: 135.000, Step: 135 2022-12-04 00:35:11 - r - INFO: - Episode: 644/1000, Reward: 144.000, Step: 144 2022-12-04 00:35:11 - r - INFO: - Episode: 645/1000, Reward: 46.000, Step: 46 2022-12-04 00:35:12 - r - INFO: - Episode: 646/1000, Reward: 59.000, Step: 59 2022-12-04 00:35:12 - r - INFO: - Episode: 647/1000, Reward: 63.000, Step: 63 2022-12-04 00:35:12 - r - INFO: - Episode: 648/1000, Reward: 105.000, Step: 105 2022-12-04 00:35:12 - r - INFO: - Episode: 649/1000, Reward: 101.000, Step: 101 2022-12-04 00:35:12 - r - INFO: - Episode: 650/1000, Reward: 92.000, Step: 92 2022-12-04 00:35:12 - r - INFO: - Episode: 651/1000, Reward: 40.000, Step: 40 2022-12-04 00:35:12 - r - INFO: - Episode: 652/1000, Reward: 40.000, Step: 40 2022-12-04 00:35:12 - r - INFO: - Episode: 653/1000, Reward: 58.000, Step: 58 2022-12-04 00:35:12 - r - INFO: - Episode: 654/1000, Reward: 101.000, Step: 101 2022-12-04 00:35:12 - r - INFO: - Episode: 655/1000, Reward: 38.000, Step: 38 2022-12-04 00:35:12 - r - INFO: - Episode: 656/1000, Reward: 40.000, Step: 40 2022-12-04 00:35:12 - r - INFO: - Episode: 657/1000, Reward: 32.000, Step: 32 2022-12-04 00:35:12 - r - INFO: - Episode: 658/1000, Reward: 50.000, Step: 50 2022-12-04 00:35:12 - r - INFO: - Episode: 659/1000, Reward: 49.000, Step: 49 2022-12-04 00:35:12 - r - INFO: - Episode: 660/1000, Reward: 38.000, Step: 38 2022-12-04 00:35:12 - r - INFO: - Episode: 661/1000, Reward: 61.000, Step: 61 2022-12-04 00:35:12 - r - INFO: - Episode: 662/1000, Reward: 40.000, Step: 40 2022-12-04 00:35:12 - r - INFO: - Episode: 663/1000, Reward: 13.000, Step: 13 2022-12-04 00:35:12 - r - INFO: - Episode: 664/1000, Reward: 44.000, Step: 44 2022-12-04 00:35:12 - r - INFO: - Episode: 665/1000, Reward: 30.000, Step: 30 2022-12-04 00:35:13 - r - INFO: - Episode: 666/1000, Reward: 43.000, Step: 43 2022-12-04 00:35:13 - r - INFO: - Episode: 667/1000, Reward: 37.000, Step: 37 2022-12-04 00:35:13 - r - INFO: - Episode: 668/1000, Reward: 34.000, Step: 34 2022-12-04 00:35:13 - r - INFO: - Episode: 669/1000, Reward: 42.000, Step: 42 2022-12-04 00:35:13 - r - INFO: - Episode: 670/1000, Reward: 35.000, Step: 35 2022-12-04 00:35:13 - r - INFO: - Episode: 671/1000, Reward: 67.000, Step: 67 2022-12-04 00:35:13 - r - INFO: - Episode: 672/1000, Reward: 16.000, Step: 16 2022-12-04 00:35:13 - r - INFO: - Episode: 673/1000, Reward: 41.000, Step: 41 2022-12-04 00:35:13 - r - INFO: - Episode: 674/1000, Reward: 23.000, Step: 23 2022-12-04 00:35:13 - r - INFO: - Episode: 675/1000, Reward: 40.000, Step: 40 2022-12-04 00:35:13 - r - INFO: - Episode: 676/1000, Reward: 37.000, Step: 37 2022-12-04 00:35:13 - r - INFO: - Episode: 677/1000, Reward: 41.000, Step: 41 2022-12-04 00:35:13 - r - INFO: - Episode: 678/1000, Reward: 47.000, Step: 47 2022-12-04 00:35:13 - r - INFO: - Episode: 679/1000, Reward: 87.000, Step: 87 2022-12-04 00:35:13 - r - INFO: - Episode: 680/1000, Reward: 40.000, Step: 40 2022-12-04 00:35:13 - r - INFO: - Episode: 681/1000, Reward: 82.000, Step: 82 2022-12-04 00:35:13 - r - INFO: - Episode: 682/1000, Reward: 50.000, Step: 50 2022-12-04 00:35:13 - r - INFO: - Episode: 683/1000, Reward: 67.000, Step: 67 2022-12-04 00:35:13 - r - INFO: - Episode: 684/1000, Reward: 28.000, Step: 28 2022-12-04 00:35:13 - r - INFO: - Episode: 685/1000, Reward: 144.000, Step: 144 2022-12-04 00:35:14 - r - INFO: - Episode: 686/1000, Reward: 36.000, Step: 36 2022-12-04 00:35:14 - r - INFO: - Episode: 687/1000, Reward: 51.000, Step: 51 2022-12-04 00:35:14 - r - INFO: - Episode: 688/1000, Reward: 69.000, Step: 69 2022-12-04 00:35:14 - r - INFO: - Episode: 689/1000, Reward: 48.000, Step: 48 2022-12-04 00:35:14 - r - INFO: - Episode: 690/1000, Reward: 44.000, Step: 44 2022-12-04 00:35:14 - r - INFO: - Episode: 691/1000, Reward: 46.000, Step: 46 2022-12-04 00:35:14 - r - INFO: - Episode: 692/1000, Reward: 42.000, Step: 42 2022-12-04 00:35:14 - r - INFO: - Episode: 693/1000, Reward: 42.000, Step: 42 2022-12-04 00:35:14 - r - INFO: - Episode: 694/1000, Reward: 41.000, Step: 41 2022-12-04 00:35:14 - r - INFO: - Episode: 695/1000, Reward: 161.000, Step: 161 2022-12-04 00:35:14 - r - INFO: - Episode: 696/1000, Reward: 56.000, Step: 56 2022-12-04 00:35:14 - r - INFO: - Episode: 697/1000, Reward: 66.000, Step: 66 2022-12-04 00:35:14 - r - INFO: - Episode: 698/1000, Reward: 63.000, Step: 63 2022-12-04 00:35:14 - r - INFO: - Episode: 699/1000, Reward: 98.000, Step: 98 2022-12-04 00:35:14 - r - INFO: - Episode: 700/1000, Reward: 130.000, Step: 130 2022-12-04 00:35:15 - r - INFO: - Episode: 701/1000, Reward: 54.000, Step: 54 2022-12-04 00:35:15 - r - INFO: - Episode: 702/1000, Reward: 125.000, Step: 125 2022-12-04 00:35:15 - r - INFO: - Episode: 703/1000, Reward: 75.000, Step: 75 2022-12-04 00:35:15 - r - INFO: - Episode: 704/1000, Reward: 115.000, Step: 115 2022-12-04 00:35:15 - r - INFO: - Episode: 705/1000, Reward: 110.000, Step: 110 2022-12-04 00:35:15 - r - INFO: - Episode: 706/1000, Reward: 73.000, Step: 73 2022-12-04 00:35:15 - r - INFO: - Episode: 707/1000, Reward: 120.000, Step: 120 2022-12-04 00:35:15 - r - INFO: - Episode: 708/1000, Reward: 62.000, Step: 62 2022-12-04 00:35:15 - r - INFO: - Episode: 709/1000, Reward: 134.000, Step: 134 2022-12-04 00:35:15 - r - INFO: - Episode: 710/1000, Reward: 53.000, Step: 53 2022-12-04 00:35:15 - r - INFO: - Episode: 711/1000, Reward: 45.000, Step: 45 2022-12-04 00:35:15 - r - INFO: - Episode: 712/1000, Reward: 82.000, Step: 82 2022-12-04 00:35:15 - r - INFO: - Episode: 713/1000, Reward: 47.000, Step: 47 2022-12-04 00:35:15 - r - INFO: - Episode: 714/1000, Reward: 60.000, Step: 60 2022-12-04 00:35:16 - r - INFO: - Episode: 715/1000, Reward: 121.000, Step: 121 2022-12-04 00:35:16 - r - INFO: - Episode: 716/1000, Reward: 100.000, Step: 100 2022-12-04 00:35:16 - r - INFO: - Episode: 717/1000, Reward: 29.000, Step: 29 2022-12-04 00:35:16 - r - INFO: - Episode: 718/1000, Reward: 33.000, Step: 33 2022-12-04 00:35:16 - r - INFO: - Episode: 719/1000, Reward: 60.000, Step: 60 2022-12-04 00:35:16 - r - INFO: - Episode: 720/1000, Reward: 117.000, Step: 117 2022-12-04 00:35:16 - r - INFO: - Episode: 721/1000, Reward: 71.000, Step: 71 2022-12-04 00:35:16 - r - INFO: - Episode: 722/1000, Reward: 15.000, Step: 15 2022-12-04 00:35:16 - r - INFO: - Episode: 723/1000, Reward: 130.000, Step: 130 2022-12-04 00:35:16 - r - INFO: - Episode: 724/1000, Reward: 115.000, Step: 115 2022-12-04 00:35:16 - r - INFO: - Episode: 725/1000, Reward: 27.000, Step: 27 2022-12-04 00:35:16 - r - INFO: - Episode: 726/1000, Reward: 28.000, Step: 28 2022-12-04 00:35:16 - r - INFO: - Episode: 727/1000, Reward: 19.000, Step: 19 2022-12-04 00:35:16 - r - INFO: - Episode: 728/1000, Reward: 22.000, Step: 22 2022-12-04 00:35:16 - r - INFO: - Episode: 729/1000, Reward: 22.000, Step: 22 2022-12-04 00:35:16 - r - INFO: - Episode: 730/1000, Reward: 21.000, Step: 21 2022-12-04 00:35:16 - r - INFO: - Episode: 731/1000, Reward: 14.000, Step: 14 2022-12-04 00:35:16 - r - INFO: - Episode: 732/1000, Reward: 22.000, Step: 22 2022-12-04 00:35:16 - r - INFO: - Episode: 733/1000, Reward: 16.000, Step: 16 2022-12-04 00:35:16 - r - INFO: - Episode: 734/1000, Reward: 21.000, Step: 21 2022-12-04 00:35:16 - r - INFO: - Episode: 735/1000, Reward: 18.000, Step: 18 2022-12-04 00:35:17 - r - INFO: - Episode: 736/1000, Reward: 21.000, Step: 21 2022-12-04 00:35:17 - r - INFO: - Episode: 737/1000, Reward: 17.000, Step: 17 2022-12-04 00:35:17 - r - INFO: - Episode: 738/1000, Reward: 16.000, Step: 16 2022-12-04 00:35:17 - r - INFO: - Episode: 739/1000, Reward: 97.000, Step: 97 2022-12-04 00:35:17 - r - INFO: - Episode: 740/1000, Reward: 20.000, Step: 20 2022-12-04 00:35:17 - r - INFO: - Episode: 741/1000, Reward: 15.000, Step: 15 2022-12-04 00:35:17 - r - INFO: - Episode: 742/1000, Reward: 17.000, Step: 17 2022-12-04 00:35:17 - r - INFO: - Episode: 743/1000, Reward: 14.000, Step: 14 2022-12-04 00:35:17 - r - INFO: - Episode: 744/1000, Reward: 20.000, Step: 20 2022-12-04 00:35:17 - r - INFO: - Episode: 745/1000, Reward: 20.000, Step: 20 2022-12-04 00:35:17 - r - INFO: - Episode: 746/1000, Reward: 13.000, Step: 13 2022-12-04 00:35:17 - r - INFO: - Episode: 747/1000, Reward: 17.000, Step: 17 2022-12-04 00:35:17 - r - INFO: - Episode: 748/1000, Reward: 18.000, Step: 18 2022-12-04 00:35:17 - r - INFO: - Episode: 749/1000, Reward: 30.000, Step: 30 2022-12-04 00:35:17 - r - INFO: - Episode: 750/1000, Reward: 125.000, Step: 125 2022-12-04 00:35:17 - r - INFO: - Episode: 751/1000, Reward: 25.000, Step: 25 2022-12-04 00:35:17 - r - INFO: - Episode: 752/1000, Reward: 117.000, Step: 117 2022-12-04 00:35:17 - r - INFO: - Episode: 753/1000, Reward: 94.000, Step: 94 2022-12-04 00:35:17 - r - INFO: - Episode: 754/1000, Reward: 134.000, Step: 134 2022-12-04 00:35:17 - r - INFO: - Episode: 755/1000, Reward: 22.000, Step: 22 2022-12-04 00:35:17 - r - INFO: - Episode: 756/1000, Reward: 101.000, Step: 101 2022-12-04 00:35:17 - r - INFO: - Episode: 757/1000, Reward: 134.000, Step: 134 2022-12-04 00:35:17 - r - INFO: - Episode: 758/1000, Reward: 98.000, Step: 98 2022-12-04 00:35:18 - r - INFO: - Episode: 759/1000, Reward: 167.000, Step: 167 2022-12-04 00:35:18 - r - INFO: - Episode: 760/1000, Reward: 137.000, Step: 137 2022-12-04 00:35:18 - r - INFO: - Episode: 761/1000, Reward: 153.000, Step: 153 2022-12-04 00:35:18 - r - INFO: - Episode: 762/1000, Reward: 125.000, Step: 125 2022-12-04 00:35:18 - r - INFO: - Episode: 763/1000, Reward: 146.000, Step: 146 2022-12-04 00:35:18 - r - INFO: - Episode: 764/1000, Reward: 123.000, Step: 123 2022-12-04 00:35:18 - r - INFO: - Episode: 765/1000, Reward: 131.000, Step: 131 2022-12-04 00:35:18 - r - INFO: - Episode: 766/1000, Reward: 123.000, Step: 123 2022-12-04 00:35:19 - r - INFO: - Episode: 767/1000, Reward: 38.000, Step: 38 2022-12-04 00:35:19 - r - INFO: - Episode: 768/1000, Reward: 30.000, Step: 30 2022-12-04 00:35:19 - r - INFO: - Episode: 769/1000, Reward: 126.000, Step: 126 2022-12-04 00:35:19 - r - INFO: - Episode: 770/1000, Reward: 128.000, Step: 128 2022-12-04 00:35:19 - r - INFO: - Episode: 771/1000, Reward: 178.000, Step: 178 2022-12-04 00:35:19 - r - INFO: - Episode: 772/1000, Reward: 164.000, Step: 164 2022-12-04 00:35:19 - r - INFO: - Episode: 773/1000, Reward: 145.000, Step: 145 2022-12-04 00:35:19 - r - INFO: - Episode: 774/1000, Reward: 175.000, Step: 175 2022-12-04 00:35:19 - r - INFO: - Episode: 775/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:20 - r - INFO: - Current episode 775 has the best eval reward: 200.000 2022-12-04 00:35:20 - r - INFO: - Episode: 776/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:20 - r - INFO: - Episode: 777/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:20 - r - INFO: - Episode: 778/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:20 - r - INFO: - Episode: 779/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:20 - r - INFO: - Episode: 780/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:21 - r - INFO: - Episode: 781/1000, Reward: 161.000, Step: 161 2022-12-04 00:35:21 - r - INFO: - Episode: 782/1000, Reward: 124.000, Step: 124 2022-12-04 00:35:21 - r - INFO: - Episode: 783/1000, Reward: 110.000, Step: 110 2022-12-04 00:35:21 - r - INFO: - Episode: 784/1000, Reward: 79.000, Step: 79 2022-12-04 00:35:21 - r - INFO: - Episode: 785/1000, Reward: 107.000, Step: 107 2022-12-04 00:35:21 - r - INFO: - Episode: 786/1000, Reward: 88.000, Step: 88 2022-12-04 00:35:22 - r - INFO: - Episode: 787/1000, Reward: 79.000, Step: 79 2022-12-04 00:35:22 - r - INFO: - Episode: 788/1000, Reward: 113.000, Step: 113 2022-12-04 00:35:22 - r - INFO: - Episode: 789/1000, Reward: 104.000, Step: 104 2022-12-04 00:35:22 - r - INFO: - Episode: 790/1000, Reward: 122.000, Step: 122 2022-12-04 00:35:22 - r - INFO: - Episode: 791/1000, Reward: 135.000, Step: 135 2022-12-04 00:35:22 - r - INFO: - Episode: 792/1000, Reward: 18.000, Step: 18 2022-12-04 00:35:22 - r - INFO: - Episode: 793/1000, Reward: 117.000, Step: 117 2022-12-04 00:35:22 - r - INFO: - Episode: 794/1000, Reward: 99.000, Step: 99 2022-12-04 00:35:23 - r - INFO: - Episode: 795/1000, Reward: 103.000, Step: 103 2022-12-04 00:35:23 - r - INFO: - Episode: 796/1000, Reward: 35.000, Step: 35 2022-12-04 00:35:23 - r - INFO: - Episode: 797/1000, Reward: 85.000, Step: 85 2022-12-04 00:35:23 - r - INFO: - Episode: 798/1000, Reward: 68.000, Step: 68 2022-12-04 00:35:23 - r - INFO: - Episode: 799/1000, Reward: 79.000, Step: 79 2022-12-04 00:35:23 - r - INFO: - Episode: 800/1000, Reward: 104.000, Step: 104 2022-12-04 00:35:23 - r - INFO: - Episode: 801/1000, Reward: 100.000, Step: 100 2022-12-04 00:35:23 - r - INFO: - Episode: 802/1000, Reward: 143.000, Step: 143 2022-12-04 00:35:23 - r - INFO: - Episode: 803/1000, Reward: 184.000, Step: 184 2022-12-04 00:35:23 - r - INFO: - Episode: 804/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:24 - r - INFO: - Episode: 805/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:24 - r - INFO: - Current episode 805 has the best eval reward: 200.000 2022-12-04 00:35:24 - r - INFO: - Episode: 806/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:24 - r - INFO: - Episode: 807/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:24 - r - INFO: - Episode: 808/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:24 - r - INFO: - Episode: 809/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:25 - r - INFO: - Episode: 810/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:25 - r - INFO: - Current episode 810 has the best eval reward: 200.000 2022-12-04 00:35:25 - r - INFO: - Episode: 811/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:25 - r - INFO: - Episode: 812/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:25 - r - INFO: - Episode: 813/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:25 - r - INFO: - Episode: 814/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:26 - r - INFO: - Episode: 815/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:26 - r - INFO: - Current episode 815 has the best eval reward: 200.000 2022-12-04 00:35:26 - r - INFO: - Episode: 816/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:26 - r - INFO: - Episode: 817/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:26 - r - INFO: - Episode: 818/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:26 - r - INFO: - Episode: 819/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:27 - r - INFO: - Episode: 820/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:27 - r - INFO: - Current episode 820 has the best eval reward: 200.000 2022-12-04 00:35:27 - r - INFO: - Episode: 821/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:27 - r - INFO: - Episode: 822/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:27 - r - INFO: - Episode: 823/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:27 - r - INFO: - Episode: 824/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:28 - r - INFO: - Episode: 825/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:28 - r - INFO: - Current episode 825 has the best eval reward: 200.000 2022-12-04 00:35:28 - r - INFO: - Episode: 826/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:28 - r - INFO: - Episode: 827/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:28 - r - INFO: - Episode: 828/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:28 - r - INFO: - Episode: 829/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:29 - r - INFO: - Episode: 830/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:29 - r - INFO: - Current episode 830 has the best eval reward: 200.000 2022-12-04 00:35:29 - r - INFO: - Episode: 831/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:29 - r - INFO: - Episode: 832/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:29 - r - INFO: - Episode: 833/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:29 - r - INFO: - Episode: 834/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:30 - r - INFO: - Episode: 835/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:30 - r - INFO: - Current episode 835 has the best eval reward: 200.000 2022-12-04 00:35:30 - r - INFO: - Episode: 836/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:30 - r - INFO: - Episode: 837/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:31 - r - INFO: - Episode: 838/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:31 - r - INFO: - Episode: 839/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:31 - r - INFO: - Episode: 840/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:31 - r - INFO: - Current episode 840 has the best eval reward: 200.000 2022-12-04 00:35:31 - r - INFO: - Episode: 841/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:32 - r - INFO: - Episode: 842/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:32 - r - INFO: - Episode: 843/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:32 - r - INFO: - Episode: 844/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:32 - r - INFO: - Episode: 845/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:32 - r - INFO: - Current episode 845 has the best eval reward: 200.000 2022-12-04 00:35:32 - r - INFO: - Episode: 846/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:33 - r - INFO: - Episode: 847/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:33 - r - INFO: - Episode: 848/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:33 - r - INFO: - Episode: 849/1000, Reward: 192.000, Step: 192 2022-12-04 00:35:33 - r - INFO: - Episode: 850/1000, Reward: 184.000, Step: 184 2022-12-04 00:35:33 - r - INFO: - Episode: 851/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:34 - r - INFO: - Episode: 852/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:34 - r - INFO: - Episode: 853/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:34 - r - INFO: - Episode: 854/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:34 - r - INFO: - Episode: 855/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:35 - r - INFO: - Episode: 856/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:35 - r - INFO: - Episode: 857/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:35 - r - INFO: - Episode: 858/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:35 - r - INFO: - Episode: 859/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:36 - r - INFO: - Episode: 860/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:36 - r - INFO: - Current episode 860 has the best eval reward: 200.000 2022-12-04 00:35:36 - r - INFO: - Episode: 861/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:37 - r - INFO: - Episode: 862/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:37 - r - INFO: - Episode: 863/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:37 - r - INFO: - Episode: 864/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:37 - r - INFO: - Episode: 865/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:38 - r - INFO: - Current episode 865 has the best eval reward: 200.000 2022-12-04 00:35:38 - r - INFO: - Episode: 866/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:38 - r - INFO: - Episode: 867/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:38 - r - INFO: - Episode: 868/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:38 - r - INFO: - Episode: 869/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:38 - r - INFO: - Episode: 870/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:39 - r - INFO: - Episode: 871/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:39 - r - INFO: - Episode: 872/1000, Reward: 190.000, Step: 190 2022-12-04 00:35:39 - r - INFO: - Episode: 873/1000, Reward: 124.000, Step: 124 2022-12-04 00:35:39 - r - INFO: - Episode: 874/1000, Reward: 133.000, Step: 133 2022-12-04 00:35:40 - r - INFO: - Episode: 875/1000, Reward: 161.000, Step: 161 2022-12-04 00:35:40 - r - INFO: - Episode: 876/1000, Reward: 21.000, Step: 21 2022-12-04 00:35:40 - r - INFO: - Episode: 877/1000, Reward: 139.000, Step: 139 2022-12-04 00:35:40 - r - INFO: - Episode: 878/1000, Reward: 128.000, Step: 128 2022-12-04 00:35:40 - r - INFO: - Episode: 879/1000, Reward: 122.000, Step: 122 2022-12-04 00:35:40 - r - INFO: - Episode: 880/1000, Reward: 170.000, Step: 170 2022-12-04 00:35:41 - r - INFO: - Episode: 881/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:41 - r - INFO: - Episode: 882/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:41 - r - INFO: - Episode: 883/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:41 - r - INFO: - Episode: 884/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:41 - r - INFO: - Episode: 885/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:42 - r - INFO: - Episode: 886/1000, Reward: 106.000, Step: 106 2022-12-04 00:35:42 - r - INFO: - Episode: 887/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:42 - r - INFO: - Episode: 888/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:42 - r - INFO: - Episode: 889/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:42 - r - INFO: - Episode: 890/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:42 - r - INFO: - Current episode 890 has the best eval reward: 200.000 2022-12-04 00:35:43 - r - INFO: - Episode: 891/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:43 - r - INFO: - Episode: 892/1000, Reward: 169.000, Step: 169 2022-12-04 00:35:43 - r - INFO: - Episode: 893/1000, Reward: 132.000, Step: 132 2022-12-04 00:35:43 - r - INFO: - Episode: 894/1000, Reward: 18.000, Step: 18 2022-12-04 00:35:43 - r - INFO: - Episode: 895/1000, Reward: 132.000, Step: 132 2022-12-04 00:35:43 - r - INFO: - Episode: 896/1000, Reward: 150.000, Step: 150 2022-12-04 00:35:43 - r - INFO: - Episode: 897/1000, Reward: 25.000, Step: 25 2022-12-04 00:35:43 - r - INFO: - Episode: 898/1000, Reward: 161.000, Step: 161 2022-12-04 00:35:43 - r - INFO: - Episode: 899/1000, Reward: 187.000, Step: 187 2022-12-04 00:35:44 - r - INFO: - Episode: 900/1000, Reward: 161.000, Step: 161 2022-12-04 00:35:44 - r - INFO: - Episode: 901/1000, Reward: 146.000, Step: 146 2022-12-04 00:35:44 - r - INFO: - Episode: 902/1000, Reward: 19.000, Step: 19 2022-12-04 00:35:44 - r - INFO: - Episode: 903/1000, Reward: 119.000, Step: 119 2022-12-04 00:35:44 - r - INFO: - Episode: 904/1000, Reward: 18.000, Step: 18 2022-12-04 00:35:44 - r - INFO: - Episode: 905/1000, Reward: 18.000, Step: 18 2022-12-04 00:35:44 - r - INFO: - Episode: 906/1000, Reward: 39.000, Step: 39 2022-12-04 00:35:44 - r - INFO: - Episode: 907/1000, Reward: 139.000, Step: 139 2022-12-04 00:35:44 - r - INFO: - Episode: 908/1000, Reward: 14.000, Step: 14 2022-12-04 00:35:44 - r - INFO: - Episode: 909/1000, Reward: 129.000, Step: 129 2022-12-04 00:35:44 - r - INFO: - Episode: 910/1000, Reward: 12.000, Step: 12 2022-12-04 00:35:45 - r - INFO: - Episode: 911/1000, Reward: 129.000, Step: 129 2022-12-04 00:35:45 - r - INFO: - Episode: 912/1000, Reward: 112.000, Step: 112 2022-12-04 00:35:45 - r - INFO: - Episode: 913/1000, Reward: 122.000, Step: 122 2022-12-04 00:35:45 - r - INFO: - Episode: 914/1000, Reward: 161.000, Step: 161 2022-12-04 00:35:45 - r - INFO: - Episode: 915/1000, Reward: 174.000, Step: 174 2022-12-04 00:35:45 - r - INFO: - Episode: 916/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:46 - r - INFO: - Episode: 917/1000, Reward: 198.000, Step: 198 2022-12-04 00:35:46 - r - INFO: - Episode: 918/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:46 - r - INFO: - Episode: 919/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:46 - r - INFO: - Episode: 920/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:46 - r - INFO: - Episode: 921/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:47 - r - INFO: - Episode: 922/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:47 - r - INFO: - Episode: 923/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:47 - r - INFO: - Episode: 924/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:47 - r - INFO: - Episode: 925/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:47 - r - INFO: - Episode: 926/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:47 - r - INFO: - Episode: 927/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:48 - r - INFO: - Episode: 928/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:48 - r - INFO: - Episode: 929/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:48 - r - INFO: - Episode: 930/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:48 - r - INFO: - Current episode 930 has the best eval reward: 200.000 2022-12-04 00:35:48 - r - INFO: - Episode: 931/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:48 - r - INFO: - Episode: 932/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:49 - r - INFO: - Episode: 933/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:49 - r - INFO: - Episode: 934/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:49 - r - INFO: - Episode: 935/1000, Reward: 22.000, Step: 22 2022-12-04 00:35:49 - r - INFO: - Episode: 936/1000, Reward: 187.000, Step: 187 2022-12-04 00:35:49 - r - INFO: - Episode: 937/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:49 - r - INFO: - Episode: 938/1000, Reward: 186.000, Step: 186 2022-12-04 00:35:49 - r - INFO: - Episode: 939/1000, Reward: 183.000, Step: 183 2022-12-04 00:35:50 - r - INFO: - Episode: 940/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:50 - r - INFO: - Current episode 940 has the best eval reward: 200.000 2022-12-04 00:35:50 - r - INFO: - Episode: 941/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:50 - r - INFO: - Episode: 942/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:50 - r - INFO: - Episode: 943/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:50 - r - INFO: - Episode: 944/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:50 - r - INFO: - Episode: 945/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:51 - r - INFO: - Current episode 945 has the best eval reward: 200.000 2022-12-04 00:35:51 - r - INFO: - Episode: 946/1000, Reward: 88.000, Step: 88 2022-12-04 00:35:51 - r - INFO: - Episode: 947/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:51 - r - INFO: - Episode: 948/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:51 - r - INFO: - Episode: 949/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:51 - r - INFO: - Episode: 950/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:52 - r - INFO: - Current episode 950 has the best eval reward: 200.000 2022-12-04 00:35:52 - r - INFO: - Episode: 951/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:52 - r - INFO: - Episode: 952/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:52 - r - INFO: - Episode: 953/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:52 - r - INFO: - Episode: 954/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:52 - r - INFO: - Episode: 955/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:53 - r - INFO: - Current episode 955 has the best eval reward: 200.000 2022-12-04 00:35:53 - r - INFO: - Episode: 956/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:53 - r - INFO: - Episode: 957/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:53 - r - INFO: - Episode: 958/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:53 - r - INFO: - Episode: 959/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:53 - r - INFO: - Episode: 960/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:54 - r - INFO: - Current episode 960 has the best eval reward: 200.000 2022-12-04 00:35:54 - r - INFO: - Episode: 961/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:54 - r - INFO: - Episode: 962/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:54 - r - INFO: - Episode: 963/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:54 - r - INFO: - Episode: 964/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:54 - r - INFO: - Episode: 965/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:55 - r - INFO: - Episode: 966/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:55 - r - INFO: - Episode: 967/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:55 - r - INFO: - Episode: 968/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:55 - r - INFO: - Episode: 969/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:55 - r - INFO: - Episode: 970/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:56 - r - INFO: - Episode: 971/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:56 - r - INFO: - Episode: 972/1000, Reward: 22.000, Step: 22 2022-12-04 00:35:56 - r - INFO: - Episode: 973/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:56 - r - INFO: - Episode: 974/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:56 - r - INFO: - Episode: 975/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:56 - r - INFO: - Episode: 976/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:57 - r - INFO: - Episode: 977/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:57 - r - INFO: - Episode: 978/1000, Reward: 142.000, Step: 142 2022-12-04 00:35:57 - r - INFO: - Episode: 979/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:57 - r - INFO: - Episode: 980/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:57 - r - INFO: - Episode: 981/1000, Reward: 179.000, Step: 179 2022-12-04 00:35:58 - r - INFO: - Episode: 982/1000, Reward: 140.000, Step: 140 2022-12-04 00:35:58 - r - INFO: - Episode: 983/1000, Reward: 109.000, Step: 109 2022-12-04 00:35:58 - r - INFO: - Episode: 984/1000, Reward: 114.000, Step: 114 2022-12-04 00:35:58 - r - INFO: - Episode: 985/1000, Reward: 14.000, Step: 14 2022-12-04 00:35:58 - r - INFO: - Episode: 986/1000, Reward: 25.000, Step: 25 2022-12-04 00:35:58 - r - INFO: - Episode: 987/1000, Reward: 12.000, Step: 12 2022-12-04 00:35:58 - r - INFO: - Episode: 988/1000, Reward: 129.000, Step: 129 2022-12-04 00:35:58 - r - INFO: - Episode: 989/1000, Reward: 150.000, Step: 150 2022-12-04 00:35:58 - r - INFO: - Episode: 990/1000, Reward: 140.000, Step: 140 2022-12-04 00:35:58 - r - INFO: - Episode: 991/1000, Reward: 178.000, Step: 178 2022-12-04 00:35:59 - r - INFO: - Episode: 992/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:59 - r - INFO: - Episode: 993/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:59 - r - INFO: - Episode: 994/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:59 - r - INFO: - Episode: 995/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:59 - r - INFO: - Current episode 995 has the best eval reward: 200.000 2022-12-04 00:35:59 - r - INFO: - Episode: 996/1000, Reward: 200.000, Step: 200 2022-12-04 00:35:59 - r - INFO: - Episode: 997/1000, Reward: 197.000, Step: 197 2022-12-04 00:36:00 - r - INFO: - Episode: 998/1000, Reward: 163.000, Step: 163 2022-12-04 00:36:00 - r - INFO: - Episode: 999/1000, Reward: 169.000, Step: 169 2022-12-04 00:36:00 - r - INFO: - Episode: 1000/1000, Reward: 12.000, Step: 12 2022-12-04 00:36:00 - r - INFO: - Finish training!