johnjim0816's picture
update CartPole-v1 NoisyDQN
54d82df
raw
history blame
126 kB
2022-12-07 16:09:45 - r - INFO: - Hyperparameters:
2022-12-07 16:09:45 - r - INFO: - ================================================================================
2022-12-07 16:09:45 - r - INFO: - Name Value Type
2022-12-07 16:09:45 - r - INFO: - env_name CartPole-v1 <class 'str'>
2022-12-07 16:09:45 - r - INFO: - new_step_api 1 <class 'bool'>
2022-12-07 16:09:45 - r - INFO: - wrapper None <class 'str'>
2022-12-07 16:09:45 - r - INFO: - render 0 <class 'bool'>
2022-12-07 16:09:45 - r - INFO: - algo_name GAIL <class 'str'>
2022-12-07 16:09:45 - r - INFO: - mode train <class 'str'>
2022-12-07 16:09:45 - r - INFO: - seed 1 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - device cuda <class 'str'>
2022-12-07 16:09:45 - r - INFO: - train_eps 1500 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - test_eps 10 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - eval_eps 10 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - eval_per_episode 5 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - max_steps 200 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - load_checkpoint 0 <class 'bool'>
2022-12-07 16:09:45 - r - INFO: - load_path Collect_CartPole-v1_PPO_20221206-173222 <class 'str'>
2022-12-07 16:09:45 - r - INFO: - show_fig 0 <class 'bool'>
2022-12-07 16:09:45 - r - INFO: - save_fig 1 <class 'bool'>
2022-12-07 16:09:45 - r - INFO: - adversarial_batch_size 128 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - adversarial_epochs 5 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - batch_size 2048 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - discount 0.99 <class 'float'>
2022-12-07 16:09:45 - r - INFO: - num_workers 8 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - hidden_dim 32 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - lr 0.001 <class 'float'>
2022-12-07 16:09:45 - r - INFO: - imitation_replay_size 4 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - r1_reg_coeff 1 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - ppo_epochs 5 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - gamma 0.99 <class 'float'>
2022-12-07 16:09:45 - r - INFO: - k_epochs 4 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - actor_lr 0.0003 <class 'float'>
2022-12-07 16:09:45 - r - INFO: - critic_lr 0.0003 <class 'float'>
2022-12-07 16:09:45 - r - INFO: - eps_clip 0.2 <class 'float'>
2022-12-07 16:09:45 - r - INFO: - entropy_coef 0.01 <class 'float'>
2022-12-07 16:09:45 - r - INFO: - update_freq 2048 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - actor_hidden_dim 256 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - critic_hidden_dim 256 <class 'int'>
2022-12-07 16:09:45 - r - INFO: - ================================================================================
2022-12-07 16:09:46 - r - INFO: - n_states: 4, n_actions: 2
2022-12-07 16:09:46 - r - INFO: - Start training!
2022-12-07 16:09:46 - r - INFO: - Env: CartPole-v1, Algorithm: GAIL, Device: cuda
2022-12-07 16:09:48 - r - INFO: - Episode: 1/1500, Reward: 25.000, Step: 25
2022-12-07 16:09:48 - r - INFO: - Episode: 2/1500, Reward: 15.000, Step: 15
2022-12-07 16:09:48 - r - INFO: - Episode: 3/1500, Reward: 13.000, Step: 13
2022-12-07 16:09:48 - r - INFO: - Episode: 4/1500, Reward: 14.000, Step: 14
2022-12-07 16:09:48 - r - INFO: - Episode: 5/1500, Reward: 25.000, Step: 25
2022-12-07 16:09:49 - r - INFO: - Current episode 5 has the best eval reward: 23.900
2022-12-07 16:09:49 - r - INFO: - Episode: 6/1500, Reward: 41.000, Step: 41
2022-12-07 16:09:49 - r - INFO: - Episode: 7/1500, Reward: 33.000, Step: 33
2022-12-07 16:09:49 - r - INFO: - Episode: 8/1500, Reward: 12.000, Step: 12
2022-12-07 16:09:49 - r - INFO: - Episode: 9/1500, Reward: 20.000, Step: 20
2022-12-07 16:09:49 - r - INFO: - Episode: 10/1500, Reward: 33.000, Step: 33
2022-12-07 16:09:49 - r - INFO: - Current episode 10 has the best eval reward: 27.400
2022-12-07 16:09:49 - r - INFO: - Episode: 11/1500, Reward: 19.000, Step: 19
2022-12-07 16:09:50 - r - INFO: - Episode: 12/1500, Reward: 35.000, Step: 35
2022-12-07 16:09:50 - r - INFO: - Episode: 13/1500, Reward: 22.000, Step: 22
2022-12-07 16:09:50 - r - INFO: - Episode: 14/1500, Reward: 9.000, Step: 9
2022-12-07 16:09:50 - r - INFO: - Episode: 15/1500, Reward: 17.000, Step: 17
2022-12-07 16:09:50 - r - INFO: - Episode: 16/1500, Reward: 36.000, Step: 36
2022-12-07 16:09:50 - r - INFO: - Episode: 17/1500, Reward: 16.000, Step: 16
2022-12-07 16:09:50 - r - INFO: - Episode: 18/1500, Reward: 18.000, Step: 18
2022-12-07 16:09:50 - r - INFO: - Episode: 19/1500, Reward: 34.000, Step: 34
2022-12-07 16:09:50 - r - INFO: - Episode: 20/1500, Reward: 11.000, Step: 11
2022-12-07 16:09:51 - r - INFO: - Episode: 21/1500, Reward: 21.000, Step: 21
2022-12-07 16:09:51 - r - INFO: - Episode: 22/1500, Reward: 16.000, Step: 16
2022-12-07 16:09:51 - r - INFO: - Episode: 23/1500, Reward: 17.000, Step: 17
2022-12-07 16:09:51 - r - INFO: - Episode: 24/1500, Reward: 13.000, Step: 13
2022-12-07 16:09:51 - r - INFO: - Episode: 25/1500, Reward: 20.000, Step: 20
2022-12-07 16:09:51 - r - INFO: - Current episode 25 has the best eval reward: 30.400
2022-12-07 16:09:51 - r - INFO: - Episode: 26/1500, Reward: 18.000, Step: 18
2022-12-07 16:09:51 - r - INFO: - Episode: 27/1500, Reward: 18.000, Step: 18
2022-12-07 16:09:51 - r - INFO: - Episode: 28/1500, Reward: 28.000, Step: 28
2022-12-07 16:09:51 - r - INFO: - Episode: 29/1500, Reward: 12.000, Step: 12
2022-12-07 16:09:51 - r - INFO: - Episode: 30/1500, Reward: 17.000, Step: 17
2022-12-07 16:09:52 - r - INFO: - Episode: 31/1500, Reward: 10.000, Step: 10
2022-12-07 16:09:52 - r - INFO: - Episode: 32/1500, Reward: 56.000, Step: 56
2022-12-07 16:09:52 - r - INFO: - Episode: 33/1500, Reward: 45.000, Step: 45
2022-12-07 16:09:52 - r - INFO: - Episode: 34/1500, Reward: 11.000, Step: 11
2022-12-07 16:09:52 - r - INFO: - Episode: 35/1500, Reward: 19.000, Step: 19
2022-12-07 16:09:52 - r - INFO: - Episode: 36/1500, Reward: 13.000, Step: 13
2022-12-07 16:09:52 - r - INFO: - Episode: 37/1500, Reward: 30.000, Step: 30
2022-12-07 16:09:52 - r - INFO: - Episode: 38/1500, Reward: 13.000, Step: 13
2022-12-07 16:09:53 - r - INFO: - Episode: 39/1500, Reward: 21.000, Step: 21
2022-12-07 16:09:53 - r - INFO: - Episode: 40/1500, Reward: 15.000, Step: 15
2022-12-07 16:09:53 - r - INFO: - Episode: 41/1500, Reward: 12.000, Step: 12
2022-12-07 16:09:53 - r - INFO: - Episode: 42/1500, Reward: 21.000, Step: 21
2022-12-07 16:09:53 - r - INFO: - Episode: 43/1500, Reward: 9.000, Step: 9
2022-12-07 16:09:53 - r - INFO: - Episode: 44/1500, Reward: 26.000, Step: 26
2022-12-07 16:09:53 - r - INFO: - Episode: 45/1500, Reward: 19.000, Step: 19
2022-12-07 16:09:53 - r - INFO: - Episode: 46/1500, Reward: 12.000, Step: 12
2022-12-07 16:09:54 - r - INFO: - Episode: 47/1500, Reward: 14.000, Step: 14
2022-12-07 16:09:54 - r - INFO: - Episode: 48/1500, Reward: 9.000, Step: 9
2022-12-07 16:09:54 - r - INFO: - Episode: 49/1500, Reward: 21.000, Step: 21
2022-12-07 16:09:54 - r - INFO: - Episode: 50/1500, Reward: 10.000, Step: 10
2022-12-07 16:09:54 - r - INFO: - Episode: 51/1500, Reward: 20.000, Step: 20
2022-12-07 16:09:54 - r - INFO: - Episode: 52/1500, Reward: 20.000, Step: 20
2022-12-07 16:09:54 - r - INFO: - Episode: 53/1500, Reward: 35.000, Step: 35
2022-12-07 16:09:54 - r - INFO: - Episode: 54/1500, Reward: 28.000, Step: 28
2022-12-07 16:09:54 - r - INFO: - Episode: 55/1500, Reward: 50.000, Step: 50
2022-12-07 16:09:54 - r - INFO: - Episode: 56/1500, Reward: 29.000, Step: 29
2022-12-07 16:09:54 - r - INFO: - Episode: 57/1500, Reward: 10.000, Step: 10
2022-12-07 16:09:54 - r - INFO: - Episode: 58/1500, Reward: 15.000, Step: 15
2022-12-07 16:09:55 - r - INFO: - Episode: 59/1500, Reward: 20.000, Step: 20
2022-12-07 16:09:55 - r - INFO: - Episode: 60/1500, Reward: 66.000, Step: 66
2022-12-07 16:09:55 - r - INFO: - Episode: 61/1500, Reward: 38.000, Step: 38
2022-12-07 16:09:55 - r - INFO: - Episode: 62/1500, Reward: 19.000, Step: 19
2022-12-07 16:09:55 - r - INFO: - Episode: 63/1500, Reward: 39.000, Step: 39
2022-12-07 16:09:55 - r - INFO: - Episode: 64/1500, Reward: 67.000, Step: 67
2022-12-07 16:09:55 - r - INFO: - Episode: 65/1500, Reward: 13.000, Step: 13
2022-12-07 16:09:56 - r - INFO: - Episode: 66/1500, Reward: 18.000, Step: 18
2022-12-07 16:09:56 - r - INFO: - Episode: 67/1500, Reward: 22.000, Step: 22
2022-12-07 16:09:56 - r - INFO: - Episode: 68/1500, Reward: 16.000, Step: 16
2022-12-07 16:09:56 - r - INFO: - Episode: 69/1500, Reward: 21.000, Step: 21
2022-12-07 16:09:56 - r - INFO: - Episode: 70/1500, Reward: 11.000, Step: 11
2022-12-07 16:09:56 - r - INFO: - Episode: 71/1500, Reward: 42.000, Step: 42
2022-12-07 16:09:56 - r - INFO: - Episode: 72/1500, Reward: 15.000, Step: 15
2022-12-07 16:09:56 - r - INFO: - Episode: 73/1500, Reward: 45.000, Step: 45
2022-12-07 16:09:56 - r - INFO: - Episode: 74/1500, Reward: 17.000, Step: 17
2022-12-07 16:09:56 - r - INFO: - Episode: 75/1500, Reward: 35.000, Step: 35
2022-12-07 16:09:57 - r - INFO: - Episode: 76/1500, Reward: 18.000, Step: 18
2022-12-07 16:09:57 - r - INFO: - Episode: 77/1500, Reward: 26.000, Step: 26
2022-12-07 16:09:57 - r - INFO: - Episode: 78/1500, Reward: 19.000, Step: 19
2022-12-07 16:09:57 - r - INFO: - Episode: 79/1500, Reward: 13.000, Step: 13
2022-12-07 16:09:57 - r - INFO: - Episode: 80/1500, Reward: 11.000, Step: 11
2022-12-07 16:09:57 - r - INFO: - Episode: 81/1500, Reward: 19.000, Step: 19
2022-12-07 16:09:57 - r - INFO: - Episode: 82/1500, Reward: 18.000, Step: 18
2022-12-07 16:09:57 - r - INFO: - Episode: 83/1500, Reward: 73.000, Step: 73
2022-12-07 16:09:58 - r - INFO: - Episode: 84/1500, Reward: 35.000, Step: 35
2022-12-07 16:09:58 - r - INFO: - Episode: 85/1500, Reward: 15.000, Step: 15
2022-12-07 16:09:58 - r - INFO: - Episode: 86/1500, Reward: 20.000, Step: 20
2022-12-07 16:09:58 - r - INFO: - Episode: 87/1500, Reward: 19.000, Step: 19
2022-12-07 16:09:58 - r - INFO: - Episode: 88/1500, Reward: 16.000, Step: 16
2022-12-07 16:09:58 - r - INFO: - Episode: 89/1500, Reward: 18.000, Step: 18
2022-12-07 16:10:34 - r - INFO: - Episode: 90/1500, Reward: 17.000, Step: 17
2022-12-07 16:10:34 - r - INFO: - Episode: 91/1500, Reward: 35.000, Step: 35
2022-12-07 16:10:34 - r - INFO: - Episode: 92/1500, Reward: 27.000, Step: 27
2022-12-07 16:10:34 - r - INFO: - Episode: 93/1500, Reward: 9.000, Step: 9
2022-12-07 16:10:34 - r - INFO: - Episode: 94/1500, Reward: 46.000, Step: 46
2022-12-07 16:10:34 - r - INFO: - Episode: 95/1500, Reward: 11.000, Step: 11
2022-12-07 16:10:34 - r - INFO: - Episode: 96/1500, Reward: 22.000, Step: 22
2022-12-07 16:10:34 - r - INFO: - Episode: 97/1500, Reward: 13.000, Step: 13
2022-12-07 16:10:34 - r - INFO: - Episode: 98/1500, Reward: 12.000, Step: 12
2022-12-07 16:10:34 - r - INFO: - Episode: 99/1500, Reward: 10.000, Step: 10
2022-12-07 16:10:34 - r - INFO: - Episode: 100/1500, Reward: 18.000, Step: 18
2022-12-07 16:10:34 - r - INFO: - Episode: 101/1500, Reward: 25.000, Step: 25
2022-12-07 16:10:34 - r - INFO: - Episode: 102/1500, Reward: 15.000, Step: 15
2022-12-07 16:10:34 - r - INFO: - Episode: 103/1500, Reward: 14.000, Step: 14
2022-12-07 16:10:35 - r - INFO: - Episode: 104/1500, Reward: 36.000, Step: 36
2022-12-07 16:10:35 - r - INFO: - Episode: 105/1500, Reward: 21.000, Step: 21
2022-12-07 16:10:35 - r - INFO: - Episode: 106/1500, Reward: 27.000, Step: 27
2022-12-07 16:10:35 - r - INFO: - Episode: 107/1500, Reward: 30.000, Step: 30
2022-12-07 16:10:35 - r - INFO: - Episode: 108/1500, Reward: 23.000, Step: 23
2022-12-07 16:10:35 - r - INFO: - Episode: 109/1500, Reward: 28.000, Step: 28
2022-12-07 16:10:35 - r - INFO: - Episode: 110/1500, Reward: 12.000, Step: 12
2022-12-07 16:10:35 - r - INFO: - Episode: 111/1500, Reward: 16.000, Step: 16
2022-12-07 16:10:35 - r - INFO: - Episode: 112/1500, Reward: 29.000, Step: 29
2022-12-07 16:10:35 - r - INFO: - Episode: 113/1500, Reward: 37.000, Step: 37
2022-12-07 16:10:35 - r - INFO: - Episode: 114/1500, Reward: 37.000, Step: 37
2022-12-07 16:10:35 - r - INFO: - Episode: 115/1500, Reward: 17.000, Step: 17
2022-12-07 16:10:35 - r - INFO: - Episode: 116/1500, Reward: 28.000, Step: 28
2022-12-07 16:10:35 - r - INFO: - Episode: 117/1500, Reward: 43.000, Step: 43
2022-12-07 16:10:35 - r - INFO: - Episode: 118/1500, Reward: 9.000, Step: 9
2022-12-07 16:10:35 - r - INFO: - Episode: 119/1500, Reward: 16.000, Step: 16
2022-12-07 16:10:35 - r - INFO: - Episode: 120/1500, Reward: 20.000, Step: 20
2022-12-07 16:10:36 - r - INFO: - Episode: 121/1500, Reward: 12.000, Step: 12
2022-12-07 16:10:36 - r - INFO: - Episode: 122/1500, Reward: 40.000, Step: 40
2022-12-07 16:10:36 - r - INFO: - Episode: 123/1500, Reward: 13.000, Step: 13
2022-12-07 16:10:36 - r - INFO: - Episode: 124/1500, Reward: 11.000, Step: 11
2022-12-07 16:10:36 - r - INFO: - Episode: 125/1500, Reward: 9.000, Step: 9
2022-12-07 16:10:36 - r - INFO: - Episode: 126/1500, Reward: 18.000, Step: 18
2022-12-07 16:10:36 - r - INFO: - Episode: 127/1500, Reward: 20.000, Step: 20
2022-12-07 16:10:36 - r - INFO: - Episode: 128/1500, Reward: 21.000, Step: 21
2022-12-07 16:10:36 - r - INFO: - Episode: 129/1500, Reward: 13.000, Step: 13
2022-12-07 16:10:36 - r - INFO: - Episode: 130/1500, Reward: 33.000, Step: 33
2022-12-07 16:10:36 - r - INFO: - Episode: 131/1500, Reward: 13.000, Step: 13
2022-12-07 16:10:36 - r - INFO: - Episode: 132/1500, Reward: 17.000, Step: 17
2022-12-07 16:10:36 - r - INFO: - Episode: 133/1500, Reward: 44.000, Step: 44
2022-12-07 16:10:36 - r - INFO: - Episode: 134/1500, Reward: 11.000, Step: 11
2022-12-07 16:10:36 - r - INFO: - Episode: 135/1500, Reward: 16.000, Step: 16
2022-12-07 16:10:36 - r - INFO: - Episode: 136/1500, Reward: 19.000, Step: 19
2022-12-07 16:10:36 - r - INFO: - Episode: 137/1500, Reward: 14.000, Step: 14
2022-12-07 16:10:36 - r - INFO: - Episode: 138/1500, Reward: 20.000, Step: 20
2022-12-07 16:10:36 - r - INFO: - Episode: 139/1500, Reward: 19.000, Step: 19
2022-12-07 16:10:36 - r - INFO: - Episode: 140/1500, Reward: 11.000, Step: 11
2022-12-07 16:10:37 - r - INFO: - Episode: 141/1500, Reward: 14.000, Step: 14
2022-12-07 16:10:37 - r - INFO: - Episode: 142/1500, Reward: 22.000, Step: 22
2022-12-07 16:10:37 - r - INFO: - Episode: 143/1500, Reward: 17.000, Step: 17
2022-12-07 16:10:37 - r - INFO: - Episode: 144/1500, Reward: 13.000, Step: 13
2022-12-07 16:10:37 - r - INFO: - Episode: 145/1500, Reward: 12.000, Step: 12
2022-12-07 16:10:37 - r - INFO: - Episode: 146/1500, Reward: 15.000, Step: 15
2022-12-07 16:10:37 - r - INFO: - Episode: 147/1500, Reward: 19.000, Step: 19
2022-12-07 16:10:37 - r - INFO: - Episode: 148/1500, Reward: 15.000, Step: 15
2022-12-07 16:10:37 - r - INFO: - Episode: 149/1500, Reward: 11.000, Step: 11
2022-12-07 16:10:37 - r - INFO: - Episode: 150/1500, Reward: 15.000, Step: 15
2022-12-07 16:10:37 - r - INFO: - Episode: 151/1500, Reward: 12.000, Step: 12
2022-12-07 16:10:37 - r - INFO: - Episode: 152/1500, Reward: 11.000, Step: 11
2022-12-07 16:10:37 - r - INFO: - Episode: 153/1500, Reward: 30.000, Step: 30
2022-12-07 16:10:37 - r - INFO: - Episode: 154/1500, Reward: 12.000, Step: 12
2022-12-07 16:10:37 - r - INFO: - Episode: 155/1500, Reward: 22.000, Step: 22
2022-12-07 16:10:37 - r - INFO: - Episode: 156/1500, Reward: 11.000, Step: 11
2022-12-07 16:10:37 - r - INFO: - Episode: 157/1500, Reward: 21.000, Step: 21
2022-12-07 16:10:37 - r - INFO: - Episode: 158/1500, Reward: 37.000, Step: 37
2022-12-07 16:10:37 - r - INFO: - Episode: 159/1500, Reward: 16.000, Step: 16
2022-12-07 16:10:37 - r - INFO: - Episode: 160/1500, Reward: 17.000, Step: 17
2022-12-07 16:10:37 - r - INFO: - Episode: 161/1500, Reward: 15.000, Step: 15
2022-12-07 16:10:37 - r - INFO: - Episode: 162/1500, Reward: 16.000, Step: 16
2022-12-07 16:10:37 - r - INFO: - Episode: 163/1500, Reward: 32.000, Step: 32
2022-12-07 16:10:38 - r - INFO: - Episode: 164/1500, Reward: 31.000, Step: 31
2022-12-07 16:10:38 - r - INFO: - Episode: 165/1500, Reward: 16.000, Step: 16
2022-12-07 16:10:38 - r - INFO: - Episode: 166/1500, Reward: 19.000, Step: 19
2022-12-07 16:10:38 - r - INFO: - Episode: 167/1500, Reward: 16.000, Step: 16
2022-12-07 16:10:38 - r - INFO: - Episode: 168/1500, Reward: 19.000, Step: 19
2022-12-07 16:10:38 - r - INFO: - Episode: 169/1500, Reward: 12.000, Step: 12
2022-12-07 16:10:38 - r - INFO: - Episode: 170/1500, Reward: 11.000, Step: 11
2022-12-07 16:10:38 - r - INFO: - Episode: 171/1500, Reward: 15.000, Step: 15
2022-12-07 16:10:38 - r - INFO: - Episode: 172/1500, Reward: 20.000, Step: 20
2022-12-07 16:10:38 - r - INFO: - Episode: 173/1500, Reward: 11.000, Step: 11
2022-12-07 16:10:38 - r - INFO: - Episode: 174/1500, Reward: 26.000, Step: 26
2022-12-07 16:10:38 - r - INFO: - Episode: 175/1500, Reward: 19.000, Step: 19
2022-12-07 16:10:38 - r - INFO: - Episode: 176/1500, Reward: 30.000, Step: 30
2022-12-07 16:10:38 - r - INFO: - Episode: 177/1500, Reward: 12.000, Step: 12
2022-12-07 16:10:38 - r - INFO: - Episode: 178/1500, Reward: 17.000, Step: 17
2022-12-07 16:10:38 - r - INFO: - Episode: 179/1500, Reward: 18.000, Step: 18
2022-12-07 16:10:38 - r - INFO: - Episode: 180/1500, Reward: 14.000, Step: 14
2022-12-07 16:10:38 - r - INFO: - Episode: 181/1500, Reward: 19.000, Step: 19
2022-12-07 16:10:38 - r - INFO: - Episode: 182/1500, Reward: 28.000, Step: 28
2022-12-07 16:10:38 - r - INFO: - Episode: 183/1500, Reward: 11.000, Step: 11
2022-12-07 16:10:39 - r - INFO: - Episode: 184/1500, Reward: 20.000, Step: 20
2022-12-07 16:10:39 - r - INFO: - Episode: 185/1500, Reward: 14.000, Step: 14
2022-12-07 16:10:39 - r - INFO: - Episode: 186/1500, Reward: 15.000, Step: 15
2022-12-07 16:10:39 - r - INFO: - Episode: 187/1500, Reward: 24.000, Step: 24
2022-12-07 16:10:39 - r - INFO: - Episode: 188/1500, Reward: 9.000, Step: 9
2022-12-07 16:10:39 - r - INFO: - Episode: 189/1500, Reward: 12.000, Step: 12
2022-12-07 16:10:39 - r - INFO: - Episode: 190/1500, Reward: 11.000, Step: 11
2022-12-07 16:10:39 - r - INFO: - Episode: 191/1500, Reward: 12.000, Step: 12
2022-12-07 16:10:39 - r - INFO: - Episode: 192/1500, Reward: 12.000, Step: 12
2022-12-07 16:10:39 - r - INFO: - Episode: 193/1500, Reward: 15.000, Step: 15
2022-12-07 16:10:39 - r - INFO: - Episode: 194/1500, Reward: 17.000, Step: 17
2022-12-07 16:10:39 - r - INFO: - Episode: 195/1500, Reward: 32.000, Step: 32
2022-12-07 16:11:03 - r - INFO: - Episode: 196/1500, Reward: 42.000, Step: 42
2022-12-07 16:11:03 - r - INFO: - Episode: 197/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:03 - r - INFO: - Episode: 198/1500, Reward: 52.000, Step: 52
2022-12-07 16:11:03 - r - INFO: - Episode: 199/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:03 - r - INFO: - Episode: 200/1500, Reward: 62.000, Step: 62
2022-12-07 16:11:03 - r - INFO: - Episode: 201/1500, Reward: 19.000, Step: 19
2022-12-07 16:11:03 - r - INFO: - Episode: 202/1500, Reward: 23.000, Step: 23
2022-12-07 16:11:03 - r - INFO: - Episode: 203/1500, Reward: 16.000, Step: 16
2022-12-07 16:11:04 - r - INFO: - Episode: 204/1500, Reward: 11.000, Step: 11
2022-12-07 16:11:04 - r - INFO: - Episode: 205/1500, Reward: 30.000, Step: 30
2022-12-07 16:11:04 - r - INFO: - Episode: 206/1500, Reward: 26.000, Step: 26
2022-12-07 16:11:04 - r - INFO: - Episode: 207/1500, Reward: 17.000, Step: 17
2022-12-07 16:11:04 - r - INFO: - Episode: 208/1500, Reward: 16.000, Step: 16
2022-12-07 16:11:04 - r - INFO: - Episode: 209/1500, Reward: 25.000, Step: 25
2022-12-07 16:11:04 - r - INFO: - Episode: 210/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:04 - r - INFO: - Episode: 211/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:04 - r - INFO: - Episode: 212/1500, Reward: 29.000, Step: 29
2022-12-07 16:11:04 - r - INFO: - Episode: 213/1500, Reward: 17.000, Step: 17
2022-12-07 16:11:04 - r - INFO: - Episode: 214/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:04 - r - INFO: - Episode: 215/1500, Reward: 21.000, Step: 21
2022-12-07 16:11:04 - r - INFO: - Episode: 216/1500, Reward: 9.000, Step: 9
2022-12-07 16:11:04 - r - INFO: - Episode: 217/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:04 - r - INFO: - Episode: 218/1500, Reward: 27.000, Step: 27
2022-12-07 16:11:04 - r - INFO: - Episode: 219/1500, Reward: 20.000, Step: 20
2022-12-07 16:11:04 - r - INFO: - Episode: 220/1500, Reward: 13.000, Step: 13
2022-12-07 16:11:04 - r - INFO: - Episode: 221/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:04 - r - INFO: - Episode: 222/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:04 - r - INFO: - Episode: 223/1500, Reward: 14.000, Step: 14
2022-12-07 16:11:04 - r - INFO: - Episode: 224/1500, Reward: 43.000, Step: 43
2022-12-07 16:11:04 - r - INFO: - Episode: 225/1500, Reward: 10.000, Step: 10
2022-12-07 16:11:05 - r - INFO: - Episode: 226/1500, Reward: 16.000, Step: 16
2022-12-07 16:11:05 - r - INFO: - Episode: 227/1500, Reward: 17.000, Step: 17
2022-12-07 16:11:05 - r - INFO: - Episode: 228/1500, Reward: 29.000, Step: 29
2022-12-07 16:11:05 - r - INFO: - Episode: 229/1500, Reward: 21.000, Step: 21
2022-12-07 16:11:05 - r - INFO: - Episode: 230/1500, Reward: 18.000, Step: 18
2022-12-07 16:11:05 - r - INFO: - Episode: 231/1500, Reward: 17.000, Step: 17
2022-12-07 16:11:05 - r - INFO: - Episode: 232/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:05 - r - INFO: - Episode: 233/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:05 - r - INFO: - Episode: 234/1500, Reward: 11.000, Step: 11
2022-12-07 16:11:05 - r - INFO: - Episode: 235/1500, Reward: 23.000, Step: 23
2022-12-07 16:11:05 - r - INFO: - Episode: 236/1500, Reward: 37.000, Step: 37
2022-12-07 16:11:05 - r - INFO: - Episode: 237/1500, Reward: 9.000, Step: 9
2022-12-07 16:11:05 - r - INFO: - Episode: 238/1500, Reward: 16.000, Step: 16
2022-12-07 16:11:05 - r - INFO: - Episode: 239/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:05 - r - INFO: - Episode: 240/1500, Reward: 17.000, Step: 17
2022-12-07 16:11:05 - r - INFO: - Episode: 241/1500, Reward: 9.000, Step: 9
2022-12-07 16:11:05 - r - INFO: - Episode: 242/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:05 - r - INFO: - Episode: 243/1500, Reward: 17.000, Step: 17
2022-12-07 16:11:05 - r - INFO: - Episode: 244/1500, Reward: 13.000, Step: 13
2022-12-07 16:11:05 - r - INFO: - Episode: 245/1500, Reward: 13.000, Step: 13
2022-12-07 16:11:05 - r - INFO: - Episode: 246/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:06 - r - INFO: - Episode: 247/1500, Reward: 28.000, Step: 28
2022-12-07 16:11:06 - r - INFO: - Episode: 248/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:06 - r - INFO: - Episode: 249/1500, Reward: 22.000, Step: 22
2022-12-07 16:11:06 - r - INFO: - Episode: 250/1500, Reward: 37.000, Step: 37
2022-12-07 16:11:06 - r - INFO: - Episode: 251/1500, Reward: 17.000, Step: 17
2022-12-07 16:11:06 - r - INFO: - Episode: 252/1500, Reward: 64.000, Step: 64
2022-12-07 16:11:06 - r - INFO: - Episode: 253/1500, Reward: 27.000, Step: 27
2022-12-07 16:11:06 - r - INFO: - Episode: 254/1500, Reward: 14.000, Step: 14
2022-12-07 16:11:06 - r - INFO: - Episode: 255/1500, Reward: 21.000, Step: 21
2022-12-07 16:11:06 - r - INFO: - Episode: 256/1500, Reward: 19.000, Step: 19
2022-12-07 16:11:06 - r - INFO: - Episode: 257/1500, Reward: 23.000, Step: 23
2022-12-07 16:11:06 - r - INFO: - Episode: 258/1500, Reward: 23.000, Step: 23
2022-12-07 16:11:06 - r - INFO: - Episode: 259/1500, Reward: 13.000, Step: 13
2022-12-07 16:11:06 - r - INFO: - Episode: 260/1500, Reward: 21.000, Step: 21
2022-12-07 16:11:06 - r - INFO: - Episode: 261/1500, Reward: 17.000, Step: 17
2022-12-07 16:11:06 - r - INFO: - Episode: 262/1500, Reward: 31.000, Step: 31
2022-12-07 16:11:06 - r - INFO: - Episode: 263/1500, Reward: 33.000, Step: 33
2022-12-07 16:11:06 - r - INFO: - Episode: 264/1500, Reward: 20.000, Step: 20
2022-12-07 16:11:06 - r - INFO: - Episode: 265/1500, Reward: 29.000, Step: 29
2022-12-07 16:11:07 - r - INFO: - Episode: 266/1500, Reward: 17.000, Step: 17
2022-12-07 16:11:07 - r - INFO: - Episode: 267/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:07 - r - INFO: - Episode: 268/1500, Reward: 10.000, Step: 10
2022-12-07 16:11:07 - r - INFO: - Episode: 269/1500, Reward: 14.000, Step: 14
2022-12-07 16:11:07 - r - INFO: - Episode: 270/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:07 - r - INFO: - Episode: 271/1500, Reward: 11.000, Step: 11
2022-12-07 16:11:07 - r - INFO: - Episode: 272/1500, Reward: 26.000, Step: 26
2022-12-07 16:11:07 - r - INFO: - Episode: 273/1500, Reward: 16.000, Step: 16
2022-12-07 16:11:07 - r - INFO: - Episode: 274/1500, Reward: 9.000, Step: 9
2022-12-07 16:11:07 - r - INFO: - Episode: 275/1500, Reward: 23.000, Step: 23
2022-12-07 16:11:07 - r - INFO: - Episode: 276/1500, Reward: 10.000, Step: 10
2022-12-07 16:11:07 - r - INFO: - Episode: 277/1500, Reward: 13.000, Step: 13
2022-12-07 16:11:07 - r - INFO: - Episode: 278/1500, Reward: 20.000, Step: 20
2022-12-07 16:11:07 - r - INFO: - Episode: 279/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:07 - r - INFO: - Episode: 280/1500, Reward: 18.000, Step: 18
2022-12-07 16:11:07 - r - INFO: - Episode: 281/1500, Reward: 20.000, Step: 20
2022-12-07 16:11:07 - r - INFO: - Episode: 282/1500, Reward: 19.000, Step: 19
2022-12-07 16:11:07 - r - INFO: - Episode: 283/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:07 - r - INFO: - Episode: 284/1500, Reward: 20.000, Step: 20
2022-12-07 16:11:07 - r - INFO: - Episode: 285/1500, Reward: 13.000, Step: 13
2022-12-07 16:11:07 - r - INFO: - Episode: 286/1500, Reward: 11.000, Step: 11
2022-12-07 16:11:08 - r - INFO: - Episode: 287/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:08 - r - INFO: - Episode: 288/1500, Reward: 34.000, Step: 34
2022-12-07 16:11:08 - r - INFO: - Episode: 289/1500, Reward: 11.000, Step: 11
2022-12-07 16:11:08 - r - INFO: - Episode: 290/1500, Reward: 17.000, Step: 17
2022-12-07 16:11:08 - r - INFO: - Episode: 291/1500, Reward: 14.000, Step: 14
2022-12-07 16:11:08 - r - INFO: - Episode: 292/1500, Reward: 11.000, Step: 11
2022-12-07 16:11:08 - r - INFO: - Episode: 293/1500, Reward: 22.000, Step: 22
2022-12-07 16:11:08 - r - INFO: - Episode: 294/1500, Reward: 23.000, Step: 23
2022-12-07 16:11:08 - r - INFO: - Episode: 295/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:08 - r - INFO: - Episode: 296/1500, Reward: 13.000, Step: 13
2022-12-07 16:11:08 - r - INFO: - Episode: 297/1500, Reward: 14.000, Step: 14
2022-12-07 16:11:08 - r - INFO: - Episode: 298/1500, Reward: 25.000, Step: 25
2022-12-07 16:11:08 - r - INFO: - Episode: 299/1500, Reward: 20.000, Step: 20
2022-12-07 16:11:08 - r - INFO: - Episode: 300/1500, Reward: 17.000, Step: 17
2022-12-07 16:11:08 - r - INFO: - Episode: 301/1500, Reward: 10.000, Step: 10
2022-12-07 16:11:31 - r - INFO: - Episode: 302/1500, Reward: 17.000, Step: 17
2022-12-07 16:11:31 - r - INFO: - Episode: 303/1500, Reward: 27.000, Step: 27
2022-12-07 16:11:31 - r - INFO: - Episode: 304/1500, Reward: 24.000, Step: 24
2022-12-07 16:11:31 - r - INFO: - Episode: 305/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:32 - r - INFO: - Episode: 306/1500, Reward: 22.000, Step: 22
2022-12-07 16:11:32 - r - INFO: - Episode: 307/1500, Reward: 23.000, Step: 23
2022-12-07 16:11:32 - r - INFO: - Episode: 308/1500, Reward: 20.000, Step: 20
2022-12-07 16:11:32 - r - INFO: - Episode: 309/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:32 - r - INFO: - Episode: 310/1500, Reward: 26.000, Step: 26
2022-12-07 16:11:32 - r - INFO: - Episode: 311/1500, Reward: 17.000, Step: 17
2022-12-07 16:11:32 - r - INFO: - Episode: 312/1500, Reward: 27.000, Step: 27
2022-12-07 16:11:32 - r - INFO: - Episode: 313/1500, Reward: 21.000, Step: 21
2022-12-07 16:11:32 - r - INFO: - Episode: 314/1500, Reward: 26.000, Step: 26
2022-12-07 16:11:32 - r - INFO: - Episode: 315/1500, Reward: 23.000, Step: 23
2022-12-07 16:11:32 - r - INFO: - Episode: 316/1500, Reward: 13.000, Step: 13
2022-12-07 16:11:32 - r - INFO: - Episode: 317/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:32 - r - INFO: - Episode: 318/1500, Reward: 26.000, Step: 26
2022-12-07 16:11:32 - r - INFO: - Episode: 319/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:32 - r - INFO: - Episode: 320/1500, Reward: 13.000, Step: 13
2022-12-07 16:11:32 - r - INFO: - Episode: 321/1500, Reward: 24.000, Step: 24
2022-12-07 16:11:32 - r - INFO: - Episode: 322/1500, Reward: 11.000, Step: 11
2022-12-07 16:11:32 - r - INFO: - Episode: 323/1500, Reward: 19.000, Step: 19
2022-12-07 16:11:32 - r - INFO: - Episode: 324/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:32 - r - INFO: - Episode: 325/1500, Reward: 14.000, Step: 14
2022-12-07 16:11:32 - r - INFO: - Episode: 326/1500, Reward: 19.000, Step: 19
2022-12-07 16:11:33 - r - INFO: - Episode: 327/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:33 - r - INFO: - Episode: 328/1500, Reward: 14.000, Step: 14
2022-12-07 16:11:33 - r - INFO: - Episode: 329/1500, Reward: 16.000, Step: 16
2022-12-07 16:11:33 - r - INFO: - Episode: 330/1500, Reward: 11.000, Step: 11
2022-12-07 16:11:33 - r - INFO: - Episode: 331/1500, Reward: 20.000, Step: 20
2022-12-07 16:11:33 - r - INFO: - Episode: 332/1500, Reward: 14.000, Step: 14
2022-12-07 16:11:33 - r - INFO: - Episode: 333/1500, Reward: 29.000, Step: 29
2022-12-07 16:11:33 - r - INFO: - Episode: 334/1500, Reward: 36.000, Step: 36
2022-12-07 16:11:33 - r - INFO: - Episode: 335/1500, Reward: 23.000, Step: 23
2022-12-07 16:11:33 - r - INFO: - Episode: 336/1500, Reward: 32.000, Step: 32
2022-12-07 16:11:33 - r - INFO: - Episode: 337/1500, Reward: 41.000, Step: 41
2022-12-07 16:11:33 - r - INFO: - Episode: 338/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:33 - r - INFO: - Episode: 339/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:33 - r - INFO: - Episode: 340/1500, Reward: 16.000, Step: 16
2022-12-07 16:11:33 - r - INFO: - Episode: 341/1500, Reward: 11.000, Step: 11
2022-12-07 16:11:33 - r - INFO: - Episode: 342/1500, Reward: 24.000, Step: 24
2022-12-07 16:11:33 - r - INFO: - Episode: 343/1500, Reward: 11.000, Step: 11
2022-12-07 16:11:33 - r - INFO: - Episode: 344/1500, Reward: 16.000, Step: 16
2022-12-07 16:11:33 - r - INFO: - Episode: 345/1500, Reward: 18.000, Step: 18
2022-12-07 16:11:34 - r - INFO: - Episode: 346/1500, Reward: 26.000, Step: 26
2022-12-07 16:11:34 - r - INFO: - Episode: 347/1500, Reward: 22.000, Step: 22
2022-12-07 16:11:34 - r - INFO: - Episode: 348/1500, Reward: 57.000, Step: 57
2022-12-07 16:11:34 - r - INFO: - Episode: 349/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:34 - r - INFO: - Episode: 350/1500, Reward: 13.000, Step: 13
2022-12-07 16:11:34 - r - INFO: - Episode: 351/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:34 - r - INFO: - Episode: 352/1500, Reward: 23.000, Step: 23
2022-12-07 16:11:34 - r - INFO: - Episode: 353/1500, Reward: 24.000, Step: 24
2022-12-07 16:11:34 - r - INFO: - Episode: 354/1500, Reward: 26.000, Step: 26
2022-12-07 16:11:34 - r - INFO: - Episode: 355/1500, Reward: 17.000, Step: 17
2022-12-07 16:11:34 - r - INFO: - Episode: 356/1500, Reward: 36.000, Step: 36
2022-12-07 16:11:34 - r - INFO: - Episode: 357/1500, Reward: 19.000, Step: 19
2022-12-07 16:11:34 - r - INFO: - Episode: 358/1500, Reward: 22.000, Step: 22
2022-12-07 16:11:34 - r - INFO: - Episode: 359/1500, Reward: 16.000, Step: 16
2022-12-07 16:11:34 - r - INFO: - Episode: 360/1500, Reward: 47.000, Step: 47
2022-12-07 16:11:34 - r - INFO: - Episode: 361/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:34 - r - INFO: - Episode: 362/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:35 - r - INFO: - Episode: 363/1500, Reward: 11.000, Step: 11
2022-12-07 16:11:35 - r - INFO: - Episode: 364/1500, Reward: 16.000, Step: 16
2022-12-07 16:11:35 - r - INFO: - Episode: 365/1500, Reward: 19.000, Step: 19
2022-12-07 16:11:35 - r - INFO: - Episode: 366/1500, Reward: 17.000, Step: 17
2022-12-07 16:11:35 - r - INFO: - Episode: 367/1500, Reward: 11.000, Step: 11
2022-12-07 16:11:35 - r - INFO: - Episode: 368/1500, Reward: 14.000, Step: 14
2022-12-07 16:11:35 - r - INFO: - Episode: 369/1500, Reward: 10.000, Step: 10
2022-12-07 16:11:35 - r - INFO: - Episode: 370/1500, Reward: 18.000, Step: 18
2022-12-07 16:11:35 - r - INFO: - Episode: 371/1500, Reward: 35.000, Step: 35
2022-12-07 16:11:35 - r - INFO: - Episode: 372/1500, Reward: 9.000, Step: 9
2022-12-07 16:11:35 - r - INFO: - Episode: 373/1500, Reward: 20.000, Step: 20
2022-12-07 16:11:35 - r - INFO: - Episode: 374/1500, Reward: 11.000, Step: 11
2022-12-07 16:11:35 - r - INFO: - Episode: 375/1500, Reward: 18.000, Step: 18
2022-12-07 16:11:35 - r - INFO: - Episode: 376/1500, Reward: 18.000, Step: 18
2022-12-07 16:11:35 - r - INFO: - Episode: 377/1500, Reward: 16.000, Step: 16
2022-12-07 16:11:35 - r - INFO: - Episode: 378/1500, Reward: 11.000, Step: 11
2022-12-07 16:11:35 - r - INFO: - Episode: 379/1500, Reward: 19.000, Step: 19
2022-12-07 16:11:35 - r - INFO: - Episode: 380/1500, Reward: 33.000, Step: 33
2022-12-07 16:11:35 - r - INFO: - Episode: 381/1500, Reward: 9.000, Step: 9
2022-12-07 16:11:35 - r - INFO: - Episode: 382/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:35 - r - INFO: - Episode: 383/1500, Reward: 27.000, Step: 27
2022-12-07 16:11:35 - r - INFO: - Episode: 384/1500, Reward: 19.000, Step: 19
2022-12-07 16:11:36 - r - INFO: - Episode: 385/1500, Reward: 15.000, Step: 15
2022-12-07 16:11:36 - r - INFO: - Episode: 386/1500, Reward: 11.000, Step: 11
2022-12-07 16:11:36 - r - INFO: - Episode: 387/1500, Reward: 13.000, Step: 13
2022-12-07 16:11:36 - r - INFO: - Episode: 388/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:36 - r - INFO: - Episode: 389/1500, Reward: 24.000, Step: 24
2022-12-07 16:11:36 - r - INFO: - Episode: 390/1500, Reward: 18.000, Step: 18
2022-12-07 16:11:36 - r - INFO: - Episode: 391/1500, Reward: 11.000, Step: 11
2022-12-07 16:11:36 - r - INFO: - Episode: 392/1500, Reward: 23.000, Step: 23
2022-12-07 16:11:36 - r - INFO: - Episode: 393/1500, Reward: 20.000, Step: 20
2022-12-07 16:11:36 - r - INFO: - Episode: 394/1500, Reward: 12.000, Step: 12
2022-12-07 16:11:36 - r - INFO: - Episode: 395/1500, Reward: 24.000, Step: 24
2022-12-07 16:11:36 - r - INFO: - Episode: 396/1500, Reward: 32.000, Step: 32
2022-12-07 16:11:36 - r - INFO: - Episode: 397/1500, Reward: 10.000, Step: 10
2022-12-07 16:11:36 - r - INFO: - Episode: 398/1500, Reward: 14.000, Step: 14
2022-12-07 16:11:36 - r - INFO: - Episode: 399/1500, Reward: 18.000, Step: 18
2022-12-07 16:11:36 - r - INFO: - Episode: 400/1500, Reward: 38.000, Step: 38
2022-12-07 16:11:36 - r - INFO: - Episode: 401/1500, Reward: 14.000, Step: 14
2022-12-07 16:11:37 - r - INFO: - Episode: 402/1500, Reward: 20.000, Step: 20
2022-12-07 16:11:37 - r - INFO: - Episode: 403/1500, Reward: 16.000, Step: 16
2022-12-07 16:11:37 - r - INFO: - Episode: 404/1500, Reward: 13.000, Step: 13
2022-12-07 16:11:37 - r - INFO: - Episode: 405/1500, Reward: 16.000, Step: 16
2022-12-07 16:11:37 - r - INFO: - Episode: 406/1500, Reward: 35.000, Step: 35
2022-12-07 16:11:37 - r - INFO: - Episode: 407/1500, Reward: 10.000, Step: 10
2022-12-07 16:12:00 - r - INFO: - Episode: 408/1500, Reward: 9.000, Step: 9
2022-12-07 16:12:00 - r - INFO: - Episode: 409/1500, Reward: 26.000, Step: 26
2022-12-07 16:12:00 - r - INFO: - Episode: 410/1500, Reward: 47.000, Step: 47
2022-12-07 16:12:01 - r - INFO: - Episode: 411/1500, Reward: 21.000, Step: 21
2022-12-07 16:12:01 - r - INFO: - Episode: 412/1500, Reward: 26.000, Step: 26
2022-12-07 16:12:01 - r - INFO: - Episode: 413/1500, Reward: 15.000, Step: 15
2022-12-07 16:12:01 - r - INFO: - Episode: 414/1500, Reward: 24.000, Step: 24
2022-12-07 16:12:01 - r - INFO: - Episode: 415/1500, Reward: 10.000, Step: 10
2022-12-07 16:12:01 - r - INFO: - Episode: 416/1500, Reward: 25.000, Step: 25
2022-12-07 16:12:01 - r - INFO: - Episode: 417/1500, Reward: 28.000, Step: 28
2022-12-07 16:12:01 - r - INFO: - Episode: 418/1500, Reward: 18.000, Step: 18
2022-12-07 16:12:01 - r - INFO: - Episode: 419/1500, Reward: 11.000, Step: 11
2022-12-07 16:12:01 - r - INFO: - Episode: 420/1500, Reward: 22.000, Step: 22
2022-12-07 16:12:01 - r - INFO: - Episode: 421/1500, Reward: 22.000, Step: 22
2022-12-07 16:12:01 - r - INFO: - Episode: 422/1500, Reward: 18.000, Step: 18
2022-12-07 16:12:01 - r - INFO: - Episode: 423/1500, Reward: 27.000, Step: 27
2022-12-07 16:12:01 - r - INFO: - Episode: 424/1500, Reward: 29.000, Step: 29
2022-12-07 16:12:01 - r - INFO: - Episode: 425/1500, Reward: 15.000, Step: 15
2022-12-07 16:12:01 - r - INFO: - Episode: 426/1500, Reward: 27.000, Step: 27
2022-12-07 16:12:01 - r - INFO: - Episode: 427/1500, Reward: 26.000, Step: 26
2022-12-07 16:12:01 - r - INFO: - Episode: 428/1500, Reward: 21.000, Step: 21
2022-12-07 16:12:01 - r - INFO: - Episode: 429/1500, Reward: 13.000, Step: 13
2022-12-07 16:12:01 - r - INFO: - Episode: 430/1500, Reward: 10.000, Step: 10
2022-12-07 16:12:02 - r - INFO: - Episode: 431/1500, Reward: 12.000, Step: 12
2022-12-07 16:12:02 - r - INFO: - Episode: 432/1500, Reward: 16.000, Step: 16
2022-12-07 16:12:02 - r - INFO: - Episode: 433/1500, Reward: 21.000, Step: 21
2022-12-07 16:12:02 - r - INFO: - Episode: 434/1500, Reward: 14.000, Step: 14
2022-12-07 16:12:02 - r - INFO: - Episode: 435/1500, Reward: 17.000, Step: 17
2022-12-07 16:12:02 - r - INFO: - Episode: 436/1500, Reward: 10.000, Step: 10
2022-12-07 16:12:02 - r - INFO: - Episode: 437/1500, Reward: 20.000, Step: 20
2022-12-07 16:12:02 - r - INFO: - Episode: 438/1500, Reward: 16.000, Step: 16
2022-12-07 16:12:02 - r - INFO: - Episode: 439/1500, Reward: 15.000, Step: 15
2022-12-07 16:12:02 - r - INFO: - Episode: 440/1500, Reward: 35.000, Step: 35
2022-12-07 16:12:02 - r - INFO: - Episode: 441/1500, Reward: 28.000, Step: 28
2022-12-07 16:12:02 - r - INFO: - Episode: 442/1500, Reward: 21.000, Step: 21
2022-12-07 16:12:02 - r - INFO: - Episode: 443/1500, Reward: 45.000, Step: 45
2022-12-07 16:12:02 - r - INFO: - Episode: 444/1500, Reward: 19.000, Step: 19
2022-12-07 16:12:02 - r - INFO: - Episode: 445/1500, Reward: 23.000, Step: 23
2022-12-07 16:12:03 - r - INFO: - Episode: 446/1500, Reward: 21.000, Step: 21
2022-12-07 16:12:03 - r - INFO: - Episode: 447/1500, Reward: 33.000, Step: 33
2022-12-07 16:12:03 - r - INFO: - Episode: 448/1500, Reward: 20.000, Step: 20
2022-12-07 16:12:03 - r - INFO: - Episode: 449/1500, Reward: 15.000, Step: 15
2022-12-07 16:12:03 - r - INFO: - Episode: 450/1500, Reward: 30.000, Step: 30
2022-12-07 16:12:03 - r - INFO: - Episode: 451/1500, Reward: 14.000, Step: 14
2022-12-07 16:12:03 - r - INFO: - Episode: 452/1500, Reward: 11.000, Step: 11
2022-12-07 16:12:03 - r - INFO: - Episode: 453/1500, Reward: 14.000, Step: 14
2022-12-07 16:12:03 - r - INFO: - Episode: 454/1500, Reward: 19.000, Step: 19
2022-12-07 16:12:03 - r - INFO: - Episode: 455/1500, Reward: 25.000, Step: 25
2022-12-07 16:12:03 - r - INFO: - Episode: 456/1500, Reward: 28.000, Step: 28
2022-12-07 16:12:03 - r - INFO: - Episode: 457/1500, Reward: 10.000, Step: 10
2022-12-07 16:12:03 - r - INFO: - Episode: 458/1500, Reward: 12.000, Step: 12
2022-12-07 16:12:03 - r - INFO: - Episode: 459/1500, Reward: 38.000, Step: 38
2022-12-07 16:12:03 - r - INFO: - Episode: 460/1500, Reward: 15.000, Step: 15
2022-12-07 16:12:03 - r - INFO: - Episode: 461/1500, Reward: 15.000, Step: 15
2022-12-07 16:12:03 - r - INFO: - Episode: 462/1500, Reward: 18.000, Step: 18
2022-12-07 16:12:03 - r - INFO: - Episode: 463/1500, Reward: 13.000, Step: 13
2022-12-07 16:12:03 - r - INFO: - Episode: 464/1500, Reward: 17.000, Step: 17
2022-12-07 16:12:04 - r - INFO: - Episode: 465/1500, Reward: 62.000, Step: 62
2022-12-07 16:12:04 - r - INFO: - Episode: 466/1500, Reward: 15.000, Step: 15
2022-12-07 16:12:04 - r - INFO: - Episode: 467/1500, Reward: 27.000, Step: 27
2022-12-07 16:12:04 - r - INFO: - Episode: 468/1500, Reward: 22.000, Step: 22
2022-12-07 16:12:04 - r - INFO: - Episode: 469/1500, Reward: 28.000, Step: 28
2022-12-07 16:12:04 - r - INFO: - Episode: 470/1500, Reward: 20.000, Step: 20
2022-12-07 16:12:04 - r - INFO: - Episode: 471/1500, Reward: 23.000, Step: 23
2022-12-07 16:12:04 - r - INFO: - Episode: 472/1500, Reward: 34.000, Step: 34
2022-12-07 16:12:04 - r - INFO: - Episode: 473/1500, Reward: 76.000, Step: 76
2022-12-07 16:12:04 - r - INFO: - Episode: 474/1500, Reward: 40.000, Step: 40
2022-12-07 16:12:04 - r - INFO: - Episode: 475/1500, Reward: 16.000, Step: 16
2022-12-07 16:12:04 - r - INFO: - Episode: 476/1500, Reward: 32.000, Step: 32
2022-12-07 16:12:04 - r - INFO: - Episode: 477/1500, Reward: 18.000, Step: 18
2022-12-07 16:12:04 - r - INFO: - Episode: 478/1500, Reward: 13.000, Step: 13
2022-12-07 16:12:04 - r - INFO: - Episode: 479/1500, Reward: 23.000, Step: 23
2022-12-07 16:12:04 - r - INFO: - Episode: 480/1500, Reward: 25.000, Step: 25
2022-12-07 16:12:05 - r - INFO: - Episode: 481/1500, Reward: 23.000, Step: 23
2022-12-07 16:12:05 - r - INFO: - Episode: 482/1500, Reward: 25.000, Step: 25
2022-12-07 16:12:05 - r - INFO: - Episode: 483/1500, Reward: 20.000, Step: 20
2022-12-07 16:12:05 - r - INFO: - Episode: 484/1500, Reward: 16.000, Step: 16
2022-12-07 16:12:05 - r - INFO: - Episode: 485/1500, Reward: 22.000, Step: 22
2022-12-07 16:12:05 - r - INFO: - Episode: 486/1500, Reward: 28.000, Step: 28
2022-12-07 16:12:05 - r - INFO: - Episode: 487/1500, Reward: 11.000, Step: 11
2022-12-07 16:12:05 - r - INFO: - Episode: 488/1500, Reward: 17.000, Step: 17
2022-12-07 16:12:05 - r - INFO: - Episode: 489/1500, Reward: 35.000, Step: 35
2022-12-07 16:12:05 - r - INFO: - Episode: 490/1500, Reward: 20.000, Step: 20
2022-12-07 16:12:05 - r - INFO: - Episode: 491/1500, Reward: 20.000, Step: 20
2022-12-07 16:12:05 - r - INFO: - Episode: 492/1500, Reward: 42.000, Step: 42
2022-12-07 16:12:05 - r - INFO: - Episode: 493/1500, Reward: 21.000, Step: 21
2022-12-07 16:12:05 - r - INFO: - Episode: 494/1500, Reward: 23.000, Step: 23
2022-12-07 16:12:05 - r - INFO: - Episode: 495/1500, Reward: 19.000, Step: 19
2022-12-07 16:12:06 - r - INFO: - Episode: 496/1500, Reward: 27.000, Step: 27
2022-12-07 16:12:06 - r - INFO: - Episode: 497/1500, Reward: 13.000, Step: 13
2022-12-07 16:12:06 - r - INFO: - Episode: 498/1500, Reward: 18.000, Step: 18
2022-12-07 16:12:29 - r - INFO: - Episode: 499/1500, Reward: 14.000, Step: 14
2022-12-07 16:12:29 - r - INFO: - Episode: 500/1500, Reward: 9.000, Step: 9
2022-12-07 16:12:30 - r - INFO: - Episode: 501/1500, Reward: 14.000, Step: 14
2022-12-07 16:12:30 - r - INFO: - Episode: 502/1500, Reward: 21.000, Step: 21
2022-12-07 16:12:30 - r - INFO: - Episode: 503/1500, Reward: 20.000, Step: 20
2022-12-07 16:12:30 - r - INFO: - Episode: 504/1500, Reward: 25.000, Step: 25
2022-12-07 16:12:30 - r - INFO: - Episode: 505/1500, Reward: 41.000, Step: 41
2022-12-07 16:12:30 - r - INFO: - Episode: 506/1500, Reward: 31.000, Step: 31
2022-12-07 16:12:30 - r - INFO: - Episode: 507/1500, Reward: 13.000, Step: 13
2022-12-07 16:12:30 - r - INFO: - Episode: 508/1500, Reward: 17.000, Step: 17
2022-12-07 16:12:30 - r - INFO: - Episode: 509/1500, Reward: 12.000, Step: 12
2022-12-07 16:12:30 - r - INFO: - Episode: 510/1500, Reward: 13.000, Step: 13
2022-12-07 16:12:30 - r - INFO: - Episode: 511/1500, Reward: 12.000, Step: 12
2022-12-07 16:12:30 - r - INFO: - Episode: 512/1500, Reward: 16.000, Step: 16
2022-12-07 16:12:30 - r - INFO: - Episode: 513/1500, Reward: 50.000, Step: 50
2022-12-07 16:12:30 - r - INFO: - Episode: 514/1500, Reward: 11.000, Step: 11
2022-12-07 16:12:30 - r - INFO: - Episode: 515/1500, Reward: 17.000, Step: 17
2022-12-07 16:12:31 - r - INFO: - Episode: 516/1500, Reward: 19.000, Step: 19
2022-12-07 16:12:31 - r - INFO: - Episode: 517/1500, Reward: 12.000, Step: 12
2022-12-07 16:12:31 - r - INFO: - Episode: 518/1500, Reward: 13.000, Step: 13
2022-12-07 16:12:31 - r - INFO: - Episode: 519/1500, Reward: 17.000, Step: 17
2022-12-07 16:12:31 - r - INFO: - Episode: 520/1500, Reward: 23.000, Step: 23
2022-12-07 16:12:31 - r - INFO: - Episode: 521/1500, Reward: 18.000, Step: 18
2022-12-07 16:12:31 - r - INFO: - Episode: 522/1500, Reward: 38.000, Step: 38
2022-12-07 16:12:31 - r - INFO: - Episode: 523/1500, Reward: 30.000, Step: 30
2022-12-07 16:12:31 - r - INFO: - Episode: 524/1500, Reward: 28.000, Step: 28
2022-12-07 16:12:31 - r - INFO: - Episode: 525/1500, Reward: 28.000, Step: 28
2022-12-07 16:12:31 - r - INFO: - Episode: 526/1500, Reward: 22.000, Step: 22
2022-12-07 16:12:31 - r - INFO: - Episode: 527/1500, Reward: 14.000, Step: 14
2022-12-07 16:12:31 - r - INFO: - Episode: 528/1500, Reward: 12.000, Step: 12
2022-12-07 16:12:31 - r - INFO: - Episode: 529/1500, Reward: 46.000, Step: 46
2022-12-07 16:12:31 - r - INFO: - Episode: 530/1500, Reward: 32.000, Step: 32
2022-12-07 16:12:31 - r - INFO: - Episode: 531/1500, Reward: 37.000, Step: 37
2022-12-07 16:12:31 - r - INFO: - Episode: 532/1500, Reward: 17.000, Step: 17
2022-12-07 16:12:32 - r - INFO: - Episode: 533/1500, Reward: 21.000, Step: 21
2022-12-07 16:12:32 - r - INFO: - Episode: 534/1500, Reward: 11.000, Step: 11
2022-12-07 16:12:32 - r - INFO: - Episode: 535/1500, Reward: 16.000, Step: 16
2022-12-07 16:12:32 - r - INFO: - Episode: 536/1500, Reward: 10.000, Step: 10
2022-12-07 16:12:32 - r - INFO: - Episode: 537/1500, Reward: 15.000, Step: 15
2022-12-07 16:12:32 - r - INFO: - Episode: 538/1500, Reward: 39.000, Step: 39
2022-12-07 16:12:32 - r - INFO: - Episode: 539/1500, Reward: 67.000, Step: 67
2022-12-07 16:12:32 - r - INFO: - Episode: 540/1500, Reward: 33.000, Step: 33
2022-12-07 16:12:32 - r - INFO: - Episode: 541/1500, Reward: 25.000, Step: 25
2022-12-07 16:12:32 - r - INFO: - Episode: 542/1500, Reward: 30.000, Step: 30
2022-12-07 16:12:32 - r - INFO: - Episode: 543/1500, Reward: 32.000, Step: 32
2022-12-07 16:12:32 - r - INFO: - Episode: 544/1500, Reward: 43.000, Step: 43
2022-12-07 16:12:32 - r - INFO: - Episode: 545/1500, Reward: 21.000, Step: 21
2022-12-07 16:12:32 - r - INFO: - Episode: 546/1500, Reward: 23.000, Step: 23
2022-12-07 16:12:32 - r - INFO: - Episode: 547/1500, Reward: 14.000, Step: 14
2022-12-07 16:12:33 - r - INFO: - Episode: 548/1500, Reward: 22.000, Step: 22
2022-12-07 16:12:33 - r - INFO: - Episode: 549/1500, Reward: 28.000, Step: 28
2022-12-07 16:12:33 - r - INFO: - Episode: 550/1500, Reward: 27.000, Step: 27
2022-12-07 16:12:33 - r - INFO: - Episode: 551/1500, Reward: 37.000, Step: 37
2022-12-07 16:12:33 - r - INFO: - Episode: 552/1500, Reward: 21.000, Step: 21
2022-12-07 16:12:33 - r - INFO: - Episode: 553/1500, Reward: 18.000, Step: 18
2022-12-07 16:12:33 - r - INFO: - Episode: 554/1500, Reward: 19.000, Step: 19
2022-12-07 16:12:33 - r - INFO: - Episode: 555/1500, Reward: 36.000, Step: 36
2022-12-07 16:12:33 - r - INFO: - Episode: 556/1500, Reward: 33.000, Step: 33
2022-12-07 16:12:33 - r - INFO: - Episode: 557/1500, Reward: 41.000, Step: 41
2022-12-07 16:12:33 - r - INFO: - Episode: 558/1500, Reward: 41.000, Step: 41
2022-12-07 16:12:33 - r - INFO: - Episode: 559/1500, Reward: 28.000, Step: 28
2022-12-07 16:12:33 - r - INFO: - Episode: 560/1500, Reward: 16.000, Step: 16
2022-12-07 16:12:33 - r - INFO: - Episode: 561/1500, Reward: 24.000, Step: 24
2022-12-07 16:12:34 - r - INFO: - Episode: 562/1500, Reward: 26.000, Step: 26
2022-12-07 16:12:34 - r - INFO: - Episode: 563/1500, Reward: 29.000, Step: 29
2022-12-07 16:12:34 - r - INFO: - Episode: 564/1500, Reward: 21.000, Step: 21
2022-12-07 16:12:34 - r - INFO: - Episode: 565/1500, Reward: 17.000, Step: 17
2022-12-07 16:12:34 - r - INFO: - Episode: 566/1500, Reward: 22.000, Step: 22
2022-12-07 16:12:34 - r - INFO: - Episode: 567/1500, Reward: 23.000, Step: 23
2022-12-07 16:12:34 - r - INFO: - Episode: 568/1500, Reward: 13.000, Step: 13
2022-12-07 16:12:34 - r - INFO: - Episode: 569/1500, Reward: 30.000, Step: 30
2022-12-07 16:12:34 - r - INFO: - Episode: 570/1500, Reward: 24.000, Step: 24
2022-12-07 16:12:34 - r - INFO: - Episode: 571/1500, Reward: 41.000, Step: 41
2022-12-07 16:12:34 - r - INFO: - Episode: 572/1500, Reward: 14.000, Step: 14
2022-12-07 16:12:34 - r - INFO: - Episode: 573/1500, Reward: 32.000, Step: 32
2022-12-07 16:12:34 - r - INFO: - Episode: 574/1500, Reward: 28.000, Step: 28
2022-12-07 16:12:34 - r - INFO: - Episode: 575/1500, Reward: 18.000, Step: 18
2022-12-07 16:12:34 - r - INFO: - Episode: 576/1500, Reward: 34.000, Step: 34
2022-12-07 16:12:34 - r - INFO: - Episode: 577/1500, Reward: 39.000, Step: 39
2022-12-07 16:12:34 - r - INFO: - Episode: 578/1500, Reward: 22.000, Step: 22
2022-12-07 16:12:35 - r - INFO: - Episode: 579/1500, Reward: 16.000, Step: 16
2022-12-07 16:12:35 - r - INFO: - Episode: 580/1500, Reward: 24.000, Step: 24
2022-12-07 16:12:35 - r - INFO: - Current episode 580 has the best eval reward: 30.500
2022-12-07 16:12:35 - r - INFO: - Episode: 581/1500, Reward: 34.000, Step: 34
2022-12-07 16:12:58 - r - INFO: - Episode: 582/1500, Reward: 64.000, Step: 64
2022-12-07 16:12:58 - r - INFO: - Episode: 583/1500, Reward: 43.000, Step: 43
2022-12-07 16:12:58 - r - INFO: - Episode: 584/1500, Reward: 20.000, Step: 20
2022-12-07 16:12:58 - r - INFO: - Episode: 585/1500, Reward: 11.000, Step: 11
2022-12-07 16:12:59 - r - INFO: - Episode: 586/1500, Reward: 61.000, Step: 61
2022-12-07 16:12:59 - r - INFO: - Episode: 587/1500, Reward: 20.000, Step: 20
2022-12-07 16:12:59 - r - INFO: - Episode: 588/1500, Reward: 51.000, Step: 51
2022-12-07 16:12:59 - r - INFO: - Episode: 589/1500, Reward: 21.000, Step: 21
2022-12-07 16:12:59 - r - INFO: - Episode: 590/1500, Reward: 11.000, Step: 11
2022-12-07 16:12:59 - r - INFO: - Current episode 590 has the best eval reward: 31.200
2022-12-07 16:12:59 - r - INFO: - Episode: 591/1500, Reward: 32.000, Step: 32
2022-12-07 16:12:59 - r - INFO: - Episode: 592/1500, Reward: 44.000, Step: 44
2022-12-07 16:12:59 - r - INFO: - Episode: 593/1500, Reward: 26.000, Step: 26
2022-12-07 16:12:59 - r - INFO: - Episode: 594/1500, Reward: 28.000, Step: 28
2022-12-07 16:12:59 - r - INFO: - Episode: 595/1500, Reward: 16.000, Step: 16
2022-12-07 16:12:59 - r - INFO: - Current episode 595 has the best eval reward: 37.000
2022-12-07 16:12:59 - r - INFO: - Episode: 596/1500, Reward: 60.000, Step: 60
2022-12-07 16:12:59 - r - INFO: - Episode: 597/1500, Reward: 14.000, Step: 14
2022-12-07 16:13:00 - r - INFO: - Episode: 598/1500, Reward: 30.000, Step: 30
2022-12-07 16:13:00 - r - INFO: - Episode: 599/1500, Reward: 18.000, Step: 18
2022-12-07 16:13:00 - r - INFO: - Episode: 600/1500, Reward: 32.000, Step: 32
2022-12-07 16:13:00 - r - INFO: - Episode: 601/1500, Reward: 74.000, Step: 74
2022-12-07 16:13:00 - r - INFO: - Episode: 602/1500, Reward: 19.000, Step: 19
2022-12-07 16:13:00 - r - INFO: - Episode: 603/1500, Reward: 30.000, Step: 30
2022-12-07 16:13:00 - r - INFO: - Episode: 604/1500, Reward: 22.000, Step: 22
2022-12-07 16:13:00 - r - INFO: - Episode: 605/1500, Reward: 37.000, Step: 37
2022-12-07 16:13:00 - r - INFO: - Episode: 606/1500, Reward: 12.000, Step: 12
2022-12-07 16:13:00 - r - INFO: - Episode: 607/1500, Reward: 45.000, Step: 45
2022-12-07 16:13:00 - r - INFO: - Episode: 608/1500, Reward: 15.000, Step: 15
2022-12-07 16:13:00 - r - INFO: - Episode: 609/1500, Reward: 38.000, Step: 38
2022-12-07 16:13:00 - r - INFO: - Episode: 610/1500, Reward: 32.000, Step: 32
2022-12-07 16:13:01 - r - INFO: - Episode: 611/1500, Reward: 15.000, Step: 15
2022-12-07 16:13:01 - r - INFO: - Episode: 612/1500, Reward: 45.000, Step: 45
2022-12-07 16:13:01 - r - INFO: - Episode: 613/1500, Reward: 15.000, Step: 15
2022-12-07 16:13:01 - r - INFO: - Episode: 614/1500, Reward: 18.000, Step: 18
2022-12-07 16:13:01 - r - INFO: - Episode: 615/1500, Reward: 59.000, Step: 59
2022-12-07 16:13:01 - r - INFO: - Episode: 616/1500, Reward: 10.000, Step: 10
2022-12-07 16:13:01 - r - INFO: - Episode: 617/1500, Reward: 10.000, Step: 10
2022-12-07 16:13:01 - r - INFO: - Episode: 618/1500, Reward: 15.000, Step: 15
2022-12-07 16:13:01 - r - INFO: - Episode: 619/1500, Reward: 48.000, Step: 48
2022-12-07 16:13:01 - r - INFO: - Episode: 620/1500, Reward: 12.000, Step: 12
2022-12-07 16:13:01 - r - INFO: - Episode: 621/1500, Reward: 23.000, Step: 23
2022-12-07 16:13:01 - r - INFO: - Episode: 622/1500, Reward: 20.000, Step: 20
2022-12-07 16:13:01 - r - INFO: - Episode: 623/1500, Reward: 42.000, Step: 42
2022-12-07 16:13:01 - r - INFO: - Episode: 624/1500, Reward: 18.000, Step: 18
2022-12-07 16:13:01 - r - INFO: - Episode: 625/1500, Reward: 9.000, Step: 9
2022-12-07 16:13:02 - r - INFO: - Episode: 626/1500, Reward: 29.000, Step: 29
2022-12-07 16:13:02 - r - INFO: - Episode: 627/1500, Reward: 15.000, Step: 15
2022-12-07 16:13:02 - r - INFO: - Episode: 628/1500, Reward: 20.000, Step: 20
2022-12-07 16:13:02 - r - INFO: - Episode: 629/1500, Reward: 18.000, Step: 18
2022-12-07 16:13:02 - r - INFO: - Episode: 630/1500, Reward: 14.000, Step: 14
2022-12-07 16:13:02 - r - INFO: - Episode: 631/1500, Reward: 22.000, Step: 22
2022-12-07 16:13:02 - r - INFO: - Episode: 632/1500, Reward: 33.000, Step: 33
2022-12-07 16:13:02 - r - INFO: - Episode: 633/1500, Reward: 20.000, Step: 20
2022-12-07 16:13:02 - r - INFO: - Episode: 634/1500, Reward: 9.000, Step: 9
2022-12-07 16:13:02 - r - INFO: - Episode: 635/1500, Reward: 17.000, Step: 17
2022-12-07 16:13:02 - r - INFO: - Episode: 636/1500, Reward: 31.000, Step: 31
2022-12-07 16:13:02 - r - INFO: - Episode: 637/1500, Reward: 73.000, Step: 73
2022-12-07 16:13:02 - r - INFO: - Episode: 638/1500, Reward: 16.000, Step: 16
2022-12-07 16:13:02 - r - INFO: - Episode: 639/1500, Reward: 10.000, Step: 10
2022-12-07 16:13:02 - r - INFO: - Episode: 640/1500, Reward: 22.000, Step: 22
2022-12-07 16:13:03 - r - INFO: - Episode: 641/1500, Reward: 12.000, Step: 12
2022-12-07 16:13:03 - r - INFO: - Episode: 642/1500, Reward: 34.000, Step: 34
2022-12-07 16:13:03 - r - INFO: - Episode: 643/1500, Reward: 15.000, Step: 15
2022-12-07 16:13:03 - r - INFO: - Episode: 644/1500, Reward: 71.000, Step: 71
2022-12-07 16:13:03 - r - INFO: - Episode: 645/1500, Reward: 40.000, Step: 40
2022-12-07 16:13:03 - r - INFO: - Episode: 646/1500, Reward: 19.000, Step: 19
2022-12-07 16:13:03 - r - INFO: - Episode: 647/1500, Reward: 46.000, Step: 46
2022-12-07 16:13:03 - r - INFO: - Episode: 648/1500, Reward: 32.000, Step: 32
2022-12-07 16:13:03 - r - INFO: - Episode: 649/1500, Reward: 19.000, Step: 19
2022-12-07 16:13:03 - r - INFO: - Episode: 650/1500, Reward: 24.000, Step: 24
2022-12-07 16:13:03 - r - INFO: - Episode: 651/1500, Reward: 54.000, Step: 54
2022-12-07 16:13:03 - r - INFO: - Episode: 652/1500, Reward: 18.000, Step: 18
2022-12-07 16:13:03 - r - INFO: - Episode: 653/1500, Reward: 26.000, Step: 26
2022-12-07 16:13:27 - r - INFO: - Episode: 654/1500, Reward: 42.000, Step: 42
2022-12-07 16:13:27 - r - INFO: - Episode: 655/1500, Reward: 15.000, Step: 15
2022-12-07 16:13:27 - r - INFO: - Episode: 656/1500, Reward: 26.000, Step: 26
2022-12-07 16:13:27 - r - INFO: - Episode: 657/1500, Reward: 40.000, Step: 40
2022-12-07 16:13:27 - r - INFO: - Episode: 658/1500, Reward: 15.000, Step: 15
2022-12-07 16:13:27 - r - INFO: - Episode: 659/1500, Reward: 22.000, Step: 22
2022-12-07 16:13:27 - r - INFO: - Episode: 660/1500, Reward: 40.000, Step: 40
2022-12-07 16:13:27 - r - INFO: - Episode: 661/1500, Reward: 29.000, Step: 29
2022-12-07 16:13:27 - r - INFO: - Episode: 662/1500, Reward: 48.000, Step: 48
2022-12-07 16:13:27 - r - INFO: - Episode: 663/1500, Reward: 15.000, Step: 15
2022-12-07 16:13:27 - r - INFO: - Episode: 664/1500, Reward: 13.000, Step: 13
2022-12-07 16:13:27 - r - INFO: - Episode: 665/1500, Reward: 20.000, Step: 20
2022-12-07 16:13:28 - r - INFO: - Episode: 666/1500, Reward: 12.000, Step: 12
2022-12-07 16:13:28 - r - INFO: - Episode: 667/1500, Reward: 32.000, Step: 32
2022-12-07 16:13:28 - r - INFO: - Episode: 668/1500, Reward: 18.000, Step: 18
2022-12-07 16:13:28 - r - INFO: - Episode: 669/1500, Reward: 13.000, Step: 13
2022-12-07 16:13:28 - r - INFO: - Episode: 670/1500, Reward: 86.000, Step: 86
2022-12-07 16:13:28 - r - INFO: - Current episode 670 has the best eval reward: 42.300
2022-12-07 16:13:28 - r - INFO: - Episode: 671/1500, Reward: 72.000, Step: 72
2022-12-07 16:13:28 - r - INFO: - Episode: 672/1500, Reward: 34.000, Step: 34
2022-12-07 16:13:28 - r - INFO: - Episode: 673/1500, Reward: 22.000, Step: 22
2022-12-07 16:13:28 - r - INFO: - Episode: 674/1500, Reward: 22.000, Step: 22
2022-12-07 16:13:28 - r - INFO: - Episode: 675/1500, Reward: 27.000, Step: 27
2022-12-07 16:13:29 - r - INFO: - Episode: 676/1500, Reward: 41.000, Step: 41
2022-12-07 16:13:29 - r - INFO: - Episode: 677/1500, Reward: 18.000, Step: 18
2022-12-07 16:13:29 - r - INFO: - Episode: 678/1500, Reward: 58.000, Step: 58
2022-12-07 16:13:29 - r - INFO: - Episode: 679/1500, Reward: 17.000, Step: 17
2022-12-07 16:13:29 - r - INFO: - Episode: 680/1500, Reward: 33.000, Step: 33
2022-12-07 16:13:29 - r - INFO: - Episode: 681/1500, Reward: 32.000, Step: 32
2022-12-07 16:13:29 - r - INFO: - Episode: 682/1500, Reward: 36.000, Step: 36
2022-12-07 16:13:29 - r - INFO: - Episode: 683/1500, Reward: 23.000, Step: 23
2022-12-07 16:13:29 - r - INFO: - Episode: 684/1500, Reward: 38.000, Step: 38
2022-12-07 16:13:29 - r - INFO: - Episode: 685/1500, Reward: 45.000, Step: 45
2022-12-07 16:13:29 - r - INFO: - Episode: 686/1500, Reward: 44.000, Step: 44
2022-12-07 16:13:29 - r - INFO: - Episode: 687/1500, Reward: 55.000, Step: 55
2022-12-07 16:13:29 - r - INFO: - Episode: 688/1500, Reward: 26.000, Step: 26
2022-12-07 16:13:30 - r - INFO: - Episode: 689/1500, Reward: 43.000, Step: 43
2022-12-07 16:13:30 - r - INFO: - Episode: 690/1500, Reward: 28.000, Step: 28
2022-12-07 16:13:30 - r - INFO: - Episode: 691/1500, Reward: 21.000, Step: 21
2022-12-07 16:13:30 - r - INFO: - Episode: 692/1500, Reward: 25.000, Step: 25
2022-12-07 16:13:30 - r - INFO: - Episode: 693/1500, Reward: 40.000, Step: 40
2022-12-07 16:13:30 - r - INFO: - Episode: 694/1500, Reward: 16.000, Step: 16
2022-12-07 16:13:30 - r - INFO: - Episode: 695/1500, Reward: 19.000, Step: 19
2022-12-07 16:13:30 - r - INFO: - Episode: 696/1500, Reward: 15.000, Step: 15
2022-12-07 16:13:30 - r - INFO: - Episode: 697/1500, Reward: 35.000, Step: 35
2022-12-07 16:13:30 - r - INFO: - Episode: 698/1500, Reward: 12.000, Step: 12
2022-12-07 16:13:30 - r - INFO: - Episode: 699/1500, Reward: 32.000, Step: 32
2022-12-07 16:13:30 - r - INFO: - Episode: 700/1500, Reward: 50.000, Step: 50
2022-12-07 16:13:30 - r - INFO: - Episode: 701/1500, Reward: 46.000, Step: 46
2022-12-07 16:13:30 - r - INFO: - Episode: 702/1500, Reward: 32.000, Step: 32
2022-12-07 16:13:30 - r - INFO: - Episode: 703/1500, Reward: 17.000, Step: 17
2022-12-07 16:13:31 - r - INFO: - Episode: 704/1500, Reward: 30.000, Step: 30
2022-12-07 16:13:31 - r - INFO: - Episode: 705/1500, Reward: 33.000, Step: 33
2022-12-07 16:13:31 - r - INFO: - Episode: 706/1500, Reward: 24.000, Step: 24
2022-12-07 16:13:31 - r - INFO: - Episode: 707/1500, Reward: 25.000, Step: 25
2022-12-07 16:13:31 - r - INFO: - Episode: 708/1500, Reward: 29.000, Step: 29
2022-12-07 16:13:31 - r - INFO: - Episode: 709/1500, Reward: 28.000, Step: 28
2022-12-07 16:13:31 - r - INFO: - Episode: 710/1500, Reward: 28.000, Step: 28
2022-12-07 16:13:31 - r - INFO: - Episode: 711/1500, Reward: 44.000, Step: 44
2022-12-07 16:13:31 - r - INFO: - Episode: 712/1500, Reward: 34.000, Step: 34
2022-12-07 16:13:31 - r - INFO: - Episode: 713/1500, Reward: 39.000, Step: 39
2022-12-07 16:13:31 - r - INFO: - Episode: 714/1500, Reward: 23.000, Step: 23
2022-12-07 16:13:31 - r - INFO: - Episode: 715/1500, Reward: 53.000, Step: 53
2022-12-07 16:13:32 - r - INFO: - Episode: 716/1500, Reward: 26.000, Step: 26
2022-12-07 16:13:32 - r - INFO: - Episode: 717/1500, Reward: 36.000, Step: 36
2022-12-07 16:13:32 - r - INFO: - Episode: 718/1500, Reward: 15.000, Step: 15
2022-12-07 16:13:32 - r - INFO: - Episode: 719/1500, Reward: 25.000, Step: 25
2022-12-07 16:13:55 - r - INFO: - Episode: 720/1500, Reward: 18.000, Step: 18
2022-12-07 16:13:55 - r - INFO: - Episode: 721/1500, Reward: 39.000, Step: 39
2022-12-07 16:13:55 - r - INFO: - Episode: 722/1500, Reward: 17.000, Step: 17
2022-12-07 16:13:55 - r - INFO: - Episode: 723/1500, Reward: 34.000, Step: 34
2022-12-07 16:13:55 - r - INFO: - Episode: 724/1500, Reward: 21.000, Step: 21
2022-12-07 16:13:55 - r - INFO: - Episode: 725/1500, Reward: 43.000, Step: 43
2022-12-07 16:13:55 - r - INFO: - Episode: 726/1500, Reward: 20.000, Step: 20
2022-12-07 16:13:55 - r - INFO: - Episode: 727/1500, Reward: 49.000, Step: 49
2022-12-07 16:13:55 - r - INFO: - Episode: 728/1500, Reward: 21.000, Step: 21
2022-12-07 16:13:55 - r - INFO: - Episode: 729/1500, Reward: 37.000, Step: 37
2022-12-07 16:13:55 - r - INFO: - Episode: 730/1500, Reward: 41.000, Step: 41
2022-12-07 16:13:56 - r - INFO: - Current episode 730 has the best eval reward: 48.200
2022-12-07 16:13:56 - r - INFO: - Episode: 731/1500, Reward: 43.000, Step: 43
2022-12-07 16:13:56 - r - INFO: - Episode: 732/1500, Reward: 36.000, Step: 36
2022-12-07 16:13:56 - r - INFO: - Episode: 733/1500, Reward: 20.000, Step: 20
2022-12-07 16:13:56 - r - INFO: - Episode: 734/1500, Reward: 20.000, Step: 20
2022-12-07 16:13:56 - r - INFO: - Episode: 735/1500, Reward: 22.000, Step: 22
2022-12-07 16:13:56 - r - INFO: - Episode: 736/1500, Reward: 30.000, Step: 30
2022-12-07 16:13:56 - r - INFO: - Episode: 737/1500, Reward: 46.000, Step: 46
2022-12-07 16:13:56 - r - INFO: - Episode: 738/1500, Reward: 32.000, Step: 32
2022-12-07 16:13:56 - r - INFO: - Episode: 739/1500, Reward: 29.000, Step: 29
2022-12-07 16:13:56 - r - INFO: - Episode: 740/1500, Reward: 36.000, Step: 36
2022-12-07 16:13:57 - r - INFO: - Episode: 741/1500, Reward: 12.000, Step: 12
2022-12-07 16:13:57 - r - INFO: - Episode: 742/1500, Reward: 74.000, Step: 74
2022-12-07 16:13:57 - r - INFO: - Episode: 743/1500, Reward: 11.000, Step: 11
2022-12-07 16:13:57 - r - INFO: - Episode: 744/1500, Reward: 26.000, Step: 26
2022-12-07 16:13:57 - r - INFO: - Episode: 745/1500, Reward: 21.000, Step: 21
2022-12-07 16:13:57 - r - INFO: - Episode: 746/1500, Reward: 25.000, Step: 25
2022-12-07 16:13:57 - r - INFO: - Episode: 747/1500, Reward: 19.000, Step: 19
2022-12-07 16:13:57 - r - INFO: - Episode: 748/1500, Reward: 47.000, Step: 47
2022-12-07 16:13:57 - r - INFO: - Episode: 749/1500, Reward: 15.000, Step: 15
2022-12-07 16:13:57 - r - INFO: - Episode: 750/1500, Reward: 22.000, Step: 22
2022-12-07 16:13:58 - r - INFO: - Episode: 751/1500, Reward: 20.000, Step: 20
2022-12-07 16:13:58 - r - INFO: - Episode: 752/1500, Reward: 42.000, Step: 42
2022-12-07 16:13:58 - r - INFO: - Episode: 753/1500, Reward: 26.000, Step: 26
2022-12-07 16:13:58 - r - INFO: - Episode: 754/1500, Reward: 30.000, Step: 30
2022-12-07 16:13:58 - r - INFO: - Episode: 755/1500, Reward: 25.000, Step: 25
2022-12-07 16:13:58 - r - INFO: - Episode: 756/1500, Reward: 46.000, Step: 46
2022-12-07 16:13:58 - r - INFO: - Episode: 757/1500, Reward: 32.000, Step: 32
2022-12-07 16:13:58 - r - INFO: - Episode: 758/1500, Reward: 28.000, Step: 28
2022-12-07 16:13:58 - r - INFO: - Episode: 759/1500, Reward: 34.000, Step: 34
2022-12-07 16:13:58 - r - INFO: - Episode: 760/1500, Reward: 35.000, Step: 35
2022-12-07 16:13:58 - r - INFO: - Episode: 761/1500, Reward: 73.000, Step: 73
2022-12-07 16:13:58 - r - INFO: - Episode: 762/1500, Reward: 25.000, Step: 25
2022-12-07 16:13:59 - r - INFO: - Episode: 763/1500, Reward: 13.000, Step: 13
2022-12-07 16:13:59 - r - INFO: - Episode: 764/1500, Reward: 22.000, Step: 22
2022-12-07 16:13:59 - r - INFO: - Episode: 765/1500, Reward: 39.000, Step: 39
2022-12-07 16:13:59 - r - INFO: - Episode: 766/1500, Reward: 13.000, Step: 13
2022-12-07 16:13:59 - r - INFO: - Episode: 767/1500, Reward: 63.000, Step: 63
2022-12-07 16:13:59 - r - INFO: - Episode: 768/1500, Reward: 25.000, Step: 25
2022-12-07 16:13:59 - r - INFO: - Episode: 769/1500, Reward: 31.000, Step: 31
2022-12-07 16:13:59 - r - INFO: - Episode: 770/1500, Reward: 42.000, Step: 42
2022-12-07 16:13:59 - r - INFO: - Episode: 771/1500, Reward: 21.000, Step: 21
2022-12-07 16:13:59 - r - INFO: - Episode: 772/1500, Reward: 33.000, Step: 33
2022-12-07 16:13:59 - r - INFO: - Episode: 773/1500, Reward: 28.000, Step: 28
2022-12-07 16:13:59 - r - INFO: - Episode: 774/1500, Reward: 36.000, Step: 36
2022-12-07 16:13:59 - r - INFO: - Episode: 775/1500, Reward: 19.000, Step: 19
2022-12-07 16:14:00 - r - INFO: - Episode: 776/1500, Reward: 39.000, Step: 39
2022-12-07 16:14:00 - r - INFO: - Episode: 777/1500, Reward: 19.000, Step: 19
2022-12-07 16:14:00 - r - INFO: - Episode: 778/1500, Reward: 15.000, Step: 15
2022-12-07 16:14:00 - r - INFO: - Episode: 779/1500, Reward: 12.000, Step: 12
2022-12-07 16:14:00 - r - INFO: - Episode: 780/1500, Reward: 33.000, Step: 33
2022-12-07 16:14:00 - r - INFO: - Episode: 781/1500, Reward: 14.000, Step: 14
2022-12-07 16:14:00 - r - INFO: - Episode: 782/1500, Reward: 36.000, Step: 36
2022-12-07 16:14:00 - r - INFO: - Episode: 783/1500, Reward: 20.000, Step: 20
2022-12-07 16:14:00 - r - INFO: - Episode: 784/1500, Reward: 80.000, Step: 80
2022-12-07 16:14:00 - r - INFO: - Episode: 785/1500, Reward: 21.000, Step: 21
2022-12-07 16:14:01 - r - INFO: - Episode: 786/1500, Reward: 44.000, Step: 44
2022-12-07 16:14:24 - r - INFO: - Episode: 787/1500, Reward: 110.000, Step: 110
2022-12-07 16:14:24 - r - INFO: - Episode: 788/1500, Reward: 15.000, Step: 15
2022-12-07 16:14:24 - r - INFO: - Episode: 789/1500, Reward: 20.000, Step: 20
2022-12-07 16:14:24 - r - INFO: - Episode: 790/1500, Reward: 31.000, Step: 31
2022-12-07 16:14:24 - r - INFO: - Episode: 791/1500, Reward: 26.000, Step: 26
2022-12-07 16:14:24 - r - INFO: - Episode: 792/1500, Reward: 41.000, Step: 41
2022-12-07 16:14:24 - r - INFO: - Episode: 793/1500, Reward: 39.000, Step: 39
2022-12-07 16:14:24 - r - INFO: - Episode: 794/1500, Reward: 40.000, Step: 40
2022-12-07 16:14:24 - r - INFO: - Episode: 795/1500, Reward: 42.000, Step: 42
2022-12-07 16:14:24 - r - INFO: - Episode: 796/1500, Reward: 21.000, Step: 21
2022-12-07 16:14:25 - r - INFO: - Episode: 797/1500, Reward: 38.000, Step: 38
2022-12-07 16:14:25 - r - INFO: - Episode: 798/1500, Reward: 19.000, Step: 19
2022-12-07 16:14:25 - r - INFO: - Episode: 799/1500, Reward: 45.000, Step: 45
2022-12-07 16:14:25 - r - INFO: - Episode: 800/1500, Reward: 30.000, Step: 30
2022-12-07 16:14:25 - r - INFO: - Episode: 801/1500, Reward: 11.000, Step: 11
2022-12-07 16:14:25 - r - INFO: - Episode: 802/1500, Reward: 55.000, Step: 55
2022-12-07 16:14:25 - r - INFO: - Episode: 803/1500, Reward: 37.000, Step: 37
2022-12-07 16:14:25 - r - INFO: - Episode: 804/1500, Reward: 114.000, Step: 114
2022-12-07 16:14:25 - r - INFO: - Episode: 805/1500, Reward: 48.000, Step: 48
2022-12-07 16:14:25 - r - INFO: - Episode: 806/1500, Reward: 52.000, Step: 52
2022-12-07 16:14:26 - r - INFO: - Episode: 807/1500, Reward: 29.000, Step: 29
2022-12-07 16:14:26 - r - INFO: - Episode: 808/1500, Reward: 34.000, Step: 34
2022-12-07 16:14:26 - r - INFO: - Episode: 809/1500, Reward: 45.000, Step: 45
2022-12-07 16:14:26 - r - INFO: - Episode: 810/1500, Reward: 24.000, Step: 24
2022-12-07 16:14:26 - r - INFO: - Episode: 811/1500, Reward: 34.000, Step: 34
2022-12-07 16:14:26 - r - INFO: - Episode: 812/1500, Reward: 16.000, Step: 16
2022-12-07 16:14:26 - r - INFO: - Episode: 813/1500, Reward: 28.000, Step: 28
2022-12-07 16:14:26 - r - INFO: - Episode: 814/1500, Reward: 40.000, Step: 40
2022-12-07 16:14:26 - r - INFO: - Episode: 815/1500, Reward: 18.000, Step: 18
2022-12-07 16:14:26 - r - INFO: - Episode: 816/1500, Reward: 24.000, Step: 24
2022-12-07 16:14:26 - r - INFO: - Episode: 817/1500, Reward: 20.000, Step: 20
2022-12-07 16:14:26 - r - INFO: - Episode: 818/1500, Reward: 45.000, Step: 45
2022-12-07 16:14:26 - r - INFO: - Episode: 819/1500, Reward: 102.000, Step: 102
2022-12-07 16:14:26 - r - INFO: - Episode: 820/1500, Reward: 15.000, Step: 15
2022-12-07 16:14:27 - r - INFO: - Episode: 821/1500, Reward: 117.000, Step: 117
2022-12-07 16:14:27 - r - INFO: - Episode: 822/1500, Reward: 21.000, Step: 21
2022-12-07 16:14:27 - r - INFO: - Episode: 823/1500, Reward: 21.000, Step: 21
2022-12-07 16:14:27 - r - INFO: - Episode: 824/1500, Reward: 18.000, Step: 18
2022-12-07 16:14:27 - r - INFO: - Episode: 825/1500, Reward: 61.000, Step: 61
2022-12-07 16:14:27 - r - INFO: - Episode: 826/1500, Reward: 32.000, Step: 32
2022-12-07 16:14:27 - r - INFO: - Episode: 827/1500, Reward: 39.000, Step: 39
2022-12-07 16:14:27 - r - INFO: - Episode: 828/1500, Reward: 22.000, Step: 22
2022-12-07 16:14:27 - r - INFO: - Episode: 829/1500, Reward: 29.000, Step: 29
2022-12-07 16:14:27 - r - INFO: - Episode: 830/1500, Reward: 40.000, Step: 40
2022-12-07 16:14:28 - r - INFO: - Current episode 830 has the best eval reward: 60.400
2022-12-07 16:14:28 - r - INFO: - Episode: 831/1500, Reward: 27.000, Step: 27
2022-12-07 16:14:28 - r - INFO: - Episode: 832/1500, Reward: 26.000, Step: 26
2022-12-07 16:14:28 - r - INFO: - Episode: 833/1500, Reward: 30.000, Step: 30
2022-12-07 16:14:28 - r - INFO: - Episode: 834/1500, Reward: 39.000, Step: 39
2022-12-07 16:14:28 - r - INFO: - Episode: 835/1500, Reward: 32.000, Step: 32
2022-12-07 16:14:28 - r - INFO: - Episode: 836/1500, Reward: 24.000, Step: 24
2022-12-07 16:14:28 - r - INFO: - Episode: 837/1500, Reward: 23.000, Step: 23
2022-12-07 16:14:28 - r - INFO: - Episode: 838/1500, Reward: 56.000, Step: 56
2022-12-07 16:14:28 - r - INFO: - Episode: 839/1500, Reward: 18.000, Step: 18
2022-12-07 16:14:28 - r - INFO: - Episode: 840/1500, Reward: 25.000, Step: 25
2022-12-07 16:14:29 - r - INFO: - Episode: 841/1500, Reward: 30.000, Step: 30
2022-12-07 16:14:52 - r - INFO: - Episode: 842/1500, Reward: 86.000, Step: 86
2022-12-07 16:14:52 - r - INFO: - Episode: 843/1500, Reward: 60.000, Step: 60
2022-12-07 16:14:52 - r - INFO: - Episode: 844/1500, Reward: 54.000, Step: 54
2022-12-07 16:14:52 - r - INFO: - Episode: 845/1500, Reward: 55.000, Step: 55
2022-12-07 16:14:53 - r - INFO: - Episode: 846/1500, Reward: 31.000, Step: 31
2022-12-07 16:14:53 - r - INFO: - Episode: 847/1500, Reward: 68.000, Step: 68
2022-12-07 16:14:53 - r - INFO: - Episode: 848/1500, Reward: 38.000, Step: 38
2022-12-07 16:14:53 - r - INFO: - Episode: 849/1500, Reward: 19.000, Step: 19
2022-12-07 16:14:53 - r - INFO: - Episode: 850/1500, Reward: 31.000, Step: 31
2022-12-07 16:14:53 - r - INFO: - Episode: 851/1500, Reward: 57.000, Step: 57
2022-12-07 16:14:53 - r - INFO: - Episode: 852/1500, Reward: 78.000, Step: 78
2022-12-07 16:14:53 - r - INFO: - Episode: 853/1500, Reward: 25.000, Step: 25
2022-12-07 16:14:53 - r - INFO: - Episode: 854/1500, Reward: 57.000, Step: 57
2022-12-07 16:14:53 - r - INFO: - Episode: 855/1500, Reward: 29.000, Step: 29
2022-12-07 16:14:54 - r - INFO: - Episode: 856/1500, Reward: 26.000, Step: 26
2022-12-07 16:14:54 - r - INFO: - Episode: 857/1500, Reward: 23.000, Step: 23
2022-12-07 16:14:54 - r - INFO: - Episode: 858/1500, Reward: 18.000, Step: 18
2022-12-07 16:14:54 - r - INFO: - Episode: 859/1500, Reward: 26.000, Step: 26
2022-12-07 16:14:54 - r - INFO: - Episode: 860/1500, Reward: 30.000, Step: 30
2022-12-07 16:14:54 - r - INFO: - Episode: 861/1500, Reward: 59.000, Step: 59
2022-12-07 16:14:54 - r - INFO: - Episode: 862/1500, Reward: 69.000, Step: 69
2022-12-07 16:14:54 - r - INFO: - Episode: 863/1500, Reward: 54.000, Step: 54
2022-12-07 16:14:54 - r - INFO: - Episode: 864/1500, Reward: 68.000, Step: 68
2022-12-07 16:14:55 - r - INFO: - Episode: 865/1500, Reward: 118.000, Step: 118
2022-12-07 16:14:55 - r - INFO: - Episode: 866/1500, Reward: 44.000, Step: 44
2022-12-07 16:14:55 - r - INFO: - Episode: 867/1500, Reward: 74.000, Step: 74
2022-12-07 16:14:55 - r - INFO: - Episode: 868/1500, Reward: 65.000, Step: 65
2022-12-07 16:14:55 - r - INFO: - Episode: 869/1500, Reward: 73.000, Step: 73
2022-12-07 16:14:55 - r - INFO: - Episode: 870/1500, Reward: 42.000, Step: 42
2022-12-07 16:14:56 - r - INFO: - Episode: 871/1500, Reward: 27.000, Step: 27
2022-12-07 16:14:56 - r - INFO: - Episode: 872/1500, Reward: 20.000, Step: 20
2022-12-07 16:14:56 - r - INFO: - Episode: 873/1500, Reward: 59.000, Step: 59
2022-12-07 16:14:56 - r - INFO: - Episode: 874/1500, Reward: 36.000, Step: 36
2022-12-07 16:14:56 - r - INFO: - Episode: 875/1500, Reward: 24.000, Step: 24
2022-12-07 16:14:56 - r - INFO: - Episode: 876/1500, Reward: 71.000, Step: 71
2022-12-07 16:14:56 - r - INFO: - Episode: 877/1500, Reward: 35.000, Step: 35
2022-12-07 16:14:56 - r - INFO: - Episode: 878/1500, Reward: 37.000, Step: 37
2022-12-07 16:14:56 - r - INFO: - Episode: 879/1500, Reward: 73.000, Step: 73
2022-12-07 16:14:56 - r - INFO: - Episode: 880/1500, Reward: 44.000, Step: 44
2022-12-07 16:14:57 - r - INFO: - Episode: 881/1500, Reward: 72.000, Step: 72
2022-12-07 16:14:57 - r - INFO: - Episode: 882/1500, Reward: 26.000, Step: 26
2022-12-07 16:15:20 - r - INFO: - Episode: 883/1500, Reward: 62.000, Step: 62
2022-12-07 16:15:20 - r - INFO: - Episode: 884/1500, Reward: 33.000, Step: 33
2022-12-07 16:15:20 - r - INFO: - Episode: 885/1500, Reward: 21.000, Step: 21
2022-12-07 16:15:20 - r - INFO: - Episode: 886/1500, Reward: 23.000, Step: 23
2022-12-07 16:15:20 - r - INFO: - Episode: 887/1500, Reward: 26.000, Step: 26
2022-12-07 16:15:20 - r - INFO: - Episode: 888/1500, Reward: 33.000, Step: 33
2022-12-07 16:15:20 - r - INFO: - Episode: 889/1500, Reward: 27.000, Step: 27
2022-12-07 16:15:20 - r - INFO: - Episode: 890/1500, Reward: 24.000, Step: 24
2022-12-07 16:15:21 - r - INFO: - Episode: 891/1500, Reward: 63.000, Step: 63
2022-12-07 16:15:21 - r - INFO: - Episode: 892/1500, Reward: 49.000, Step: 49
2022-12-07 16:15:21 - r - INFO: - Episode: 893/1500, Reward: 30.000, Step: 30
2022-12-07 16:15:21 - r - INFO: - Episode: 894/1500, Reward: 20.000, Step: 20
2022-12-07 16:15:21 - r - INFO: - Episode: 895/1500, Reward: 48.000, Step: 48
2022-12-07 16:15:21 - r - INFO: - Episode: 896/1500, Reward: 31.000, Step: 31
2022-12-07 16:15:22 - r - INFO: - Episode: 897/1500, Reward: 96.000, Step: 96
2022-12-07 16:15:22 - r - INFO: - Episode: 898/1500, Reward: 67.000, Step: 67
2022-12-07 16:15:22 - r - INFO: - Episode: 899/1500, Reward: 58.000, Step: 58
2022-12-07 16:15:22 - r - INFO: - Episode: 900/1500, Reward: 40.000, Step: 40
2022-12-07 16:15:22 - r - INFO: - Episode: 901/1500, Reward: 25.000, Step: 25
2022-12-07 16:15:22 - r - INFO: - Episode: 902/1500, Reward: 18.000, Step: 18
2022-12-07 16:15:22 - r - INFO: - Episode: 903/1500, Reward: 22.000, Step: 22
2022-12-07 16:15:22 - r - INFO: - Episode: 904/1500, Reward: 74.000, Step: 74
2022-12-07 16:15:22 - r - INFO: - Episode: 905/1500, Reward: 26.000, Step: 26
2022-12-07 16:15:23 - r - INFO: - Episode: 906/1500, Reward: 18.000, Step: 18
2022-12-07 16:15:23 - r - INFO: - Episode: 907/1500, Reward: 38.000, Step: 38
2022-12-07 16:15:23 - r - INFO: - Episode: 908/1500, Reward: 22.000, Step: 22
2022-12-07 16:15:23 - r - INFO: - Episode: 909/1500, Reward: 50.000, Step: 50
2022-12-07 16:15:23 - r - INFO: - Episode: 910/1500, Reward: 15.000, Step: 15
2022-12-07 16:15:23 - r - INFO: - Current episode 910 has the best eval reward: 64.400
2022-12-07 16:15:23 - r - INFO: - Episode: 911/1500, Reward: 27.000, Step: 27
2022-12-07 16:15:23 - r - INFO: - Episode: 912/1500, Reward: 39.000, Step: 39
2022-12-07 16:15:23 - r - INFO: - Episode: 913/1500, Reward: 87.000, Step: 87
2022-12-07 16:15:24 - r - INFO: - Episode: 914/1500, Reward: 148.000, Step: 148
2022-12-07 16:15:24 - r - INFO: - Episode: 915/1500, Reward: 13.000, Step: 13
2022-12-07 16:15:24 - r - INFO: - Episode: 916/1500, Reward: 89.000, Step: 89
2022-12-07 16:15:24 - r - INFO: - Episode: 917/1500, Reward: 56.000, Step: 56
2022-12-07 16:15:24 - r - INFO: - Episode: 918/1500, Reward: 37.000, Step: 37
2022-12-07 16:15:24 - r - INFO: - Episode: 919/1500, Reward: 22.000, Step: 22
2022-12-07 16:15:24 - r - INFO: - Episode: 920/1500, Reward: 20.000, Step: 20
2022-12-07 16:15:24 - r - INFO: - Episode: 921/1500, Reward: 80.000, Step: 80
2022-12-07 16:15:24 - r - INFO: - Episode: 922/1500, Reward: 71.000, Step: 71
2022-12-07 16:15:25 - r - INFO: - Episode: 923/1500, Reward: 50.000, Step: 50
2022-12-07 16:15:25 - r - INFO: - Episode: 924/1500, Reward: 33.000, Step: 33
2022-12-07 16:15:25 - r - INFO: - Episode: 925/1500, Reward: 80.000, Step: 80
2022-12-07 16:15:25 - r - INFO: - Current episode 925 has the best eval reward: 69.400
2022-12-07 16:15:25 - r - INFO: - Episode: 926/1500, Reward: 69.000, Step: 69
2022-12-07 16:15:25 - r - INFO: - Episode: 927/1500, Reward: 28.000, Step: 28
2022-12-07 16:15:25 - r - INFO: - Episode: 928/1500, Reward: 55.000, Step: 55
2022-12-07 16:15:49 - r - INFO: - Episode: 929/1500, Reward: 55.000, Step: 55
2022-12-07 16:15:49 - r - INFO: - Episode: 930/1500, Reward: 94.000, Step: 94
2022-12-07 16:15:50 - r - INFO: - Current episode 930 has the best eval reward: 73.000
2022-12-07 16:15:50 - r - INFO: - Episode: 931/1500, Reward: 86.000, Step: 86
2022-12-07 16:15:50 - r - INFO: - Episode: 932/1500, Reward: 83.000, Step: 83
2022-12-07 16:15:50 - r - INFO: - Episode: 933/1500, Reward: 64.000, Step: 64
2022-12-07 16:15:50 - r - INFO: - Episode: 934/1500, Reward: 94.000, Step: 94
2022-12-07 16:15:50 - r - INFO: - Episode: 935/1500, Reward: 17.000, Step: 17
2022-12-07 16:15:51 - r - INFO: - Episode: 936/1500, Reward: 104.000, Step: 104
2022-12-07 16:15:51 - r - INFO: - Episode: 937/1500, Reward: 37.000, Step: 37
2022-12-07 16:15:51 - r - INFO: - Episode: 938/1500, Reward: 51.000, Step: 51
2022-12-07 16:15:51 - r - INFO: - Episode: 939/1500, Reward: 33.000, Step: 33
2022-12-07 16:15:51 - r - INFO: - Episode: 940/1500, Reward: 106.000, Step: 106
2022-12-07 16:15:51 - r - INFO: - Episode: 941/1500, Reward: 73.000, Step: 73
2022-12-07 16:15:51 - r - INFO: - Episode: 942/1500, Reward: 54.000, Step: 54
2022-12-07 16:15:51 - r - INFO: - Episode: 943/1500, Reward: 39.000, Step: 39
2022-12-07 16:15:51 - r - INFO: - Episode: 944/1500, Reward: 52.000, Step: 52
2022-12-07 16:15:52 - r - INFO: - Episode: 945/1500, Reward: 127.000, Step: 127
2022-12-07 16:15:52 - r - INFO: - Episode: 946/1500, Reward: 34.000, Step: 34
2022-12-07 16:15:52 - r - INFO: - Episode: 947/1500, Reward: 32.000, Step: 32
2022-12-07 16:15:52 - r - INFO: - Episode: 948/1500, Reward: 32.000, Step: 32
2022-12-07 16:15:52 - r - INFO: - Episode: 949/1500, Reward: 47.000, Step: 47
2022-12-07 16:15:52 - r - INFO: - Episode: 950/1500, Reward: 15.000, Step: 15
2022-12-07 16:15:53 - r - INFO: - Episode: 951/1500, Reward: 34.000, Step: 34
2022-12-07 16:15:53 - r - INFO: - Episode: 952/1500, Reward: 47.000, Step: 47
2022-12-07 16:15:53 - r - INFO: - Episode: 953/1500, Reward: 32.000, Step: 32
2022-12-07 16:15:53 - r - INFO: - Episode: 954/1500, Reward: 29.000, Step: 29
2022-12-07 16:15:53 - r - INFO: - Episode: 955/1500, Reward: 64.000, Step: 64
2022-12-07 16:15:53 - r - INFO: - Episode: 956/1500, Reward: 73.000, Step: 73
2022-12-07 16:15:53 - r - INFO: - Episode: 957/1500, Reward: 39.000, Step: 39
2022-12-07 16:15:53 - r - INFO: - Episode: 958/1500, Reward: 33.000, Step: 33
2022-12-07 16:15:53 - r - INFO: - Episode: 959/1500, Reward: 25.000, Step: 25
2022-12-07 16:15:53 - r - INFO: - Episode: 960/1500, Reward: 56.000, Step: 56
2022-12-07 16:15:54 - r - INFO: - Episode: 961/1500, Reward: 34.000, Step: 34
2022-12-07 16:15:54 - r - INFO: - Episode: 962/1500, Reward: 47.000, Step: 47
2022-12-07 16:15:54 - r - INFO: - Episode: 963/1500, Reward: 36.000, Step: 36
2022-12-07 16:15:54 - r - INFO: - Episode: 964/1500, Reward: 85.000, Step: 85
2022-12-07 16:15:54 - r - INFO: - Episode: 965/1500, Reward: 58.000, Step: 58
2022-12-07 16:15:54 - r - INFO: - Current episode 965 has the best eval reward: 73.300
2022-12-07 16:15:55 - r - INFO: - Episode: 966/1500, Reward: 20.000, Step: 20
2022-12-07 16:16:18 - r - INFO: - Episode: 967/1500, Reward: 153.000, Step: 153
2022-12-07 16:16:18 - r - INFO: - Episode: 968/1500, Reward: 35.000, Step: 35
2022-12-07 16:16:18 - r - INFO: - Episode: 969/1500, Reward: 55.000, Step: 55
2022-12-07 16:16:18 - r - INFO: - Episode: 970/1500, Reward: 66.000, Step: 66
2022-12-07 16:16:19 - r - INFO: - Episode: 971/1500, Reward: 41.000, Step: 41
2022-12-07 16:16:19 - r - INFO: - Episode: 972/1500, Reward: 76.000, Step: 76
2022-12-07 16:16:19 - r - INFO: - Episode: 973/1500, Reward: 88.000, Step: 88
2022-12-07 16:16:19 - r - INFO: - Episode: 974/1500, Reward: 35.000, Step: 35
2022-12-07 16:16:19 - r - INFO: - Episode: 975/1500, Reward: 35.000, Step: 35
2022-12-07 16:16:19 - r - INFO: - Episode: 976/1500, Reward: 105.000, Step: 105
2022-12-07 16:16:20 - r - INFO: - Episode: 977/1500, Reward: 116.000, Step: 116
2022-12-07 16:16:20 - r - INFO: - Episode: 978/1500, Reward: 58.000, Step: 58
2022-12-07 16:16:20 - r - INFO: - Episode: 979/1500, Reward: 50.000, Step: 50
2022-12-07 16:16:20 - r - INFO: - Episode: 980/1500, Reward: 26.000, Step: 26
2022-12-07 16:16:20 - r - INFO: - Episode: 981/1500, Reward: 76.000, Step: 76
2022-12-07 16:16:20 - r - INFO: - Episode: 982/1500, Reward: 46.000, Step: 46
2022-12-07 16:16:20 - r - INFO: - Episode: 983/1500, Reward: 57.000, Step: 57
2022-12-07 16:16:20 - r - INFO: - Episode: 984/1500, Reward: 39.000, Step: 39
2022-12-07 16:16:20 - r - INFO: - Episode: 985/1500, Reward: 40.000, Step: 40
2022-12-07 16:16:21 - r - INFO: - Episode: 986/1500, Reward: 41.000, Step: 41
2022-12-07 16:16:21 - r - INFO: - Episode: 987/1500, Reward: 80.000, Step: 80
2022-12-07 16:16:21 - r - INFO: - Episode: 988/1500, Reward: 98.000, Step: 98
2022-12-07 16:16:21 - r - INFO: - Episode: 989/1500, Reward: 57.000, Step: 57
2022-12-07 16:16:21 - r - INFO: - Episode: 990/1500, Reward: 89.000, Step: 89
2022-12-07 16:16:22 - r - INFO: - Episode: 991/1500, Reward: 124.000, Step: 124
2022-12-07 16:16:22 - r - INFO: - Episode: 992/1500, Reward: 42.000, Step: 42
2022-12-07 16:16:22 - r - INFO: - Episode: 993/1500, Reward: 36.000, Step: 36
2022-12-07 16:16:22 - r - INFO: - Episode: 994/1500, Reward: 41.000, Step: 41
2022-12-07 16:16:22 - r - INFO: - Episode: 995/1500, Reward: 67.000, Step: 67
2022-12-07 16:16:22 - r - INFO: - Current episode 995 has the best eval reward: 94.400
2022-12-07 16:16:23 - r - INFO: - Episode: 996/1500, Reward: 130.000, Step: 130
2022-12-07 16:16:23 - r - INFO: - Episode: 997/1500, Reward: 91.000, Step: 91
2022-12-07 16:16:46 - r - INFO: - Episode: 998/1500, Reward: 36.000, Step: 36
2022-12-07 16:16:46 - r - INFO: - Episode: 999/1500, Reward: 76.000, Step: 76
2022-12-07 16:16:46 - r - INFO: - Episode: 1000/1500, Reward: 37.000, Step: 37
2022-12-07 16:16:46 - r - INFO: - Episode: 1001/1500, Reward: 28.000, Step: 28
2022-12-07 16:16:46 - r - INFO: - Episode: 1002/1500, Reward: 79.000, Step: 79
2022-12-07 16:16:47 - r - INFO: - Episode: 1003/1500, Reward: 25.000, Step: 25
2022-12-07 16:16:47 - r - INFO: - Episode: 1004/1500, Reward: 41.000, Step: 41
2022-12-07 16:16:47 - r - INFO: - Episode: 1005/1500, Reward: 28.000, Step: 28
2022-12-07 16:16:47 - r - INFO: - Episode: 1006/1500, Reward: 35.000, Step: 35
2022-12-07 16:16:47 - r - INFO: - Episode: 1007/1500, Reward: 85.000, Step: 85
2022-12-07 16:16:47 - r - INFO: - Episode: 1008/1500, Reward: 34.000, Step: 34
2022-12-07 16:16:47 - r - INFO: - Episode: 1009/1500, Reward: 39.000, Step: 39
2022-12-07 16:16:48 - r - INFO: - Episode: 1010/1500, Reward: 200.000, Step: 200
2022-12-07 16:16:48 - r - INFO: - Episode: 1011/1500, Reward: 39.000, Step: 39
2022-12-07 16:16:48 - r - INFO: - Episode: 1012/1500, Reward: 41.000, Step: 41
2022-12-07 16:16:48 - r - INFO: - Episode: 1013/1500, Reward: 64.000, Step: 64
2022-12-07 16:16:48 - r - INFO: - Episode: 1014/1500, Reward: 56.000, Step: 56
2022-12-07 16:16:48 - r - INFO: - Episode: 1015/1500, Reward: 39.000, Step: 39
2022-12-07 16:16:49 - r - INFO: - Episode: 1016/1500, Reward: 87.000, Step: 87
2022-12-07 16:16:49 - r - INFO: - Episode: 1017/1500, Reward: 48.000, Step: 48
2022-12-07 16:16:49 - r - INFO: - Episode: 1018/1500, Reward: 82.000, Step: 82
2022-12-07 16:16:49 - r - INFO: - Episode: 1019/1500, Reward: 70.000, Step: 70
2022-12-07 16:16:49 - r - INFO: - Episode: 1020/1500, Reward: 129.000, Step: 129
2022-12-07 16:16:50 - r - INFO: - Episode: 1021/1500, Reward: 101.000, Step: 101
2022-12-07 16:16:50 - r - INFO: - Episode: 1022/1500, Reward: 49.000, Step: 49
2022-12-07 16:16:50 - r - INFO: - Episode: 1023/1500, Reward: 199.000, Step: 199
2022-12-07 16:16:50 - r - INFO: - Episode: 1024/1500, Reward: 102.000, Step: 102
2022-12-07 16:16:50 - r - INFO: - Episode: 1025/1500, Reward: 80.000, Step: 80
2022-12-07 16:16:51 - r - INFO: - Episode: 1026/1500, Reward: 30.000, Step: 30
2022-12-07 16:16:51 - r - INFO: - Episode: 1027/1500, Reward: 37.000, Step: 37
2022-12-07 16:16:51 - r - INFO: - Episode: 1028/1500, Reward: 53.000, Step: 53
2022-12-07 16:17:14 - r - INFO: - Episode: 1029/1500, Reward: 147.000, Step: 147
2022-12-07 16:17:14 - r - INFO: - Episode: 1030/1500, Reward: 59.000, Step: 59
2022-12-07 16:17:15 - r - INFO: - Episode: 1031/1500, Reward: 151.000, Step: 151
2022-12-07 16:17:15 - r - INFO: - Episode: 1032/1500, Reward: 87.000, Step: 87
2022-12-07 16:17:15 - r - INFO: - Episode: 1033/1500, Reward: 74.000, Step: 74
2022-12-07 16:17:15 - r - INFO: - Episode: 1034/1500, Reward: 46.000, Step: 46
2022-12-07 16:17:15 - r - INFO: - Episode: 1035/1500, Reward: 78.000, Step: 78
2022-12-07 16:17:16 - r - INFO: - Episode: 1036/1500, Reward: 69.000, Step: 69
2022-12-07 16:17:16 - r - INFO: - Episode: 1037/1500, Reward: 91.000, Step: 91
2022-12-07 16:17:16 - r - INFO: - Episode: 1038/1500, Reward: 79.000, Step: 79
2022-12-07 16:17:16 - r - INFO: - Episode: 1039/1500, Reward: 77.000, Step: 77
2022-12-07 16:17:16 - r - INFO: - Episode: 1040/1500, Reward: 35.000, Step: 35
2022-12-07 16:17:17 - r - INFO: - Episode: 1041/1500, Reward: 91.000, Step: 91
2022-12-07 16:17:17 - r - INFO: - Episode: 1042/1500, Reward: 154.000, Step: 154
2022-12-07 16:17:17 - r - INFO: - Episode: 1043/1500, Reward: 129.000, Step: 129
2022-12-07 16:17:17 - r - INFO: - Episode: 1044/1500, Reward: 67.000, Step: 67
2022-12-07 16:17:17 - r - INFO: - Episode: 1045/1500, Reward: 66.000, Step: 66
2022-12-07 16:17:18 - r - INFO: - Episode: 1046/1500, Reward: 182.000, Step: 182
2022-12-07 16:17:18 - r - INFO: - Episode: 1047/1500, Reward: 43.000, Step: 43
2022-12-07 16:17:18 - r - INFO: - Episode: 1048/1500, Reward: 62.000, Step: 62
2022-12-07 16:17:18 - r - INFO: - Episode: 1049/1500, Reward: 153.000, Step: 153
2022-12-07 16:17:18 - r - INFO: - Episode: 1050/1500, Reward: 25.000, Step: 25
2022-12-07 16:17:19 - r - INFO: - Episode: 1051/1500, Reward: 57.000, Step: 57
2022-12-07 16:17:41 - r - INFO: - Episode: 1052/1500, Reward: 113.000, Step: 113
2022-12-07 16:17:42 - r - INFO: - Episode: 1053/1500, Reward: 78.000, Step: 78
2022-12-07 16:17:42 - r - INFO: - Episode: 1054/1500, Reward: 69.000, Step: 69
2022-12-07 16:17:42 - r - INFO: - Episode: 1055/1500, Reward: 113.000, Step: 113
2022-12-07 16:17:43 - r - INFO: - Current episode 1055 has the best eval reward: 107.100
2022-12-07 16:17:43 - r - INFO: - Episode: 1056/1500, Reward: 112.000, Step: 112
2022-12-07 16:17:43 - r - INFO: - Episode: 1057/1500, Reward: 97.000, Step: 97
2022-12-07 16:17:43 - r - INFO: - Episode: 1058/1500, Reward: 184.000, Step: 184
2022-12-07 16:17:43 - r - INFO: - Episode: 1059/1500, Reward: 184.000, Step: 184
2022-12-07 16:17:43 - r - INFO: - Episode: 1060/1500, Reward: 76.000, Step: 76
2022-12-07 16:17:44 - r - INFO: - Current episode 1060 has the best eval reward: 120.800
2022-12-07 16:17:44 - r - INFO: - Episode: 1061/1500, Reward: 172.000, Step: 172
2022-12-07 16:17:44 - r - INFO: - Episode: 1062/1500, Reward: 84.000, Step: 84
2022-12-07 16:17:44 - r - INFO: - Episode: 1063/1500, Reward: 85.000, Step: 85
2022-12-07 16:17:45 - r - INFO: - Episode: 1064/1500, Reward: 125.000, Step: 125
2022-12-07 16:17:45 - r - INFO: - Episode: 1065/1500, Reward: 52.000, Step: 52
2022-12-07 16:17:45 - r - INFO: - Episode: 1066/1500, Reward: 40.000, Step: 40
2022-12-07 16:17:45 - r - INFO: - Episode: 1067/1500, Reward: 79.000, Step: 79
2022-12-07 16:17:45 - r - INFO: - Episode: 1068/1500, Reward: 183.000, Step: 183
2022-12-07 16:17:46 - r - INFO: - Episode: 1069/1500, Reward: 88.000, Step: 88
2022-12-07 16:17:46 - r - INFO: - Episode: 1070/1500, Reward: 55.000, Step: 55
2022-12-07 16:17:47 - r - INFO: - Current episode 1070 has the best eval reward: 127.400
2022-12-07 16:17:47 - r - INFO: - Episode: 1071/1500, Reward: 53.000, Step: 53
2022-12-07 16:17:47 - r - INFO: - Episode: 1072/1500, Reward: 34.000, Step: 34
2022-12-07 16:18:09 - r - INFO: - Episode: 1073/1500, Reward: 77.000, Step: 77
2022-12-07 16:18:09 - r - INFO: - Episode: 1074/1500, Reward: 68.000, Step: 68
2022-12-07 16:18:09 - r - INFO: - Episode: 1075/1500, Reward: 31.000, Step: 31
2022-12-07 16:18:10 - r - INFO: - Episode: 1076/1500, Reward: 75.000, Step: 75
2022-12-07 16:18:11 - r - INFO: - Episode: 1077/1500, Reward: 200.000, Step: 200
2022-12-07 16:18:11 - r - INFO: - Episode: 1078/1500, Reward: 41.000, Step: 41
2022-12-07 16:18:11 - r - INFO: - Episode: 1079/1500, Reward: 149.000, Step: 149
2022-12-07 16:18:11 - r - INFO: - Episode: 1080/1500, Reward: 113.000, Step: 113
2022-12-07 16:18:12 - r - INFO: - Episode: 1081/1500, Reward: 57.000, Step: 57
2022-12-07 16:18:12 - r - INFO: - Episode: 1082/1500, Reward: 79.000, Step: 79
2022-12-07 16:18:12 - r - INFO: - Episode: 1083/1500, Reward: 38.000, Step: 38
2022-12-07 16:18:12 - r - INFO: - Episode: 1084/1500, Reward: 44.000, Step: 44
2022-12-07 16:18:12 - r - INFO: - Episode: 1085/1500, Reward: 200.000, Step: 200
2022-12-07 16:18:13 - r - INFO: - Current episode 1085 has the best eval reward: 133.400
2022-12-07 16:18:13 - r - INFO: - Episode: 1086/1500, Reward: 39.000, Step: 39
2022-12-07 16:18:13 - r - INFO: - Episode: 1087/1500, Reward: 143.000, Step: 143
2022-12-07 16:18:13 - r - INFO: - Episode: 1088/1500, Reward: 103.000, Step: 103
2022-12-07 16:18:13 - r - INFO: - Episode: 1089/1500, Reward: 35.000, Step: 35
2022-12-07 16:18:13 - r - INFO: - Episode: 1090/1500, Reward: 123.000, Step: 123
2022-12-07 16:18:14 - r - INFO: - Current episode 1090 has the best eval reward: 139.900
2022-12-07 16:18:14 - r - INFO: - Episode: 1091/1500, Reward: 56.000, Step: 56
2022-12-07 16:18:15 - r - INFO: - Episode: 1092/1500, Reward: 177.000, Step: 177
2022-12-07 16:18:15 - r - INFO: - Episode: 1093/1500, Reward: 28.000, Step: 28
2022-12-07 16:18:15 - r - INFO: - Episode: 1094/1500, Reward: 77.000, Step: 77
2022-12-07 16:18:38 - r - INFO: - Episode: 1095/1500, Reward: 200.000, Step: 200
2022-12-07 16:18:39 - r - INFO: - Episode: 1096/1500, Reward: 90.000, Step: 90
2022-12-07 16:18:39 - r - INFO: - Episode: 1097/1500, Reward: 101.000, Step: 101
2022-12-07 16:18:39 - r - INFO: - Episode: 1098/1500, Reward: 69.000, Step: 69
2022-12-07 16:18:39 - r - INFO: - Episode: 1099/1500, Reward: 200.000, Step: 200
2022-12-07 16:18:39 - r - INFO: - Episode: 1100/1500, Reward: 129.000, Step: 129
2022-12-07 16:18:40 - r - INFO: - Episode: 1101/1500, Reward: 72.000, Step: 72
2022-12-07 16:18:41 - r - INFO: - Episode: 1102/1500, Reward: 200.000, Step: 200
2022-12-07 16:18:41 - r - INFO: - Episode: 1103/1500, Reward: 154.000, Step: 154
2022-12-07 16:18:41 - r - INFO: - Episode: 1104/1500, Reward: 62.000, Step: 62
2022-12-07 16:18:41 - r - INFO: - Episode: 1105/1500, Reward: 146.000, Step: 146
2022-12-07 16:18:42 - r - INFO: - Episode: 1106/1500, Reward: 184.000, Step: 184
2022-12-07 16:18:42 - r - INFO: - Episode: 1107/1500, Reward: 138.000, Step: 138
2022-12-07 16:18:42 - r - INFO: - Episode: 1108/1500, Reward: 139.000, Step: 139
2022-12-07 16:18:43 - r - INFO: - Episode: 1109/1500, Reward: 200.000, Step: 200
2022-12-07 16:18:43 - r - INFO: - Episode: 1110/1500, Reward: 27.000, Step: 27
2022-12-07 16:18:44 - r - INFO: - Current episode 1110 has the best eval reward: 150.300
2022-12-07 16:19:07 - r - INFO: - Episode: 1111/1500, Reward: 124.000, Step: 124
2022-12-07 16:19:07 - r - INFO: - Episode: 1112/1500, Reward: 98.000, Step: 98
2022-12-07 16:19:07 - r - INFO: - Episode: 1113/1500, Reward: 114.000, Step: 114
2022-12-07 16:19:07 - r - INFO: - Episode: 1114/1500, Reward: 194.000, Step: 194
2022-12-07 16:19:08 - r - INFO: - Episode: 1115/1500, Reward: 140.000, Step: 140
2022-12-07 16:19:08 - r - INFO: - Episode: 1116/1500, Reward: 52.000, Step: 52
2022-12-07 16:19:09 - r - INFO: - Episode: 1117/1500, Reward: 140.000, Step: 140
2022-12-07 16:19:09 - r - INFO: - Episode: 1118/1500, Reward: 110.000, Step: 110
2022-12-07 16:19:09 - r - INFO: - Episode: 1119/1500, Reward: 125.000, Step: 125
2022-12-07 16:19:09 - r - INFO: - Episode: 1120/1500, Reward: 55.000, Step: 55
2022-12-07 16:19:10 - r - INFO: - Episode: 1121/1500, Reward: 97.000, Step: 97
2022-12-07 16:19:10 - r - INFO: - Episode: 1122/1500, Reward: 148.000, Step: 148
2022-12-07 16:19:10 - r - INFO: - Episode: 1123/1500, Reward: 115.000, Step: 115
2022-12-07 16:19:10 - r - INFO: - Episode: 1124/1500, Reward: 121.000, Step: 121
2022-12-07 16:19:10 - r - INFO: - Episode: 1125/1500, Reward: 123.000, Step: 123
2022-12-07 16:19:11 - r - INFO: - Episode: 1126/1500, Reward: 43.000, Step: 43
2022-12-07 16:19:11 - r - INFO: - Episode: 1127/1500, Reward: 96.000, Step: 96
2022-12-07 16:19:12 - r - INFO: - Episode: 1128/1500, Reward: 111.000, Step: 111
2022-12-07 16:19:35 - r - INFO: - Episode: 1129/1500, Reward: 172.000, Step: 172
2022-12-07 16:19:35 - r - INFO: - Episode: 1130/1500, Reward: 87.000, Step: 87
2022-12-07 16:19:36 - r - INFO: - Episode: 1131/1500, Reward: 116.000, Step: 116
2022-12-07 16:19:36 - r - INFO: - Episode: 1132/1500, Reward: 103.000, Step: 103
2022-12-07 16:19:36 - r - INFO: - Episode: 1133/1500, Reward: 111.000, Step: 111
2022-12-07 16:19:36 - r - INFO: - Episode: 1134/1500, Reward: 81.000, Step: 81
2022-12-07 16:19:37 - r - INFO: - Episode: 1135/1500, Reward: 162.000, Step: 162
2022-12-07 16:19:38 - r - INFO: - Episode: 1136/1500, Reward: 200.000, Step: 200
2022-12-07 16:19:38 - r - INFO: - Episode: 1137/1500, Reward: 69.000, Step: 69
2022-12-07 16:19:38 - r - INFO: - Episode: 1138/1500, Reward: 94.000, Step: 94
2022-12-07 16:19:38 - r - INFO: - Episode: 1139/1500, Reward: 125.000, Step: 125
2022-12-07 16:19:38 - r - INFO: - Episode: 1140/1500, Reward: 82.000, Step: 82
2022-12-07 16:19:39 - r - INFO: - Current episode 1140 has the best eval reward: 158.900
2022-12-07 16:19:39 - r - INFO: - Episode: 1141/1500, Reward: 109.000, Step: 109
2022-12-07 16:19:39 - r - INFO: - Episode: 1142/1500, Reward: 120.000, Step: 120
2022-12-07 16:19:40 - r - INFO: - Episode: 1143/1500, Reward: 96.000, Step: 96
2022-12-07 16:19:40 - r - INFO: - Episode: 1144/1500, Reward: 34.000, Step: 34
2022-12-07 16:19:40 - r - INFO: - Episode: 1145/1500, Reward: 128.000, Step: 128
2022-12-07 16:19:41 - r - INFO: - Episode: 1146/1500, Reward: 62.000, Step: 62
2022-12-07 16:19:41 - r - INFO: - Episode: 1147/1500, Reward: 156.000, Step: 156
2022-12-07 16:20:04 - r - INFO: - Episode: 1148/1500, Reward: 118.000, Step: 118
2022-12-07 16:20:04 - r - INFO: - Episode: 1149/1500, Reward: 166.000, Step: 166
2022-12-07 16:20:05 - r - INFO: - Episode: 1150/1500, Reward: 200.000, Step: 200
2022-12-07 16:20:06 - r - INFO: - Episode: 1151/1500, Reward: 53.000, Step: 53
2022-12-07 16:20:06 - r - INFO: - Episode: 1152/1500, Reward: 89.000, Step: 89
2022-12-07 16:20:06 - r - INFO: - Episode: 1153/1500, Reward: 161.000, Step: 161
2022-12-07 16:20:06 - r - INFO: - Episode: 1154/1500, Reward: 200.000, Step: 200
2022-12-07 16:20:06 - r - INFO: - Episode: 1155/1500, Reward: 200.000, Step: 200
2022-12-07 16:20:07 - r - INFO: - Episode: 1156/1500, Reward: 156.000, Step: 156
2022-12-07 16:20:08 - r - INFO: - Episode: 1157/1500, Reward: 167.000, Step: 167
2022-12-07 16:20:08 - r - INFO: - Episode: 1158/1500, Reward: 38.000, Step: 38
2022-12-07 16:20:08 - r - INFO: - Episode: 1159/1500, Reward: 200.000, Step: 200
2022-12-07 16:20:08 - r - INFO: - Episode: 1160/1500, Reward: 63.000, Step: 63
2022-12-07 16:20:09 - r - INFO: - Episode: 1161/1500, Reward: 73.000, Step: 73
2022-12-07 16:20:09 - r - INFO: - Episode: 1162/1500, Reward: 161.000, Step: 161
2022-12-07 16:20:32 - r - INFO: - Episode: 1163/1500, Reward: 200.000, Step: 200
2022-12-07 16:20:33 - r - INFO: - Episode: 1164/1500, Reward: 200.000, Step: 200
2022-12-07 16:20:33 - r - INFO: - Episode: 1165/1500, Reward: 200.000, Step: 200
2022-12-07 16:20:34 - r - INFO: - Current episode 1165 has the best eval reward: 182.500
2022-12-07 16:20:34 - r - INFO: - Episode: 1166/1500, Reward: 200.000, Step: 200
2022-12-07 16:20:35 - r - INFO: - Episode: 1167/1500, Reward: 200.000, Step: 200
2022-12-07 16:20:35 - r - INFO: - Episode: 1168/1500, Reward: 197.000, Step: 197
2022-12-07 16:20:35 - r - INFO: - Episode: 1169/1500, Reward: 200.000, Step: 200
2022-12-07 16:20:35 - r - INFO: - Episode: 1170/1500, Reward: 200.000, Step: 200
2022-12-07 16:20:37 - r - INFO: - Current episode 1170 has the best eval reward: 199.600
2022-12-07 16:20:37 - r - INFO: - Episode: 1171/1500, Reward: 200.000, Step: 200
2022-12-07 16:20:37 - r - INFO: - Episode: 1172/1500, Reward: 120.000, Step: 120
2022-12-07 16:20:37 - r - INFO: - Episode: 1173/1500, Reward: 121.000, Step: 121
2022-12-07 16:21:00 - r - INFO: - Episode: 1174/1500, Reward: 200.000, Step: 200
2022-12-07 16:21:00 - r - INFO: - Episode: 1175/1500, Reward: 162.000, Step: 162
2022-12-07 16:21:02 - r - INFO: - Episode: 1176/1500, Reward: 157.000, Step: 157
2022-12-07 16:21:02 - r - INFO: - Episode: 1177/1500, Reward: 151.000, Step: 151
2022-12-07 16:21:02 - r - INFO: - Episode: 1178/1500, Reward: 161.000, Step: 161
2022-12-07 16:21:02 - r - INFO: - Episode: 1179/1500, Reward: 115.000, Step: 115
2022-12-07 16:21:02 - r - INFO: - Episode: 1180/1500, Reward: 176.000, Step: 176
2022-12-07 16:21:04 - r - INFO: - Episode: 1181/1500, Reward: 148.000, Step: 148
2022-12-07 16:21:04 - r - INFO: - Episode: 1182/1500, Reward: 200.000, Step: 200
2022-12-07 16:21:04 - r - INFO: - Episode: 1183/1500, Reward: 200.000, Step: 200
2022-12-07 16:21:04 - r - INFO: - Episode: 1184/1500, Reward: 188.000, Step: 188
2022-12-07 16:21:04 - r - INFO: - Episode: 1185/1500, Reward: 176.000, Step: 176
2022-12-07 16:21:29 - r - INFO: - Episode: 1186/1500, Reward: 200.000, Step: 200
2022-12-07 16:21:29 - r - INFO: - Episode: 1187/1500, Reward: 200.000, Step: 200
2022-12-07 16:21:29 - r - INFO: - Episode: 1188/1500, Reward: 200.000, Step: 200
2022-12-07 16:21:29 - r - INFO: - Episode: 1189/1500, Reward: 172.000, Step: 172
2022-12-07 16:21:29 - r - INFO: - Episode: 1190/1500, Reward: 200.000, Step: 200
2022-12-07 16:21:31 - r - INFO: - Episode: 1191/1500, Reward: 200.000, Step: 200
2022-12-07 16:21:31 - r - INFO: - Episode: 1192/1500, Reward: 200.000, Step: 200
2022-12-07 16:21:31 - r - INFO: - Episode: 1193/1500, Reward: 200.000, Step: 200
2022-12-07 16:21:32 - r - INFO: - Episode: 1194/1500, Reward: 180.000, Step: 180
2022-12-07 16:21:32 - r - INFO: - Episode: 1195/1500, Reward: 109.000, Step: 109
2022-12-07 16:21:33 - r - INFO: - Episode: 1196/1500, Reward: 200.000, Step: 200
2022-12-07 16:21:56 - r - INFO: - Episode: 1197/1500, Reward: 200.000, Step: 200
2022-12-07 16:21:56 - r - INFO: - Episode: 1198/1500, Reward: 200.000, Step: 200
2022-12-07 16:21:56 - r - INFO: - Episode: 1199/1500, Reward: 118.000, Step: 118
2022-12-07 16:21:57 - r - INFO: - Episode: 1200/1500, Reward: 200.000, Step: 200
2022-12-07 16:21:58 - r - INFO: - Episode: 1201/1500, Reward: 200.000, Step: 200
2022-12-07 16:21:58 - r - INFO: - Episode: 1202/1500, Reward: 185.000, Step: 185
2022-12-07 16:21:58 - r - INFO: - Episode: 1203/1500, Reward: 200.000, Step: 200
2022-12-07 16:21:59 - r - INFO: - Episode: 1204/1500, Reward: 200.000, Step: 200
2022-12-07 16:21:59 - r - INFO: - Episode: 1205/1500, Reward: 200.000, Step: 200
2022-12-07 16:22:00 - r - INFO: - Episode: 1206/1500, Reward: 200.000, Step: 200
2022-12-07 16:22:00 - r - INFO: - Episode: 1207/1500, Reward: 162.000, Step: 162
2022-12-07 16:22:24 - r - INFO: - Episode: 1208/1500, Reward: 195.000, Step: 195
2022-12-07 16:22:24 - r - INFO: - Episode: 1209/1500, Reward: 200.000, Step: 200
2022-12-07 16:22:24 - r - INFO: - Episode: 1210/1500, Reward: 200.000, Step: 200
2022-12-07 16:22:26 - r - INFO: - Episode: 1211/1500, Reward: 200.000, Step: 200
2022-12-07 16:22:26 - r - INFO: - Episode: 1212/1500, Reward: 114.000, Step: 114
2022-12-07 16:22:26 - r - INFO: - Episode: 1213/1500, Reward: 200.000, Step: 200
2022-12-07 16:22:26 - r - INFO: - Episode: 1214/1500, Reward: 194.000, Step: 194
2022-12-07 16:22:26 - r - INFO: - Episode: 1215/1500, Reward: 132.000, Step: 132
2022-12-07 16:22:28 - r - INFO: - Episode: 1216/1500, Reward: 200.000, Step: 200
2022-12-07 16:22:28 - r - INFO: - Episode: 1217/1500, Reward: 200.000, Step: 200
2022-12-07 16:22:28 - r - INFO: - Episode: 1218/1500, Reward: 200.000, Step: 200
2022-12-07 16:22:51 - r - INFO: - Episode: 1219/1500, Reward: 200.000, Step: 200
2022-12-07 16:22:52 - r - INFO: - Episode: 1220/1500, Reward: 200.000, Step: 200
2022-12-07 16:22:53 - r - INFO: - Episode: 1221/1500, Reward: 200.000, Step: 200
2022-12-07 16:22:53 - r - INFO: - Episode: 1222/1500, Reward: 179.000, Step: 179
2022-12-07 16:22:54 - r - INFO: - Episode: 1223/1500, Reward: 200.000, Step: 200
2022-12-07 16:22:54 - r - INFO: - Episode: 1224/1500, Reward: 200.000, Step: 200
2022-12-07 16:22:54 - r - INFO: - Episode: 1225/1500, Reward: 200.000, Step: 200
2022-12-07 16:22:55 - r - INFO: - Episode: 1226/1500, Reward: 200.000, Step: 200
2022-12-07 16:22:56 - r - INFO: - Episode: 1227/1500, Reward: 200.000, Step: 200
2022-12-07 16:22:56 - r - INFO: - Episode: 1228/1500, Reward: 200.000, Step: 200
2022-12-07 16:23:19 - r - INFO: - Episode: 1229/1500, Reward: 200.000, Step: 200
2022-12-07 16:23:19 - r - INFO: - Episode: 1230/1500, Reward: 200.000, Step: 200
2022-12-07 16:23:21 - r - INFO: - Episode: 1231/1500, Reward: 172.000, Step: 172
2022-12-07 16:23:21 - r - INFO: - Episode: 1232/1500, Reward: 200.000, Step: 200
2022-12-07 16:23:21 - r - INFO: - Episode: 1233/1500, Reward: 186.000, Step: 186
2022-12-07 16:23:21 - r - INFO: - Episode: 1234/1500, Reward: 186.000, Step: 186
2022-12-07 16:23:22 - r - INFO: - Episode: 1235/1500, Reward: 200.000, Step: 200
2022-12-07 16:23:23 - r - INFO: - Episode: 1236/1500, Reward: 200.000, Step: 200
2022-12-07 16:23:23 - r - INFO: - Episode: 1237/1500, Reward: 141.000, Step: 141
2022-12-07 16:23:24 - r - INFO: - Episode: 1238/1500, Reward: 195.000, Step: 195
2022-12-07 16:23:24 - r - INFO: - Episode: 1239/1500, Reward: 200.000, Step: 200
2022-12-07 16:23:47 - r - INFO: - Episode: 1240/1500, Reward: 200.000, Step: 200
2022-12-07 16:23:48 - r - INFO: - Episode: 1241/1500, Reward: 117.000, Step: 117
2022-12-07 16:23:48 - r - INFO: - Episode: 1242/1500, Reward: 179.000, Step: 179
2022-12-07 16:23:49 - r - INFO: - Episode: 1243/1500, Reward: 164.000, Step: 164
2022-12-07 16:23:49 - r - INFO: - Episode: 1244/1500, Reward: 72.000, Step: 72
2022-12-07 16:23:49 - r - INFO: - Episode: 1245/1500, Reward: 200.000, Step: 200
2022-12-07 16:23:50 - r - INFO: - Episode: 1246/1500, Reward: 118.000, Step: 118
2022-12-07 16:23:50 - r - INFO: - Episode: 1247/1500, Reward: 116.000, Step: 116
2022-12-07 16:23:50 - r - INFO: - Episode: 1248/1500, Reward: 130.000, Step: 130
2022-12-07 16:23:50 - r - INFO: - Episode: 1249/1500, Reward: 200.000, Step: 200
2022-12-07 16:23:51 - r - INFO: - Episode: 1250/1500, Reward: 143.000, Step: 143
2022-12-07 16:23:52 - r - INFO: - Episode: 1251/1500, Reward: 128.000, Step: 128
2022-12-07 16:23:52 - r - INFO: - Episode: 1252/1500, Reward: 160.000, Step: 160
2022-12-07 16:23:52 - r - INFO: - Episode: 1253/1500, Reward: 158.000, Step: 158
2022-12-07 16:24:15 - r - INFO: - Episode: 1254/1500, Reward: 200.000, Step: 200
2022-12-07 16:24:15 - r - INFO: - Episode: 1255/1500, Reward: 182.000, Step: 182
2022-12-07 16:24:17 - r - INFO: - Episode: 1256/1500, Reward: 200.000, Step: 200
2022-12-07 16:24:17 - r - INFO: - Episode: 1257/1500, Reward: 175.000, Step: 175
2022-12-07 16:24:17 - r - INFO: - Episode: 1258/1500, Reward: 194.000, Step: 194
2022-12-07 16:24:17 - r - INFO: - Episode: 1259/1500, Reward: 162.000, Step: 162
2022-12-07 16:24:18 - r - INFO: - Episode: 1260/1500, Reward: 149.000, Step: 149
2022-12-07 16:24:19 - r - INFO: - Episode: 1261/1500, Reward: 157.000, Step: 157
2022-12-07 16:24:19 - r - INFO: - Episode: 1262/1500, Reward: 173.000, Step: 173
2022-12-07 16:24:19 - r - INFO: - Episode: 1263/1500, Reward: 140.000, Step: 140
2022-12-07 16:24:19 - r - INFO: - Episode: 1264/1500, Reward: 132.000, Step: 132
2022-12-07 16:24:20 - r - INFO: - Episode: 1265/1500, Reward: 173.000, Step: 173
2022-12-07 16:24:44 - r - INFO: - Episode: 1266/1500, Reward: 200.000, Step: 200
2022-12-07 16:24:44 - r - INFO: - Episode: 1267/1500, Reward: 200.000, Step: 200
2022-12-07 16:24:44 - r - INFO: - Episode: 1268/1500, Reward: 200.000, Step: 200
2022-12-07 16:24:45 - r - INFO: - Episode: 1269/1500, Reward: 200.000, Step: 200
2022-12-07 16:24:45 - r - INFO: - Episode: 1270/1500, Reward: 200.000, Step: 200
2022-12-07 16:24:46 - r - INFO: - Episode: 1271/1500, Reward: 200.000, Step: 200
2022-12-07 16:24:47 - r - INFO: - Episode: 1272/1500, Reward: 176.000, Step: 176
2022-12-07 16:24:47 - r - INFO: - Episode: 1273/1500, Reward: 188.000, Step: 188
2022-12-07 16:24:47 - r - INFO: - Episode: 1274/1500, Reward: 166.000, Step: 166
2022-12-07 16:24:47 - r - INFO: - Episode: 1275/1500, Reward: 34.000, Step: 34
2022-12-07 16:24:48 - r - INFO: - Episode: 1276/1500, Reward: 196.000, Step: 196
2022-12-07 16:25:11 - r - INFO: - Episode: 1277/1500, Reward: 183.000, Step: 183
2022-12-07 16:25:12 - r - INFO: - Episode: 1278/1500, Reward: 200.000, Step: 200
2022-12-07 16:25:12 - r - INFO: - Episode: 1279/1500, Reward: 200.000, Step: 200
2022-12-07 16:25:12 - r - INFO: - Episode: 1280/1500, Reward: 200.000, Step: 200
2022-12-07 16:25:13 - r - INFO: - Episode: 1281/1500, Reward: 176.000, Step: 176
2022-12-07 16:25:14 - r - INFO: - Episode: 1282/1500, Reward: 200.000, Step: 200
2022-12-07 16:25:14 - r - INFO: - Episode: 1283/1500, Reward: 200.000, Step: 200
2022-12-07 16:25:14 - r - INFO: - Episode: 1284/1500, Reward: 200.000, Step: 200
2022-12-07 16:25:14 - r - INFO: - Episode: 1285/1500, Reward: 200.000, Step: 200
2022-12-07 16:25:16 - r - INFO: - Current episode 1285 has the best eval reward: 200.000
2022-12-07 16:25:16 - r - INFO: - Episode: 1286/1500, Reward: 197.000, Step: 197
2022-12-07 16:25:16 - r - INFO: - Episode: 1287/1500, Reward: 200.000, Step: 200
2022-12-07 16:25:40 - r - INFO: - Episode: 1288/1500, Reward: 200.000, Step: 200
2022-12-07 16:25:40 - r - INFO: - Episode: 1289/1500, Reward: 200.000, Step: 200
2022-12-07 16:25:40 - r - INFO: - Episode: 1290/1500, Reward: 178.000, Step: 178
2022-12-07 16:25:42 - r - INFO: - Current episode 1290 has the best eval reward: 200.000
2022-12-07 16:25:42 - r - INFO: - Episode: 1291/1500, Reward: 200.000, Step: 200
2022-12-07 16:25:42 - r - INFO: - Episode: 1292/1500, Reward: 200.000, Step: 200
2022-12-07 16:25:42 - r - INFO: - Episode: 1293/1500, Reward: 200.000, Step: 200
2022-12-07 16:25:42 - r - INFO: - Episode: 1294/1500, Reward: 200.000, Step: 200
2022-12-07 16:25:43 - r - INFO: - Episode: 1295/1500, Reward: 200.000, Step: 200
2022-12-07 16:25:44 - r - INFO: - Current episode 1295 has the best eval reward: 200.000
2022-12-07 16:25:44 - r - INFO: - Episode: 1296/1500, Reward: 200.000, Step: 200
2022-12-07 16:25:44 - r - INFO: - Episode: 1297/1500, Reward: 200.000, Step: 200
2022-12-07 16:26:08 - r - INFO: - Episode: 1298/1500, Reward: 143.000, Step: 143
2022-12-07 16:26:08 - r - INFO: - Episode: 1299/1500, Reward: 200.000, Step: 200
2022-12-07 16:26:08 - r - INFO: - Episode: 1300/1500, Reward: 191.000, Step: 191
2022-12-07 16:26:10 - r - INFO: - Current episode 1300 has the best eval reward: 200.000
2022-12-07 16:26:10 - r - INFO: - Episode: 1301/1500, Reward: 200.000, Step: 200
2022-12-07 16:26:10 - r - INFO: - Episode: 1302/1500, Reward: 200.000, Step: 200
2022-12-07 16:26:10 - r - INFO: - Episode: 1303/1500, Reward: 200.000, Step: 200
2022-12-07 16:26:10 - r - INFO: - Episode: 1304/1500, Reward: 200.000, Step: 200
2022-12-07 16:26:11 - r - INFO: - Episode: 1305/1500, Reward: 190.000, Step: 190
2022-12-07 16:26:12 - r - INFO: - Episode: 1306/1500, Reward: 200.000, Step: 200
2022-12-07 16:26:12 - r - INFO: - Episode: 1307/1500, Reward: 200.000, Step: 200
2022-12-07 16:26:13 - r - INFO: - Episode: 1308/1500, Reward: 200.000, Step: 200
2022-12-07 16:26:36 - r - INFO: - Episode: 1309/1500, Reward: 199.000, Step: 199
2022-12-07 16:26:36 - r - INFO: - Episode: 1310/1500, Reward: 200.000, Step: 200
2022-12-07 16:26:38 - r - INFO: - Episode: 1311/1500, Reward: 186.000, Step: 186
2022-12-07 16:26:38 - r - INFO: - Episode: 1312/1500, Reward: 200.000, Step: 200
2022-12-07 16:26:38 - r - INFO: - Episode: 1313/1500, Reward: 200.000, Step: 200
2022-12-07 16:26:38 - r - INFO: - Episode: 1314/1500, Reward: 200.000, Step: 200
2022-12-07 16:26:39 - r - INFO: - Episode: 1315/1500, Reward: 182.000, Step: 182
2022-12-07 16:26:40 - r - INFO: - Episode: 1316/1500, Reward: 200.000, Step: 200
2022-12-07 16:26:40 - r - INFO: - Episode: 1317/1500, Reward: 200.000, Step: 200
2022-12-07 16:26:41 - r - INFO: - Episode: 1318/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:04 - r - INFO: - Episode: 1319/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:04 - r - INFO: - Episode: 1320/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:06 - r - INFO: - Current episode 1320 has the best eval reward: 200.000
2022-12-07 16:27:06 - r - INFO: - Episode: 1321/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:06 - r - INFO: - Episode: 1322/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:06 - r - INFO: - Episode: 1323/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:07 - r - INFO: - Episode: 1324/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:07 - r - INFO: - Episode: 1325/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:08 - r - INFO: - Episode: 1326/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:09 - r - INFO: - Episode: 1327/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:09 - r - INFO: - Episode: 1328/1500, Reward: 185.000, Step: 185
2022-12-07 16:27:32 - r - INFO: - Episode: 1329/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:32 - r - INFO: - Episode: 1330/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:34 - r - INFO: - Episode: 1331/1500, Reward: 97.000, Step: 97
2022-12-07 16:27:34 - r - INFO: - Episode: 1332/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:34 - r - INFO: - Episode: 1333/1500, Reward: 188.000, Step: 188
2022-12-07 16:27:34 - r - INFO: - Episode: 1334/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:34 - r - INFO: - Episode: 1335/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:36 - r - INFO: - Episode: 1336/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:36 - r - INFO: - Episode: 1337/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:36 - r - INFO: - Episode: 1338/1500, Reward: 200.000, Step: 200
2022-12-07 16:27:37 - r - INFO: - Episode: 1339/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:00 - r - INFO: - Episode: 1340/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:02 - r - INFO: - Episode: 1341/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:02 - r - INFO: - Episode: 1342/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:02 - r - INFO: - Episode: 1343/1500, Reward: 185.000, Step: 185
2022-12-07 16:28:03 - r - INFO: - Episode: 1344/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:03 - r - INFO: - Episode: 1345/1500, Reward: 80.000, Step: 80
2022-12-07 16:28:04 - r - INFO: - Episode: 1346/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:04 - r - INFO: - Episode: 1347/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:05 - r - INFO: - Episode: 1348/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:05 - r - INFO: - Episode: 1349/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:05 - r - INFO: - Episode: 1350/1500, Reward: 170.000, Step: 170
2022-12-07 16:28:30 - r - INFO: - Episode: 1351/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:30 - r - INFO: - Episode: 1352/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:30 - r - INFO: - Episode: 1353/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:30 - r - INFO: - Episode: 1354/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:31 - r - INFO: - Episode: 1355/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:32 - r - INFO: - Episode: 1356/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:32 - r - INFO: - Episode: 1357/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:33 - r - INFO: - Episode: 1358/1500, Reward: 182.000, Step: 182
2022-12-07 16:28:33 - r - INFO: - Episode: 1359/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:33 - r - INFO: - Episode: 1360/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:34 - r - INFO: - Current episode 1360 has the best eval reward: 200.000
2022-12-07 16:28:35 - r - INFO: - Episode: 1361/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:58 - r - INFO: - Episode: 1362/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:58 - r - INFO: - Episode: 1363/1500, Reward: 174.000, Step: 174
2022-12-07 16:28:58 - r - INFO: - Episode: 1364/1500, Reward: 200.000, Step: 200
2022-12-07 16:28:58 - r - INFO: - Episode: 1365/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:00 - r - INFO: - Current episode 1365 has the best eval reward: 200.000
2022-12-07 16:29:00 - r - INFO: - Episode: 1366/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:00 - r - INFO: - Episode: 1367/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:01 - r - INFO: - Episode: 1368/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:01 - r - INFO: - Episode: 1369/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:01 - r - INFO: - Episode: 1370/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:02 - r - INFO: - Current episode 1370 has the best eval reward: 200.000
2022-12-07 16:29:03 - r - INFO: - Episode: 1371/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:26 - r - INFO: - Episode: 1372/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:26 - r - INFO: - Episode: 1373/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:26 - r - INFO: - Episode: 1374/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:27 - r - INFO: - Episode: 1375/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:28 - r - INFO: - Current episode 1375 has the best eval reward: 200.000
2022-12-07 16:29:28 - r - INFO: - Episode: 1376/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:28 - r - INFO: - Episode: 1377/1500, Reward: 183.000, Step: 183
2022-12-07 16:29:29 - r - INFO: - Episode: 1378/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:29 - r - INFO: - Episode: 1379/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:29 - r - INFO: - Episode: 1380/1500, Reward: 184.000, Step: 184
2022-12-07 16:29:30 - r - INFO: - Current episode 1380 has the best eval reward: 200.000
2022-12-07 16:29:31 - r - INFO: - Episode: 1381/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:54 - r - INFO: - Episode: 1382/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:54 - r - INFO: - Episode: 1383/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:54 - r - INFO: - Episode: 1384/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:55 - r - INFO: - Episode: 1385/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:56 - r - INFO: - Episode: 1386/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:56 - r - INFO: - Episode: 1387/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:57 - r - INFO: - Episode: 1388/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:57 - r - INFO: - Episode: 1389/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:57 - r - INFO: - Episode: 1390/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:58 - r - INFO: - Current episode 1390 has the best eval reward: 200.000
2022-12-07 16:29:59 - r - INFO: - Episode: 1391/1500, Reward: 200.000, Step: 200
2022-12-07 16:29:59 - r - INFO: - Episode: 1392/1500, Reward: 200.000, Step: 200
2022-12-07 16:30:22 - r - INFO: - Episode: 1393/1500, Reward: 200.000, Step: 200
2022-12-07 16:30:23 - r - INFO: - Episode: 1394/1500, Reward: 200.000, Step: 200
2022-12-07 16:30:23 - r - INFO: - Episode: 1395/1500, Reward: 200.000, Step: 200
2022-12-07 16:30:24 - r - INFO: - Episode: 1396/1500, Reward: 195.000, Step: 195
2022-12-07 16:30:25 - r - INFO: - Episode: 1397/1500, Reward: 196.000, Step: 196
2022-12-07 16:30:25 - r - INFO: - Episode: 1398/1500, Reward: 200.000, Step: 200
2022-12-07 16:30:25 - r - INFO: - Episode: 1399/1500, Reward: 200.000, Step: 200
2022-12-07 16:30:25 - r - INFO: - Episode: 1400/1500, Reward: 152.000, Step: 152
2022-12-07 16:30:27 - r - INFO: - Episode: 1401/1500, Reward: 175.000, Step: 175
2022-12-07 16:30:27 - r - INFO: - Episode: 1402/1500, Reward: 200.000, Step: 200
2022-12-07 16:30:50 - r - INFO: - Episode: 1403/1500, Reward: 200.000, Step: 200
2022-12-07 16:30:51 - r - INFO: - Episode: 1404/1500, Reward: 185.000, Step: 185
2022-12-07 16:30:51 - r - INFO: - Episode: 1405/1500, Reward: 200.000, Step: 200
2022-12-07 16:30:52 - r - INFO: - Episode: 1406/1500, Reward: 200.000, Step: 200
2022-12-07 16:30:53 - r - INFO: - Episode: 1407/1500, Reward: 200.000, Step: 200
2022-12-07 16:30:53 - r - INFO: - Episode: 1408/1500, Reward: 200.000, Step: 200
2022-12-07 16:30:53 - r - INFO: - Episode: 1409/1500, Reward: 200.000, Step: 200
2022-12-07 16:30:53 - r - INFO: - Episode: 1410/1500, Reward: 156.000, Step: 156
2022-12-07 16:30:55 - r - INFO: - Episode: 1411/1500, Reward: 173.000, Step: 173
2022-12-07 16:30:55 - r - INFO: - Episode: 1412/1500, Reward: 200.000, Step: 200
2022-12-07 16:30:55 - r - INFO: - Episode: 1413/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:20 - r - INFO: - Episode: 1414/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:20 - r - INFO: - Episode: 1415/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:22 - r - INFO: - Current episode 1415 has the best eval reward: 200.000
2022-12-07 16:31:22 - r - INFO: - Episode: 1416/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:22 - r - INFO: - Episode: 1417/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:22 - r - INFO: - Episode: 1418/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:23 - r - INFO: - Episode: 1419/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:23 - r - INFO: - Episode: 1420/1500, Reward: 197.000, Step: 197
2022-12-07 16:31:24 - r - INFO: - Episode: 1421/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:25 - r - INFO: - Episode: 1422/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:25 - r - INFO: - Episode: 1423/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:48 - r - INFO: - Episode: 1424/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:48 - r - INFO: - Episode: 1425/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:50 - r - INFO: - Current episode 1425 has the best eval reward: 200.000
2022-12-07 16:31:50 - r - INFO: - Episode: 1426/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:50 - r - INFO: - Episode: 1427/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:50 - r - INFO: - Episode: 1428/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:51 - r - INFO: - Episode: 1429/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:51 - r - INFO: - Episode: 1430/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:52 - r - INFO: - Current episode 1430 has the best eval reward: 200.000
2022-12-07 16:31:53 - r - INFO: - Episode: 1431/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:53 - r - INFO: - Episode: 1432/1500, Reward: 200.000, Step: 200
2022-12-07 16:31:53 - r - INFO: - Episode: 1433/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:16 - r - INFO: - Episode: 1434/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:17 - r - INFO: - Episode: 1435/1500, Reward: 191.000, Step: 191
2022-12-07 16:32:18 - r - INFO: - Current episode 1435 has the best eval reward: 200.000
2022-12-07 16:32:18 - r - INFO: - Episode: 1436/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:18 - r - INFO: - Episode: 1437/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:19 - r - INFO: - Episode: 1438/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:19 - r - INFO: - Episode: 1439/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:19 - r - INFO: - Episode: 1440/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:20 - r - INFO: - Current episode 1440 has the best eval reward: 200.000
2022-12-07 16:32:21 - r - INFO: - Episode: 1441/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:21 - r - INFO: - Episode: 1442/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:21 - r - INFO: - Episode: 1443/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:21 - r - INFO: - Episode: 1444/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:45 - r - INFO: - Episode: 1445/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:46 - r - INFO: - Episode: 1446/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:47 - r - INFO: - Episode: 1447/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:47 - r - INFO: - Episode: 1448/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:47 - r - INFO: - Episode: 1449/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:47 - r - INFO: - Episode: 1450/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:49 - r - INFO: - Episode: 1451/1500, Reward: 162.000, Step: 162
2022-12-07 16:32:49 - r - INFO: - Episode: 1452/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:49 - r - INFO: - Episode: 1453/1500, Reward: 200.000, Step: 200
2022-12-07 16:32:49 - r - INFO: - Episode: 1454/1500, Reward: 200.000, Step: 200
2022-12-07 16:33:13 - r - INFO: - Episode: 1455/1500, Reward: 200.000, Step: 200
2022-12-07 16:33:15 - r - INFO: - Episode: 1456/1500, Reward: 96.000, Step: 96
2022-12-07 16:33:15 - r - INFO: - Episode: 1457/1500, Reward: 200.000, Step: 200
2022-12-07 16:33:16 - r - INFO: - Episode: 1458/1500, Reward: 200.000, Step: 200
2022-12-07 16:33:16 - r - INFO: - Episode: 1459/1500, Reward: 200.000, Step: 200
2022-12-07 16:33:16 - r - INFO: - Episode: 1460/1500, Reward: 200.000, Step: 200
2022-12-07 16:33:18 - r - INFO: - Episode: 1461/1500, Reward: 178.000, Step: 178
2022-12-07 16:33:18 - r - INFO: - Episode: 1462/1500, Reward: 166.000, Step: 166
2022-12-07 16:33:18 - r - INFO: - Episode: 1463/1500, Reward: 120.000, Step: 120
2022-12-07 16:33:18 - r - INFO: - Episode: 1464/1500, Reward: 188.000, Step: 188
2022-12-07 16:33:18 - r - INFO: - Episode: 1465/1500, Reward: 166.000, Step: 166
2022-12-07 16:33:20 - r - INFO: - Current episode 1465 has the best eval reward: 200.000
2022-12-07 16:33:20 - r - INFO: - Episode: 1466/1500, Reward: 194.000, Step: 194
2022-12-07 16:33:43 - r - INFO: - Episode: 1467/1500, Reward: 200.000, Step: 200
2022-12-07 16:33:44 - r - INFO: - Episode: 1468/1500, Reward: 200.000, Step: 200
2022-12-07 16:33:44 - r - INFO: - Episode: 1469/1500, Reward: 200.000, Step: 200
2022-12-07 16:33:44 - r - INFO: - Episode: 1470/1500, Reward: 200.000, Step: 200
2022-12-07 16:33:46 - r - INFO: - Episode: 1471/1500, Reward: 200.000, Step: 200
2022-12-07 16:33:46 - r - INFO: - Episode: 1472/1500, Reward: 200.000, Step: 200
2022-12-07 16:33:46 - r - INFO: - Episode: 1473/1500, Reward: 200.000, Step: 200
2022-12-07 16:33:46 - r - INFO: - Episode: 1474/1500, Reward: 200.000, Step: 200
2022-12-07 16:33:47 - r - INFO: - Episode: 1475/1500, Reward: 200.000, Step: 200
2022-12-07 16:33:48 - r - INFO: - Current episode 1475 has the best eval reward: 200.000
2022-12-07 16:33:48 - r - INFO: - Episode: 1476/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:11 - r - INFO: - Episode: 1477/1500, Reward: 159.000, Step: 159
2022-12-07 16:34:12 - r - INFO: - Episode: 1478/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:12 - r - INFO: - Episode: 1479/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:12 - r - INFO: - Episode: 1480/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:14 - r - INFO: - Current episode 1480 has the best eval reward: 200.000
2022-12-07 16:34:14 - r - INFO: - Episode: 1481/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:14 - r - INFO: - Episode: 1482/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:14 - r - INFO: - Episode: 1483/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:14 - r - INFO: - Episode: 1484/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:15 - r - INFO: - Episode: 1485/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:16 - r - INFO: - Current episode 1485 has the best eval reward: 200.000
2022-12-07 16:34:16 - r - INFO: - Episode: 1486/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:40 - r - INFO: - Episode: 1487/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:40 - r - INFO: - Episode: 1488/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:40 - r - INFO: - Episode: 1489/1500, Reward: 151.000, Step: 151
2022-12-07 16:34:40 - r - INFO: - Episode: 1490/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:42 - r - INFO: - Episode: 1491/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:42 - r - INFO: - Episode: 1492/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:43 - r - INFO: - Episode: 1493/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:43 - r - INFO: - Episode: 1494/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:43 - r - INFO: - Episode: 1495/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:45 - r - INFO: - Episode: 1496/1500, Reward: 200.000, Step: 200
2022-12-07 16:34:45 - r - INFO: - Episode: 1497/1500, Reward: 200.000, Step: 200
2022-12-07 16:35:08 - r - INFO: - Episode: 1498/1500, Reward: 200.000, Step: 200
2022-12-07 16:35:08 - r - INFO: - Episode: 1499/1500, Reward: 200.000, Step: 200
2022-12-07 16:35:08 - r - INFO: - Episode: 1500/1500, Reward: 200.000, Step: 200
2022-12-07 16:35:10 - r - INFO: - Current episode 1500 has the best eval reward: 200.000
2022-12-07 16:35:10 - r - INFO: - Finish training!