johnjim0816
update CliffWalking-v0 QLearning
43d89c4
2023-05-19 00:58:37 - SimpleLog - INFO: - General Configs:
2023-05-19 00:58:37 - SimpleLog - INFO: - ================================================================================
2023-05-19 00:58:37 - SimpleLog - INFO: - Name Value Type
2023-05-19 00:58:37 - SimpleLog - INFO: - env_name gym <class 'str'>
2023-05-19 00:58:37 - SimpleLog - INFO: - algo_name QLearning <class 'str'>
2023-05-19 00:58:37 - SimpleLog - INFO: - mode train <class 'str'>
2023-05-19 00:58:37 - SimpleLog - INFO: - device cpu <class 'str'>
2023-05-19 00:58:37 - SimpleLog - INFO: - seed 1 <class 'int'>
2023-05-19 00:58:37 - SimpleLog - INFO: - max_episode 300 <class 'int'>
2023-05-19 00:58:37 - SimpleLog - INFO: - max_step 100 <class 'int'>
2023-05-19 00:58:37 - SimpleLog - INFO: - collect_traj 0 <class 'bool'>
2023-05-19 00:58:37 - SimpleLog - INFO: - mp_backend single <class 'str'>
2023-05-19 00:58:37 - SimpleLog - INFO: - n_workers 1 <class 'int'>
2023-05-19 00:58:37 - SimpleLog - INFO: - n_learners 1 <class 'int'>
2023-05-19 00:58:37 - SimpleLog - INFO: - share_buffer 1 <class 'bool'>
2023-05-19 00:58:37 - SimpleLog - INFO: - online_eval 0 <class 'bool'>
2023-05-19 00:58:37 - SimpleLog - INFO: - online_eval_episode 10 <class 'int'>
2023-05-19 00:58:37 - SimpleLog - INFO: - model_save_fre 500 <class 'int'>
2023-05-19 00:58:37 - SimpleLog - INFO: - load_checkpoint 0 <class 'bool'>
2023-05-19 00:58:37 - SimpleLog - INFO: - load_path Train_single_CartPole-v1_DQN_20230515-211721 <class 'str'>
2023-05-19 00:58:37 - SimpleLog - INFO: - load_model_step best <class 'str'>
2023-05-19 00:58:37 - SimpleLog - INFO: - ================================================================================
2023-05-19 00:58:37 - SimpleLog - INFO: - Algo Configs:
2023-05-19 00:58:37 - SimpleLog - INFO: - ================================================================================
2023-05-19 00:58:37 - SimpleLog - INFO: - Name Value Type
2023-05-19 00:58:37 - SimpleLog - INFO: - epsilon_start 0.95 <class 'float'>
2023-05-19 00:58:37 - SimpleLog - INFO: - epsilon_end 0.01 <class 'float'>
2023-05-19 00:58:37 - SimpleLog - INFO: - epsilon_decay 300 <class 'int'>
2023-05-19 00:58:37 - SimpleLog - INFO: - gamma 0.99 <class 'float'>
2023-05-19 00:58:37 - SimpleLog - INFO: - lr 0.1 <class 'float'>
2023-05-19 00:58:37 - SimpleLog - INFO: - ================================================================================
2023-05-19 00:58:37 - SimpleLog - INFO: - Env Configs:
2023-05-19 00:58:37 - SimpleLog - INFO: - ================================================================================
2023-05-19 00:58:37 - SimpleLog - INFO: - Name Value Type
2023-05-19 00:58:37 - SimpleLog - INFO: - id CliffWalking-v0 <class 'str'>
2023-05-19 00:58:37 - SimpleLog - INFO: - render_mode None <class 'str'>
2023-05-19 00:58:37 - SimpleLog - INFO: - wrapper None <class 'str'>
2023-05-19 00:58:37 - SimpleLog - INFO: - ignore_params ['wrapper', 'ignore_params'] <class 'str'>
2023-05-19 00:58:37 - SimpleLog - INFO: - ================================================================================
2023-05-19 00:58:37 - SimpleLog - INFO: - obs_space: Discrete(48), n_actions: Discrete(4)
2023-05-19 00:58:37 - SimpleLog - INFO: - Start training!
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 0, ep_reward: -397, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 1, ep_reward: -1090, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 2, ep_reward: -694, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 3, ep_reward: -397, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 4, ep_reward: -496, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 5, ep_reward: -298, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 6, ep_reward: -199, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 7, ep_reward: -298, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 8, ep_reward: -100, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 9, ep_reward: -199, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 10, ep_reward: -93, ep_step: 93
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 11, ep_reward: -100, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 12, ep_reward: -199, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 13, ep_reward: -199, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 14, ep_reward: -100, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 15, ep_reward: -100, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 16, ep_reward: -33, ep_step: 33
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 17, ep_reward: -100, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 18, ep_reward: -66, ep_step: 66
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 19, ep_reward: -99, ep_step: 99
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 20, ep_reward: -100, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 21, ep_reward: -100, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 22, ep_reward: -100, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 23, ep_reward: -54, ep_step: 54
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 24, ep_reward: -100, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 25, ep_reward: -73, ep_step: 73
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 26, ep_reward: -100, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 27, ep_reward: -90, ep_step: 90
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 28, ep_reward: -87, ep_step: 87
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 29, ep_reward: -100, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 30, ep_reward: -46, ep_step: 46
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 31, ep_reward: -82, ep_step: 82
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 32, ep_reward: -100, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 33, ep_reward: -100, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 34, ep_reward: -67, ep_step: 67
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 35, ep_reward: -75, ep_step: 75
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 36, ep_reward: -100, ep_step: 100
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 37, ep_reward: -45, ep_step: 45
2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 38, ep_reward: -100, ep_step: 100
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 39, ep_reward: -37, ep_step: 37
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 40, ep_reward: -100, ep_step: 100
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 41, ep_reward: -43, ep_step: 43
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 42, ep_reward: -100, ep_step: 100
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 43, ep_reward: -56, ep_step: 56
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 44, ep_reward: -70, ep_step: 70
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 45, ep_reward: -100, ep_step: 100
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 46, ep_reward: -47, ep_step: 47
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 47, ep_reward: -85, ep_step: 85
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 48, ep_reward: -82, ep_step: 82
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 49, ep_reward: -51, ep_step: 51
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 50, ep_reward: -50, ep_step: 50
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 51, ep_reward: -86, ep_step: 86
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 52, ep_reward: -100, ep_step: 100
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 53, ep_reward: -40, ep_step: 40
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 54, ep_reward: -87, ep_step: 87
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 55, ep_reward: -59, ep_step: 59
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 56, ep_reward: -51, ep_step: 51
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 57, ep_reward: -98, ep_step: 98
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 58, ep_reward: -67, ep_step: 67
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 59, ep_reward: -60, ep_step: 60
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 60, ep_reward: -38, ep_step: 38
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 61, ep_reward: -76, ep_step: 76
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 62, ep_reward: -70, ep_step: 70
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 63, ep_reward: -60, ep_step: 60
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 64, ep_reward: -68, ep_step: 68
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 65, ep_reward: -25, ep_step: 25
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 66, ep_reward: -69, ep_step: 69
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 67, ep_reward: -183, ep_step: 84
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 68, ep_reward: -62, ep_step: 62
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 69, ep_reward: -44, ep_step: 44
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 70, ep_reward: -71, ep_step: 71
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 71, ep_reward: -55, ep_step: 55
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 72, ep_reward: -65, ep_step: 65
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 73, ep_reward: -61, ep_step: 61
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 74, ep_reward: -36, ep_step: 36
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 75, ep_reward: -47, ep_step: 47
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 76, ep_reward: -63, ep_step: 63
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 77, ep_reward: -45, ep_step: 45
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 78, ep_reward: -59, ep_step: 59
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 79, ep_reward: -39, ep_step: 39
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 80, ep_reward: -62, ep_step: 62
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 81, ep_reward: -38, ep_step: 38
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 82, ep_reward: -64, ep_step: 64
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 83, ep_reward: -40, ep_step: 40
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 84, ep_reward: -59, ep_step: 59
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 85, ep_reward: -48, ep_step: 48
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 86, ep_reward: -39, ep_step: 39
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 87, ep_reward: -70, ep_step: 70
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 88, ep_reward: -34, ep_step: 34
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 89, ep_reward: -40, ep_step: 40
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 90, ep_reward: -27, ep_step: 27
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 91, ep_reward: -65, ep_step: 65
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 92, ep_reward: -79, ep_step: 79
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 93, ep_reward: -30, ep_step: 30
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 94, ep_reward: -38, ep_step: 38
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 95, ep_reward: -23, ep_step: 23
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 96, ep_reward: -60, ep_step: 60
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 97, ep_reward: -41, ep_step: 41
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 98, ep_reward: -39, ep_step: 39
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 99, ep_reward: -42, ep_step: 42
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 100, ep_reward: -41, ep_step: 41
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 101, ep_reward: -59, ep_step: 59
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 102, ep_reward: -31, ep_step: 31
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 103, ep_reward: -43, ep_step: 43
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 104, ep_reward: -70, ep_step: 70
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 105, ep_reward: -29, ep_step: 29
2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 106, ep_reward: -161, ep_step: 62
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 107, ep_reward: -38, ep_step: 38
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 108, ep_reward: -45, ep_step: 45
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 109, ep_reward: -29, ep_step: 29
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 110, ep_reward: -47, ep_step: 47
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 111, ep_reward: -23, ep_step: 23
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 112, ep_reward: -62, ep_step: 62
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 113, ep_reward: -34, ep_step: 34
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 114, ep_reward: -46, ep_step: 46
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 115, ep_reward: -29, ep_step: 29
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 116, ep_reward: -46, ep_step: 46
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 117, ep_reward: -30, ep_step: 30
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 118, ep_reward: -24, ep_step: 24
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 119, ep_reward: -30, ep_step: 30
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 120, ep_reward: -42, ep_step: 42
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 121, ep_reward: -62, ep_step: 62
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 122, ep_reward: -30, ep_step: 30
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 123, ep_reward: -31, ep_step: 31
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 124, ep_reward: -37, ep_step: 37
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 125, ep_reward: -51, ep_step: 51
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 126, ep_reward: -32, ep_step: 32
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 127, ep_reward: -22, ep_step: 22
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 128, ep_reward: -34, ep_step: 34
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 129, ep_reward: -22, ep_step: 22
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 130, ep_reward: -53, ep_step: 53
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 131, ep_reward: -28, ep_step: 28
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 132, ep_reward: -33, ep_step: 33
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 133, ep_reward: -39, ep_step: 39
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 134, ep_reward: -39, ep_step: 39
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 135, ep_reward: -20, ep_step: 20
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 136, ep_reward: -30, ep_step: 30
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 137, ep_reward: -42, ep_step: 42
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 138, ep_reward: -154, ep_step: 55
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 139, ep_reward: -34, ep_step: 34
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 140, ep_reward: -29, ep_step: 29
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 141, ep_reward: -21, ep_step: 21
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 142, ep_reward: -38, ep_step: 38
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 143, ep_reward: -21, ep_step: 21
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 144, ep_reward: -46, ep_step: 46
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 145, ep_reward: -19, ep_step: 19
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 146, ep_reward: -37, ep_step: 37
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 147, ep_reward: -27, ep_step: 27
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 148, ep_reward: -39, ep_step: 39
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 149, ep_reward: -18, ep_step: 18
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 150, ep_reward: -34, ep_step: 34
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 151, ep_reward: -25, ep_step: 25
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 152, ep_reward: -32, ep_step: 32
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 153, ep_reward: -40, ep_step: 40
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 154, ep_reward: -30, ep_step: 30
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 155, ep_reward: -36, ep_step: 36
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 156, ep_reward: -29, ep_step: 29
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 157, ep_reward: -30, ep_step: 30
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 158, ep_reward: -29, ep_step: 29
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 159, ep_reward: -22, ep_step: 22
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 160, ep_reward: -18, ep_step: 18
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 161, ep_reward: -46, ep_step: 46
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 162, ep_reward: -27, ep_step: 27
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 163, ep_reward: -22, ep_step: 22
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 164, ep_reward: -34, ep_step: 34
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 165, ep_reward: -15, ep_step: 15
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 166, ep_reward: -24, ep_step: 24
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 167, ep_reward: -45, ep_step: 45
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 168, ep_reward: -36, ep_step: 36
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 169, ep_reward: -20, ep_step: 20
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 170, ep_reward: -26, ep_step: 26
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 171, ep_reward: -29, ep_step: 29
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 172, ep_reward: -32, ep_step: 32
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 173, ep_reward: -17, ep_step: 17
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 174, ep_reward: -31, ep_step: 31
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 175, ep_reward: -15, ep_step: 15
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 176, ep_reward: -31, ep_step: 31
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 177, ep_reward: -29, ep_step: 29
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 178, ep_reward: -29, ep_step: 29
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 179, ep_reward: -21, ep_step: 21
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 180, ep_reward: -31, ep_step: 31
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 181, ep_reward: -21, ep_step: 21
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 182, ep_reward: -39, ep_step: 39
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 183, ep_reward: -30, ep_step: 30
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 184, ep_reward: -13, ep_step: 13
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 185, ep_reward: -30, ep_step: 30
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 186, ep_reward: -27, ep_step: 27
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 187, ep_reward: -18, ep_step: 18
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 188, ep_reward: -17, ep_step: 17
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 189, ep_reward: -24, ep_step: 24
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 190, ep_reward: -28, ep_step: 28
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 191, ep_reward: -36, ep_step: 36
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 192, ep_reward: -15, ep_step: 15
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 193, ep_reward: -40, ep_step: 40
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 194, ep_reward: -20, ep_step: 20
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 195, ep_reward: -23, ep_step: 23
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 196, ep_reward: -17, ep_step: 17
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 197, ep_reward: -28, ep_step: 28
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 198, ep_reward: -15, ep_step: 15
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 199, ep_reward: -27, ep_step: 27
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 200, ep_reward: -14, ep_step: 14
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 201, ep_reward: -31, ep_step: 31
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 202, ep_reward: -25, ep_step: 25
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 203, ep_reward: -19, ep_step: 19
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 204, ep_reward: -36, ep_step: 36
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 205, ep_reward: -29, ep_step: 29
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 206, ep_reward: -20, ep_step: 20
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 207, ep_reward: -23, ep_step: 23
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 208, ep_reward: -14, ep_step: 14
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 209, ep_reward: -28, ep_step: 28
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 210, ep_reward: -19, ep_step: 19
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 211, ep_reward: -26, ep_step: 26
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 212, ep_reward: -18, ep_step: 18
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 213, ep_reward: -26, ep_step: 26
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 214, ep_reward: -19, ep_step: 19
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 215, ep_reward: -23, ep_step: 23
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 216, ep_reward: -20, ep_step: 20
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 217, ep_reward: -48, ep_step: 48
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 218, ep_reward: -13, ep_step: 13
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 219, ep_reward: -133, ep_step: 34
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 220, ep_reward: -17, ep_step: 17
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 221, ep_reward: -20, ep_step: 20
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 222, ep_reward: -18, ep_step: 18
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 223, ep_reward: -35, ep_step: 35
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 224, ep_reward: -17, ep_step: 17
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 225, ep_reward: -13, ep_step: 13
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 226, ep_reward: -16, ep_step: 16
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 227, ep_reward: -25, ep_step: 25
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 228, ep_reward: -25, ep_step: 25
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 229, ep_reward: -26, ep_step: 26
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 230, ep_reward: -19, ep_step: 19
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 231, ep_reward: -17, ep_step: 17
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 232, ep_reward: -27, ep_step: 27
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 233, ep_reward: -30, ep_step: 30
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 234, ep_reward: -17, ep_step: 17
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 235, ep_reward: -18, ep_step: 18
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 236, ep_reward: -122, ep_step: 23
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 237, ep_reward: -25, ep_step: 25
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 238, ep_reward: -20, ep_step: 20
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 239, ep_reward: -13, ep_step: 13
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 240, ep_reward: -39, ep_step: 39
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 241, ep_reward: -17, ep_step: 17
2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 242, ep_reward: -14, ep_step: 14
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 243, ep_reward: -15, ep_step: 15
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 244, ep_reward: -22, ep_step: 22
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 245, ep_reward: -31, ep_step: 31
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 246, ep_reward: -20, ep_step: 20
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 247, ep_reward: -28, ep_step: 28
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 248, ep_reward: -15, ep_step: 15
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 249, ep_reward: -19, ep_step: 19
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 250, ep_reward: -15, ep_step: 15
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 251, ep_reward: -13, ep_step: 13
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 252, ep_reward: -21, ep_step: 21
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 253, ep_reward: -16, ep_step: 16
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 254, ep_reward: -22, ep_step: 22
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 255, ep_reward: -18, ep_step: 18
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 256, ep_reward: -23, ep_step: 23
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 257, ep_reward: -16, ep_step: 16
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 258, ep_reward: -22, ep_step: 22
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 259, ep_reward: -13, ep_step: 13
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 260, ep_reward: -13, ep_step: 13
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 261, ep_reward: -19, ep_step: 19
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 262, ep_reward: -17, ep_step: 17
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 263, ep_reward: -32, ep_step: 32
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 264, ep_reward: -16, ep_step: 16
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 265, ep_reward: -15, ep_step: 15
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 266, ep_reward: -17, ep_step: 17
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 267, ep_reward: -13, ep_step: 13
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 268, ep_reward: -15, ep_step: 15
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 269, ep_reward: -28, ep_step: 28
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 270, ep_reward: -15, ep_step: 15
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 271, ep_reward: -13, ep_step: 13
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 272, ep_reward: -16, ep_step: 16
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 273, ep_reward: -128, ep_step: 29
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 274, ep_reward: -32, ep_step: 32
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 275, ep_reward: -24, ep_step: 24
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 276, ep_reward: -26, ep_step: 26
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 277, ep_reward: -14, ep_step: 14
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 278, ep_reward: -25, ep_step: 25
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 279, ep_reward: -22, ep_step: 22
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 280, ep_reward: -13, ep_step: 13
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 281, ep_reward: -15, ep_step: 15
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 282, ep_reward: -15, ep_step: 15
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 283, ep_reward: -13, ep_step: 13
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 284, ep_reward: -13, ep_step: 13
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 285, ep_reward: -16, ep_step: 16
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 286, ep_reward: -21, ep_step: 21
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 287, ep_reward: -19, ep_step: 19
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 288, ep_reward: -26, ep_step: 26
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 289, ep_reward: -16, ep_step: 16
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 290, ep_reward: -13, ep_step: 13
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 291, ep_reward: -13, ep_step: 13
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 292, ep_reward: -13, ep_step: 13
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 293, ep_reward: -15, ep_step: 15
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 294, ep_reward: -13, ep_step: 13
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 295, ep_reward: -24, ep_step: 24
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 296, ep_reward: -19, ep_step: 19
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 297, ep_reward: -14, ep_step: 14
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 298, ep_reward: -16, ep_step: 16
2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 299, ep_reward: -17, ep_step: 17
2023-05-19 00:58:40 - SimpleLog - INFO: - Finish training! total time consumed: 3.10s