Hugging Face's logo

joyrl
/
joyrl-benchmarks

TensorBoard
Model card Files Metrics Community
15
johnjim0816 commited on
Commit
3a4b440
·
1 Parent(s): c93cde9

add Cartpole-v1 multi-learner DQN

Browse files
Files changed (22) hide show
  1. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/config.yaml +45 -0
  2. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/logs/log.txt +225 -0
  3. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/1000 +0 -0
  4. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/1500 +0 -0
  5. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/2000 +0 -0
  6. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/2500 +0 -0
  7. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/3000 +0 -0
  8. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/3500 +0 -0
  9. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/4000 +0 -0
  10. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/4500 +0 -0
  11. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/500 +0 -0
  12. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/5000 +0 -0
  13. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/5500 +0 -0
  14. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/6000 +0 -0
  15. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/6500 +0 -0
  16. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/7000 +0 -0
  17. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/7500 +0 -0
  18. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/best +0 -0
  19. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/tb_logs/interact/events.out.tfevents.1684339616.DESKTOP-H34HQIQ.85940.0 +3 -0
  20. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/tb_logs/interact/events.out.tfevents.1684339625.DESKTOP-H34HQIQ.86440.0 +3 -0
  21. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/tb_logs/model/events.out.tfevents.1684339616.DESKTOP-H34HQIQ.85940.1 +3 -0
  22. CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/tb_logs/model/events.out.tfevents.1684339625.DESKTOP-H34HQIQ.86440.1 +3 -0
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/config.yaml ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ general_cfg:
2
+ algo_name: DQN
3
+ collect_traj: false
4
+ device: cpu
5
+ env_name: gym
6
+ load_checkpoint: false
7
+ load_model_step: best
8
+ load_path: Train_single_CartPole-v1_DQN_20230515-211721
9
+ max_episode: 150
10
+ max_step: 200
11
+ mode: train
12
+ model_save_fre: 500
13
+ mp_backend: ray
14
+ n_learners: 2
15
+ n_workers: 10
16
+ online_eval: true
17
+ online_eval_episode: 10
18
+ seed: 1
19
+ share_buffer: true
20
+ algo_cfg:
21
+ batch_size: 64
22
+ buffer_size: 100000
23
+ buffer_type: REPLAY_QUE
24
+ epsilon_decay: 500
25
+ epsilon_end: 0.01
26
+ epsilon_start: 0.95
27
+ gamma: 0.95
28
+ lr: 0.0001
29
+ target_update: 4
30
+ value_layers:
31
+ - activation: relu
32
+ layer_dim:
33
+ - 256
34
+ layer_type: linear
35
+ - activation: relu
36
+ layer_dim:
37
+ - 256
38
+ layer_type: linear
39
+ env_cfg:
40
+ id: CartPole-v1
41
+ ignore_params:
42
+ - wrapper
43
+ - ignore_params
44
+ render_mode: null
45
+ wrapper: null
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/logs/log.txt ADDED
@@ -0,0 +1,225 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - General Configs:
2
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - ================================================================================
3
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - Name Value Type
4
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - env_name gym <class 'str'>
5
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - algo_name DQN <class 'str'>
6
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - mode train <class 'str'>
7
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - device cpu <class 'str'>
8
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - seed 1 <class 'int'>
9
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - max_episode 150 <class 'int'>
10
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - max_step 200 <class 'int'>
11
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - collect_traj 0 <class 'bool'>
12
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - mp_backend ray <class 'str'>
13
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - n_workers 10 <class 'int'>
14
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - n_learners 2 <class 'int'>
15
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - share_buffer 1 <class 'bool'>
16
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - online_eval 1 <class 'bool'>
17
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - online_eval_episode 10 <class 'int'>
18
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - model_save_fre 500 <class 'int'>
19
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - load_checkpoint 0 <class 'bool'>
20
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - load_path Train_single_CartPole-v1_DQN_20230515-211721 <class 'str'>
21
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - load_model_step best <class 'str'>
22
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - ================================================================================
23
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - Algo Configs:
24
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - ================================================================================
25
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - Name Value Type
26
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - epsilon_start 0.95 <class 'float'>
27
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - epsilon_end 0.01 <class 'float'>
28
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - epsilon_decay 500 <class 'int'>
29
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - gamma 0.95 <class 'float'>
30
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - lr 0.0001 <class 'float'>
31
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - buffer_size 100000 <class 'int'>
32
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - batch_size 64 <class 'int'>
33
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - target_update 4 <class 'int'>
34
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - value_layers [{'layer_type': 'linear', 'layer_dim': [256], 'activation': 'relu'}, {'layer_type': 'linear', 'layer_dim': [256], 'activation': 'relu'}] <class 'str'>
35
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - buffer_type REPLAY_QUE <class 'str'>
36
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - ================================================================================
37
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - Env Configs:
38
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - ================================================================================
39
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - Name Value Type
40
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - id CartPole-v1 <class 'str'>
41
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - render_mode None <class 'str'>
42
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - wrapper None <class 'str'>
43
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - ignore_params ['wrapper', 'ignore_params'] <class 'str'>
44
+ 2023-05-18 00:06:56 - SimpleLog - INFO: - ================================================================================
45
+ 2023-05-18 00:07:01 - SimpleLog - INFO: - obs_space: Box([-4.8000002e+00 -3.4028235e+38 -4.1887903e-01 -3.4028235e+38], [4.8000002e+00 3.4028235e+38 4.1887903e-01 3.4028235e+38], (4,), float32), n_actions: Discrete(2)
46
+ 2023-05-18 00:07:08 - RayLog - INFO: - Worker 1 finished episode 0 with reward 9.0 in 9 steps
47
+ 2023-05-18 00:07:09 - RayLog - INFO: - Worker 8 finished episode 0 with reward 10.0 in 10 steps
48
+ 2023-05-18 00:07:09 - RayLog - INFO: - Worker 2 finished episode 0 with reward 16.0 in 16 steps
49
+ 2023-05-18 00:07:09 - RayLog - INFO: - Worker 0 finished episode 0 with reward 14.0 in 14 steps
50
+ 2023-05-18 00:07:10 - RayLog - INFO: - Worker 3 finished episode 0 with reward 18.0 in 18 steps
51
+ 2023-05-18 00:07:10 - RayLog - INFO: - Worker 6 finished episode 0 with reward 14.0 in 14 steps
52
+ 2023-05-18 00:07:10 - RayLog - INFO: - Worker 9 finished episode 0 with reward 20.0 in 20 steps
53
+ 2023-05-18 00:07:10 - RayLog - INFO: - Worker 5 finished episode 0 with reward 27.0 in 27 steps
54
+ 2023-05-18 00:07:10 - RayLog - INFO: - Worker 2 finished episode 3 with reward 12.0 in 12 steps
55
+ 2023-05-18 00:07:11 - RayLog - INFO: - Worker 8 finished episode 2 with reward 15.0 in 15 steps
56
+ 2023-05-18 00:07:11 - RayLog - INFO: - Worker 3 finished episode 5 with reward 13.0 in 13 steps
57
+ 2023-05-18 00:07:11 - RayLog - INFO: - Worker 1 finished episode 1 with reward 21.0 in 21 steps
58
+ 2023-05-18 00:07:11 - RayLog - INFO: - Worker 7 finished episode 0 with reward 32.0 in 32 steps
59
+ 2023-05-18 00:07:12 - RayLog - INFO: - Worker 0 finished episode 4 with reward 16.0 in 16 steps
60
+ 2023-05-18 00:07:12 - RayLog - INFO: - Worker 6 finished episode 6 with reward 18.0 in 18 steps
61
+ 2023-05-18 00:07:13 - RayLog - INFO: - Worker 4 finished episode 0 with reward 38.0 in 38 steps
62
+ 2023-05-18 00:07:13 - RayLog - INFO: - Worker 2 finished episode 9 with reward 15.0 in 15 steps
63
+ 2023-05-18 00:07:13 - RayLog - INFO: - Worker 5 finished episode 8 with reward 16.0 in 16 steps
64
+ 2023-05-18 00:07:13 - RayLog - INFO: - Worker 8 finished episode 10 with reward 14.0 in 14 steps
65
+ 2023-05-18 00:07:14 - RayLog - INFO: - Worker 0 finished episode 14 with reward 10.0 in 10 steps
66
+ 2023-05-18 00:07:14 - RayLog - INFO: - Worker 7 finished episode 13 with reward 12.0 in 12 steps
67
+ 2023-05-18 00:07:14 - RayLog - INFO: - Worker 3 finished episode 11 with reward 14.0 in 14 steps
68
+ 2023-05-18 00:07:14 - RayLog - INFO: - Worker 6 finished episode 15 with reward 9.0 in 9 steps
69
+ 2023-05-18 00:07:14 - RayLog - INFO: - Worker 1 finished episode 12 with reward 20.0 in 20 steps
70
+ 2023-05-18 00:07:14 - RayLog - INFO: - Worker 2 finished episode 18 with reward 9.0 in 9 steps
71
+ 2023-05-18 00:07:14 - RayLog - INFO: - Worker 9 finished episode 7 with reward 32.0 in 32 steps
72
+ 2023-05-18 00:07:14 - RayLog - INFO: - Worker 4 finished episode 16 with reward 14.0 in 14 steps
73
+ 2023-05-18 00:07:15 - RayLog - INFO: - Worker 3 finished episode 22 with reward 10.0 in 10 steps
74
+ 2023-05-18 00:07:15 - RayLog - INFO: - Worker 8 finished episode 19 with reward 12.0 in 12 steps
75
+ 2023-05-18 00:07:15 - RayLog - INFO: - Worker 6 finished episode 23 with reward 10.0 in 10 steps
76
+ 2023-05-18 00:07:15 - RayLog - INFO: - Worker 7 finished episode 21 with reward 13.0 in 13 steps
77
+ 2023-05-18 00:07:15 - RayLog - INFO: - Worker 5 finished episode 19 with reward 15.0 in 15 steps
78
+ 2023-05-18 00:07:16 - RayLog - INFO: - learner id: 0, update_step: 500, online_eval_reward: 10.000
79
+ 2023-05-18 00:07:16 - RayLog - INFO: - learner 0 for current update step obtain a better online_eval_reward: 10.000, save the best model!
80
+ 2023-05-18 00:07:16 - RayLog - INFO: - Worker 1 finished episode 24 with reward 11.0 in 11 steps
81
+ 2023-05-18 00:07:16 - RayLog - INFO: - Worker 0 finished episode 20 with reward 18.0 in 18 steps
82
+ 2023-05-18 00:07:16 - RayLog - INFO: - Worker 4 finished episode 27 with reward 10.0 in 10 steps
83
+ 2023-05-18 00:07:17 - RayLog - INFO: - Worker 3 finished episode 29 with reward 9.0 in 9 steps
84
+ 2023-05-18 00:07:18 - RayLog - INFO: - Worker 6 finished episode 30 with reward 12.0 in 12 steps
85
+ 2023-05-18 00:07:18 - RayLog - INFO: - Worker 7 finished episode 32 with reward 11.0 in 11 steps
86
+ 2023-05-18 00:07:18 - RayLog - INFO: - Worker 2 finished episode 25 with reward 11.0 in 11 steps
87
+ 2023-05-18 00:07:18 - RayLog - INFO: - Worker 5 finished episode 32 with reward 12.0 in 12 steps
88
+ 2023-05-18 00:07:18 - RayLog - INFO: - Worker 8 finished episode 29 with reward 17.0 in 17 steps
89
+ 2023-05-18 00:07:18 - RayLog - INFO: - Worker 0 finished episode 34 with reward 11.0 in 11 steps
90
+ 2023-05-18 00:07:18 - RayLog - INFO: - Worker 1 finished episode 33 with reward 12.0 in 12 steps
91
+ 2023-05-18 00:07:18 - RayLog - INFO: - Worker 3 finished episode 36 with reward 9.0 in 9 steps
92
+ 2023-05-18 00:07:18 - RayLog - INFO: - Worker 4 finished episode 35 with reward 12.0 in 12 steps
93
+ 2023-05-18 00:07:18 - RayLog - INFO: - Worker 9 finished episode 26 with reward 26.0 in 26 steps
94
+ 2023-05-18 00:07:19 - RayLog - INFO: - Worker 6 finished episode 37 with reward 12.0 in 12 steps
95
+ 2023-05-18 00:07:19 - RayLog - INFO: - Worker 7 finished episode 39 with reward 13.0 in 13 steps
96
+ 2023-05-18 00:07:20 - RayLog - INFO: - Worker 5 finished episode 40 with reward 12.0 in 12 steps
97
+ 2023-05-18 00:07:20 - RayLog - INFO: - Worker 2 finished episode 39 with reward 15.0 in 15 steps
98
+ 2023-05-18 00:07:20 - RayLog - INFO: - Worker 3 finished episode 44 with reward 10.0 in 10 steps
99
+ 2023-05-18 00:07:20 - RayLog - INFO: - Worker 1 finished episode 44 with reward 11.0 in 11 steps
100
+ 2023-05-18 00:07:21 - RayLog - INFO: - Worker 4 finished episode 45 with reward 12.0 in 12 steps
101
+ 2023-05-18 00:07:21 - RayLog - INFO: - Worker 8 finished episode 41 with reward 16.0 in 16 steps
102
+ 2023-05-18 00:07:21 - RayLog - INFO: - Worker 0 finished episode 42 with reward 15.0 in 15 steps
103
+ 2023-05-18 00:07:21 - RayLog - INFO: - Worker 9 finished episode 46 with reward 16.0 in 16 steps
104
+ 2023-05-18 00:07:22 - RayLog - INFO: - Worker 6 finished episode 47 with reward 15.0 in 15 steps
105
+ 2023-05-18 00:07:24 - RayLog - INFO: - Worker 9 finished episode 56 with reward 11.0 in 11 steps
106
+ 2023-05-18 00:07:24 - RayLog - INFO: - Worker 0 finished episode 55 with reward 18.0 in 18 steps
107
+ 2023-05-18 00:07:24 - RayLog - INFO: - Worker 6 finished episode 57 with reward 11.0 in 11 steps
108
+ 2023-05-18 00:07:24 - RayLog - INFO: - Worker 1 finished episode 52 with reward 23.0 in 23 steps
109
+ 2023-05-18 00:07:24 - RayLog - INFO: - learner id: 1, update_step: 1000, online_eval_reward: 9.000
110
+ 2023-05-18 00:07:25 - RayLog - INFO: - Worker 4 finished episode 53 with reward 23.0 in 23 steps
111
+ 2023-05-18 00:07:25 - RayLog - INFO: - Worker 5 finished episode 49 with reward 26.0 in 26 steps
112
+ 2023-05-18 00:07:25 - RayLog - INFO: - Worker 8 finished episode 54 with reward 23.0 in 23 steps
113
+ 2023-05-18 00:07:25 - RayLog - INFO: - Worker 2 finished episode 51 with reward 27.0 in 27 steps
114
+ 2023-05-18 00:07:25 - RayLog - INFO: - Worker 7 finished episode 48 with reward 31.0 in 31 steps
115
+ 2023-05-18 00:07:25 - RayLog - INFO: - Worker 3 finished episode 51 with reward 29.0 in 29 steps
116
+ 2023-05-18 00:07:26 - RayLog - INFO: - Worker 9 finished episode 58 with reward 10.0 in 10 steps
117
+ 2023-05-18 00:07:26 - RayLog - INFO: - Worker 0 finished episode 60 with reward 9.0 in 9 steps
118
+ 2023-05-18 00:07:26 - RayLog - INFO: - Worker 6 finished episode 60 with reward 11.0 in 11 steps
119
+ 2023-05-18 00:07:26 - RayLog - INFO: - Worker 5 finished episode 63 with reward 9.0 in 9 steps
120
+ 2023-05-18 00:07:26 - RayLog - INFO: - Worker 1 finished episode 61 with reward 11.0 in 11 steps
121
+ 2023-05-18 00:07:27 - RayLog - INFO: - Worker 4 finished episode 63 with reward 10.0 in 10 steps
122
+ 2023-05-18 00:07:27 - RayLog - INFO: - Worker 8 finished episode 65 with reward 10.0 in 10 steps
123
+ 2023-05-18 00:07:27 - RayLog - INFO: - Worker 3 finished episode 67 with reward 10.0 in 10 steps
124
+ 2023-05-18 00:07:27 - RayLog - INFO: - Worker 2 finished episode 65 with reward 14.0 in 14 steps
125
+ 2023-05-18 00:07:27 - RayLog - INFO: - Worker 0 finished episode 69 with reward 9.0 in 9 steps
126
+ 2023-05-18 00:07:27 - RayLog - INFO: - Worker 7 finished episode 67 with reward 9.0 in 9 steps
127
+ 2023-05-18 00:07:27 - RayLog - INFO: - Worker 9 finished episode 69 with reward 12.0 in 12 steps
128
+ 2023-05-18 00:07:27 - RayLog - INFO: - Worker 5 finished episode 71 with reward 9.0 in 9 steps
129
+ 2023-05-18 00:07:27 - RayLog - INFO: - Worker 6 finished episode 70 with reward 10.0 in 10 steps
130
+ 2023-05-18 00:07:27 - RayLog - INFO: - Worker 1 finished episode 72 with reward 10.0 in 10 steps
131
+ 2023-05-18 00:07:27 - RayLog - INFO: - Worker 4 finished episode 74 with reward 10.0 in 10 steps
132
+ 2023-05-18 00:07:27 - RayLog - INFO: - Worker 8 finished episode 74 with reward 10.0 in 10 steps
133
+ 2023-05-18 00:07:28 - RayLog - INFO: - Worker 3 finished episode 75 with reward 10.0 in 10 steps
134
+ 2023-05-18 00:07:28 - RayLog - INFO: - Worker 7 finished episode 78 with reward 9.0 in 9 steps
135
+ 2023-05-18 00:07:28 - RayLog - INFO: - Worker 2 finished episode 76 with reward 10.0 in 10 steps
136
+ 2023-05-18 00:07:28 - RayLog - INFO: - Worker 5 finished episode 80 with reward 9.0 in 9 steps
137
+ 2023-05-18 00:07:28 - RayLog - INFO: - Worker 0 finished episode 77 with reward 11.0 in 11 steps
138
+ 2023-05-18 00:07:28 - RayLog - INFO: - Worker 9 finished episode 80 with reward 10.0 in 10 steps
139
+ 2023-05-18 00:07:28 - RayLog - INFO: - Worker 6 finished episode 81 with reward 10.0 in 10 steps
140
+ 2023-05-18 00:07:28 - RayLog - INFO: - Worker 4 finished episode 83 with reward 9.0 in 9 steps
141
+ 2023-05-18 00:07:29 - RayLog - INFO: - Worker 8 finished episode 84 with reward 10.0 in 10 steps
142
+ 2023-05-18 00:07:29 - RayLog - INFO: - Worker 1 finished episode 82 with reward 13.0 in 13 steps
143
+ 2023-05-18 00:07:29 - RayLog - INFO: - Worker 3 finished episode 85 with reward 10.0 in 10 steps
144
+ 2023-05-18 00:07:29 - RayLog - INFO: - Worker 7 finished episode 86 with reward 9.0 in 9 steps
145
+ 2023-05-18 00:07:29 - RayLog - INFO: - Worker 2 finished episode 87 with reward 10.0 in 10 steps
146
+ 2023-05-18 00:07:29 - RayLog - INFO: - Worker 5 finished episode 88 with reward 9.0 in 9 steps
147
+ 2023-05-18 00:07:29 - RayLog - INFO: - Worker 0 finished episode 90 with reward 9.0 in 9 steps
148
+ 2023-05-18 00:07:30 - RayLog - INFO: - Worker 4 finished episode 92 with reward 9.0 in 9 steps
149
+ 2023-05-18 00:07:30 - RayLog - INFO: - Worker 6 finished episode 91 with reward 10.0 in 10 steps
150
+ 2023-05-18 00:07:32 - RayLog - INFO: - Worker 3 finished episode 95 with reward 19.0 in 19 steps
151
+ 2023-05-18 00:07:32 - RayLog - INFO: - learner id: 0, update_step: 1500, online_eval_reward: 35.000
152
+ 2023-05-18 00:07:32 - RayLog - INFO: - learner 0 for current update step obtain a better online_eval_reward: 35.000, save the best model!
153
+ 2023-05-18 00:07:32 - RayLog - INFO: - Worker 2 finished episode 98 with reward 22.0 in 22 steps
154
+ 2023-05-18 00:07:33 - RayLog - INFO: - Worker 6 finished episode 101 with reward 21.0 in 21 steps
155
+ 2023-05-18 00:07:33 - RayLog - INFO: - Worker 4 finished episode 100 with reward 23.0 in 23 steps
156
+ 2023-05-18 00:07:33 - RayLog - INFO: - Worker 0 finished episode 99 with reward 28.0 in 28 steps
157
+ 2023-05-18 00:07:33 - RayLog - INFO: - Worker 9 finished episode 90 with reward 40.0 in 40 steps
158
+ 2023-05-18 00:07:33 - RayLog - INFO: - Worker 7 finished episode 96 with reward 30.0 in 30 steps
159
+ 2023-05-18 00:07:33 - RayLog - INFO: - Worker 5 finished episode 98 with reward 32.0 in 32 steps
160
+ 2023-05-18 00:07:33 - RayLog - INFO: - Worker 3 finished episode 102 with reward 20.0 in 20 steps
161
+ 2023-05-18 00:07:33 - RayLog - INFO: - Worker 1 finished episode 94 with reward 37.0 in 37 steps
162
+ 2023-05-18 00:07:34 - RayLog - INFO: - Worker 8 finished episode 93 with reward 43.0 in 43 steps
163
+ 2023-05-18 00:07:38 - RayLog - INFO: - learner id: 1, update_step: 2000, online_eval_reward: 49.000
164
+ 2023-05-18 00:07:38 - RayLog - INFO: - learner 1 for current update step obtain a better online_eval_reward: 49.000, save the best model!
165
+ 2023-05-18 00:07:42 - RayLog - INFO: - Worker 6 finished episode 104 with reward 72.0 in 72 steps
166
+ 2023-05-18 00:07:42 - RayLog - INFO: - Worker 3 finished episode 110 with reward 64.0 in 64 steps
167
+ 2023-05-18 00:07:43 - RayLog - INFO: - Worker 1 finished episode 111 with reward 65.0 in 65 steps
168
+ 2023-05-18 00:07:43 - RayLog - INFO: - Worker 4 finished episode 105 with reward 72.0 in 72 steps
169
+ 2023-05-18 00:07:43 - RayLog - INFO: - Worker 8 finished episode 112 with reward 60.0 in 60 steps
170
+ 2023-05-18 00:07:43 - RayLog - INFO: - Worker 2 finished episode 103 with reward 78.0 in 78 steps
171
+ 2023-05-18 00:07:43 - RayLog - INFO: - Worker 7 finished episode 108 with reward 69.0 in 69 steps
172
+ 2023-05-18 00:07:43 - RayLog - INFO: - Worker 9 finished episode 107 with reward 70.0 in 70 steps
173
+ 2023-05-18 00:07:44 - RayLog - INFO: - Worker 0 finished episode 106 with reward 69.0 in 69 steps
174
+ 2023-05-18 00:07:44 - RayLog - INFO: - Worker 5 finished episode 109 with reward 74.0 in 74 steps
175
+ 2023-05-18 00:07:45 - RayLog - INFO: - learner id: 0, update_step: 2500, online_eval_reward: 35.000
176
+ 2023-05-18 00:07:49 - RayLog - INFO: - Worker 5 finished episode 122 with reward 49.0 in 49 steps
177
+ 2023-05-18 00:07:51 - RayLog - INFO: - Worker 0 finished episode 122 with reward 58.0 in 58 steps
178
+ 2023-05-18 00:07:51 - RayLog - INFO: - learner id: 0, update_step: 3000, online_eval_reward: 200.000
179
+ 2023-05-18 00:07:51 - RayLog - INFO: - learner 0 for current update step obtain a better online_eval_reward: 200.000, save the best model!
180
+ 2023-05-18 00:07:52 - RayLog - INFO: - Worker 7 finished episode 119 with reward 64.0 in 64 steps
181
+ 2023-05-18 00:07:53 - RayLog - INFO: - Worker 4 finished episode 116 with reward 78.0 in 78 steps
182
+ 2023-05-18 00:07:53 - RayLog - INFO: - Worker 3 finished episode 114 with reward 86.0 in 86 steps
183
+ 2023-05-18 00:07:53 - RayLog - INFO: - Worker 8 finished episode 117 with reward 85.0 in 85 steps
184
+ 2023-05-18 00:07:54 - RayLog - INFO: - Worker 6 finished episode 113 with reward 94.0 in 94 steps
185
+ 2023-05-18 00:07:54 - RayLog - INFO: - Worker 1 finished episode 115 with reward 97.0 in 97 steps
186
+ 2023-05-18 00:07:55 - RayLog - INFO: - Worker 2 finished episode 118 with reward 95.0 in 95 steps
187
+ 2023-05-18 00:07:56 - RayLog - INFO: - Worker 0 finished episode 124 with reward 45.0 in 45 steps
188
+ 2023-05-18 00:07:57 - RayLog - INFO: - learner id: 1, update_step: 3500, online_eval_reward: 56.000
189
+ 2023-05-18 00:07:58 - RayLog - INFO: - Worker 7 finished episode 125 with reward 55.0 in 55 steps
190
+ 2023-05-18 00:07:59 - RayLog - INFO: - Worker 5 finished episode 123 with reward 77.0 in 77 steps
191
+ 2023-05-18 00:08:00 - RayLog - INFO: - Worker 9 finished episode 120 with reward 138.0 in 138 steps
192
+ 2023-05-18 00:08:04 - RayLog - INFO: - learner id: 1, update_step: 4000, online_eval_reward: 200.000
193
+ 2023-05-18 00:08:05 - RayLog - INFO: - Worker 4 finished episode 126 with reward 87.0 in 87 steps
194
+ 2023-05-18 00:08:05 - RayLog - INFO: - Worker 0 finished episode 132 with reward 66.0 in 66 steps
195
+ 2023-05-18 00:08:08 - RayLog - INFO: - Worker 8 finished episode 128 with reward 107.0 in 107 steps
196
+ 2023-05-18 00:08:10 - RayLog - INFO: - Worker 5 finished episode 134 with reward 82.0 in 82 steps
197
+ 2023-05-18 00:08:11 - RayLog - INFO: - learner id: 1, update_step: 4500, online_eval_reward: 153.000
198
+ 2023-05-18 00:08:11 - RayLog - INFO: - Worker 7 finished episode 133 with reward 93.0 in 93 steps
199
+ 2023-05-18 00:08:18 - RayLog - INFO: - learner id: 0, update_step: 5000, online_eval_reward: 200.000
200
+ 2023-05-18 00:08:18 - RayLog - INFO: - Worker 3 finished episode 127 with reward 194.0 in 194 steps
201
+ 2023-05-18 00:08:20 - RayLog - INFO: - Worker 2 finished episode 131 with reward 171.0 in 171 steps
202
+ 2023-05-18 00:08:21 - RayLog - INFO: - Worker 1 finished episode 130 with reward 200.0 in 200 steps
203
+ 2023-05-18 00:08:21 - RayLog - INFO: - Worker 6 finished episode 130 with reward 197.0 in 197 steps
204
+ 2023-05-18 00:08:24 - RayLog - INFO: - learner id: 0, update_step: 5500, online_eval_reward: 200.000
205
+ 2023-05-18 00:08:26 - RayLog - INFO: - Worker 9 finished episode 135 with reward 200.0 in 200 steps
206
+ 2023-05-18 00:08:30 - RayLog - INFO: - learner id: 0, update_step: 6000, online_eval_reward: 162.000
207
+ 2023-05-18 00:08:32 - RayLog - INFO: - Worker 0 finished episode 137 with reward 200.0 in 200 steps
208
+ 2023-05-18 00:08:33 - RayLog - INFO: - Worker 4 finished episode 136 with reward 200.0 in 200 steps
209
+ 2023-05-18 00:08:34 - RayLog - INFO: - Worker 5 finished episode 139 with reward 200.0 in 200 steps
210
+ 2023-05-18 00:08:35 - RayLog - INFO: - Worker 8 finished episode 138 with reward 200.0 in 200 steps
211
+ 2023-05-18 00:08:36 - RayLog - INFO: - Worker 7 finished episode 140 with reward 200.0 in 200 steps
212
+ 2023-05-18 00:08:37 - RayLog - INFO: - learner id: 1, update_step: 6500, online_eval_reward: 200.000
213
+ 2023-05-18 00:08:43 - RayLog - INFO: - Worker 3 finished episode 141 with reward 200.0 in 200 steps
214
+ 2023-05-18 00:08:44 - RayLog - INFO: - learner id: 0, update_step: 7000, online_eval_reward: 200.000
215
+ 2023-05-18 00:08:44 - RayLog - INFO: - Worker 2 finished episode 142 with reward 200.0 in 200 steps
216
+ 2023-05-18 00:08:46 - RayLog - INFO: - Worker 1 finished episode 143 with reward 200.0 in 200 steps
217
+ 2023-05-18 00:08:46 - RayLog - INFO: - Worker 6 finished episode 144 with reward 200.0 in 200 steps
218
+ 2023-05-18 00:08:50 - RayLog - INFO: - Worker 9 finished episode 145 with reward 200.0 in 200 steps
219
+ 2023-05-18 00:08:51 - RayLog - INFO: - learner id: 0, update_step: 7500, online_eval_reward: 200.000
220
+ 2023-05-18 00:08:53 - RayLog - INFO: - Worker 4 finished episode 147 with reward 200.0 in 200 steps
221
+ 2023-05-18 00:08:54 - RayLog - INFO: - Worker 0 finished episode 146 with reward 200.0 in 200 steps
222
+ 2023-05-18 00:08:55 - RayLog - INFO: - Worker 5 finished episode 148 with reward 200.0 in 200 steps
223
+ 2023-05-18 00:08:56 - RayLog - INFO: - Worker 7 finished episode 150 with reward 200.0 in 200 steps
224
+ 2023-05-18 00:08:56 - RayLog - INFO: - Worker 8 finished episode 149 with reward 200.0 in 200 steps
225
+ 2023-05-18 00:08:59 - SimpleLog - INFO: - Finish training! total time consumed: 122.73s
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/1000 ADDED
Binary file (545 kB). View file
 
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/1500 ADDED
Binary file (545 kB). View file
 
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/2000 ADDED
Binary file (545 kB). View file
 
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/2500 ADDED
Binary file (545 kB). View file
 
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/3000 ADDED
Binary file (545 kB). View file
 
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/3500 ADDED
Binary file (545 kB). View file
 
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/4000 ADDED
Binary file (545 kB). View file
 
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/4500 ADDED
Binary file (545 kB). View file
 
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/500 ADDED
Binary file (545 kB). View file
 
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/5000 ADDED
Binary file (545 kB). View file
 
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/5500 ADDED
Binary file (545 kB). View file
 
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/6000 ADDED
Binary file (545 kB). View file
 
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/6500 ADDED
Binary file (545 kB). View file
 
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/7000 ADDED
Binary file (545 kB). View file
 
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/7500 ADDED
Binary file (545 kB). View file
 
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/models/best ADDED
Binary file (545 kB). View file
 
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/tb_logs/interact/events.out.tfevents.1684339616.DESKTOP-H34HQIQ.85940.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0809faa3d06f301997fe2086bfc194e0722cf3d1d3aba069429b7945ec2a62f7
3
+ size 40
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/tb_logs/interact/events.out.tfevents.1684339625.DESKTOP-H34HQIQ.86440.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:898c4511bf96015d660bf6792fc3b4a86216201b4dde4b0706fd7b1f03c3f9fd
3
+ size 15726
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/tb_logs/model/events.out.tfevents.1684339616.DESKTOP-H34HQIQ.85940.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb70b39d8d73fd2532acd6826f916c1fd0cd444129a5f906714f87c1688f9f9c
3
+ size 40
CartPole-v1/Train_ray_multi_learner_CartPole-v1_DQN_20230518-000656/tb_logs/model/events.out.tfevents.1684339625.DESKTOP-H34HQIQ.86440.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dfaa682d25e17dd438c8dc904403312777485965c83e55a4d92fbd56288b83d4
3
+ size 380741