|
2023-05-18 23:23:30 - SimpleLog - INFO: - General Configs: |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - ================================================================================ |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - Name Value Type |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - env_name gym <class 'str'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - algo_name PER_DQN <class 'str'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - mode test <class 'str'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - device cuda <class 'str'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - seed 1 <class 'int'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - max_episode 10 <class 'int'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - max_step 200 <class 'int'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - collect_traj 0 <class 'bool'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - mp_backend single <class 'str'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - n_workers 2 <class 'int'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - n_learners 1 <class 'int'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - share_buffer 1 <class 'bool'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - online_eval 1 <class 'bool'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - online_eval_episode 10 <class 'int'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - model_save_fre 500 <class 'int'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - load_checkpoint 1 <class 'bool'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - load_path Train_single_CartPole-v1_PER_DQN_20230518-232215 <class 'str'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - load_model_step best <class 'str'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - ================================================================================ |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - Algo Configs: |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - ================================================================================ |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - Name Value Type |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - epsilon_start 0.95 <class 'float'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - epsilon_end 0.01 <class 'float'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - epsilon_decay 1000 <class 'int'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - gamma 0.99 <class 'float'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - lr 0.0001 <class 'float'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - buffer_type PER_QUE <class 'str'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - buffer_size 100000 <class 'int'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - per_alpha 0.6 <class 'float'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - per_beta 0.4 <class 'float'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - per_beta_annealing 0.001 <class 'float'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - per_epsilon 0.01 <class 'float'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - batch_size 64 <class 'int'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - target_update 4 <class 'int'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - value_layers [{'layer_type': 'linear', 'layer_size': [256], 'activation': 'relu'}, {'layer_type': 'linear', 'layer_size': [256], 'activation': 'relu'}] <class 'str'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - ================================================================================ |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - Env Configs: |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - ================================================================================ |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - Name Value Type |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - id CartPole-v1 <class 'str'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - render_mode None <class 'str'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - wrapper None <class 'str'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - ignore_params ['wrapper', 'ignore_params'] <class 'str'> |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - ================================================================================ |
|
2023-05-18 23:23:30 - SimpleLog - INFO: - obs_space: Box([-4.8000002e+00 -3.4028235e+38 -4.1887903e-01 -3.4028235e+38], [4.8000002e+00 3.4028235e+38 4.1887903e-01 3.4028235e+38], (4,), float32), n_actions: Discrete(2) |
|
2023-05-18 23:23:31 - SimpleLog - INFO: - Start testing! |
|
2023-05-18 23:23:32 - SimpleLog - INFO: - episode: 0, ep_reward: 200.0, ep_step: 200 |
|
2023-05-18 23:23:32 - SimpleLog - INFO: - episode: 1, ep_reward: 200.0, ep_step: 200 |
|
2023-05-18 23:23:32 - SimpleLog - INFO: - episode: 2, ep_reward: 200.0, ep_step: 200 |
|
2023-05-18 23:23:32 - SimpleLog - INFO: - episode: 3, ep_reward: 200.0, ep_step: 200 |
|
2023-05-18 23:23:32 - SimpleLog - INFO: - episode: 4, ep_reward: 200.0, ep_step: 200 |
|
2023-05-18 23:23:33 - SimpleLog - INFO: - episode: 5, ep_reward: 200.0, ep_step: 200 |
|
2023-05-18 23:23:33 - SimpleLog - INFO: - episode: 6, ep_reward: 200.0, ep_step: 200 |
|
2023-05-18 23:23:33 - SimpleLog - INFO: - episode: 7, ep_reward: 200.0, ep_step: 200 |
|
2023-05-18 23:23:33 - SimpleLog - INFO: - episode: 8, ep_reward: 200.0, ep_step: 200 |
|
2023-05-18 23:23:33 - SimpleLog - INFO: - episode: 9, ep_reward: 200.0, ep_step: 200 |
|
2023-05-18 23:23:33 - SimpleLog - INFO: - Finish testing! total time consumed: 2.60s |
|
|