| 2023-02-04 22:37:10 - r - INFO: - Hyperparameters: | |
| 2023-02-04 22:37:10 - r - INFO: - ================================================================================ | |
| 2023-02-04 22:37:10 - r - INFO: - Name Value Type | |
| 2023-02-04 22:37:10 - r - INFO: - env_name CartPole-v1 <class 'str'> | |
| 2023-02-04 22:37:10 - r - INFO: - new_step_api 1 <class 'bool'> | |
| 2023-02-04 22:37:10 - r - INFO: - wrapper None <class 'str'> | |
| 2023-02-04 22:37:10 - r - INFO: - render 0 <class 'bool'> | |
| 2023-02-04 22:37:10 - r - INFO: - algo_name DRQN <class 'str'> | |
| 2023-02-04 22:37:10 - r - INFO: - mode test <class 'str'> | |
| 2023-02-04 22:37:10 - r - INFO: - seed 0 <class 'int'> | |
| 2023-02-04 22:37:10 - r - INFO: - device cuda <class 'str'> | |
| 2023-02-04 22:37:10 - r - INFO: - train_eps 100 <class 'int'> | |
| 2023-02-04 22:37:10 - r - INFO: - test_eps 10 <class 'int'> | |
| 2023-02-04 22:37:10 - r - INFO: - eval_eps 10 <class 'int'> | |
| 2023-02-04 22:37:10 - r - INFO: - eval_per_episode 5 <class 'int'> | |
| 2023-02-04 22:37:10 - r - INFO: - max_steps 200 <class 'int'> | |
| 2023-02-04 22:37:10 - r - INFO: - load_checkpoint 1 <class 'bool'> | |
| 2023-02-04 22:37:10 - r - INFO: - load_path Train_CartPole-v1_DRQN_20230204-223146 <class 'str'> | |
| 2023-02-04 22:37:10 - r - INFO: - show_fig 0 <class 'bool'> | |
| 2023-02-04 22:37:10 - r - INFO: - save_fig 1 <class 'bool'> | |
| 2023-02-04 22:37:10 - r - INFO: - epsilon_start 0.1 <class 'float'> | |
| 2023-02-04 22:37:10 - r - INFO: - epsilon_end 0.001 <class 'float'> | |
| 2023-02-04 22:37:10 - r - INFO: - epsilon_decay 0.995 <class 'float'> | |
| 2023-02-04 22:37:10 - r - INFO: - hidden_dim 64 <class 'int'> | |
| 2023-02-04 22:37:10 - r - INFO: - gamma 0.99 <class 'float'> | |
| 2023-02-04 22:37:10 - r - INFO: - lr 0.001 <class 'float'> | |
| 2023-02-04 22:37:10 - r - INFO: - buffer_size 100000 <class 'int'> | |
| 2023-02-04 22:37:10 - r - INFO: - batch_size 64 <class 'int'> | |
| 2023-02-04 22:37:10 - r - INFO: - target_update 4 <class 'int'> | |
| 2023-02-04 22:37:10 - r - INFO: - lookup_step 10 <class 'int'> | |
| 2023-02-04 22:37:10 - r - INFO: - min_epi_num 16 <class 'int'> | |
| 2023-02-04 22:37:10 - r - INFO: - max_epi_len 128 <class 'int'> | |
| 2023-02-04 22:37:10 - r - INFO: - max_epi_num 100 <class 'int'> | |
| 2023-02-04 22:37:10 - r - INFO: - value_layers [{'layer_type': 'linear', 'layer_dim': ['n_states', 64], 'activation': 'relu'}, {'layer_type': 'linear', 'layer_dim': [64, 64], 'activation': 'relu'}, {'layer_type': 'linear', 'layer_dim': [64, 'n_actions'], 'activation': 'none'}] <class 'str'> | |
| 2023-02-04 22:37:10 - r - INFO: - task_dir /home/dingli/rl-tutorials/joyrl/tasks/Test_CartPole-v1_DRQN_20230204-223710 <class 'str'> | |
| 2023-02-04 22:37:10 - r - INFO: - model_dir /home/dingli/rl-tutorials/joyrl/tasks/Test_CartPole-v1_DRQN_20230204-223710/models <class 'str'> | |
| 2023-02-04 22:37:10 - r - INFO: - res_dir /home/dingli/rl-tutorials/joyrl/tasks/Test_CartPole-v1_DRQN_20230204-223710/results <class 'str'> | |
| 2023-02-04 22:37:10 - r - INFO: - log_dir /home/dingli/rl-tutorials/joyrl/tasks/Test_CartPole-v1_DRQN_20230204-223710/logs <class 'str'> | |
| 2023-02-04 22:37:10 - r - INFO: - traj_dir /home/dingli/rl-tutorials/joyrl/tasks/Test_CartPole-v1_DRQN_20230204-223710/traj <class 'str'> | |
| 2023-02-04 22:37:10 - r - INFO: - ================================================================================ | |
| 2023-02-04 22:37:10 - r - INFO: - n_states: 4, n_actions: 2 | |
| 2023-02-04 22:37:13 - r - INFO: - Start testing! | |
| 2023-02-04 22:37:13 - r - INFO: - Env: CartPole-v1, Algorithm: DRQN, Device: cuda | |
| 2023-02-04 22:37:13 - r - INFO: - Episode: 1/10, Reward: 200.000, Step: 200 | |
| 2023-02-04 22:37:13 - r - INFO: - Episode: 2/10, Reward: 200.000, Step: 200 | |
| 2023-02-04 22:37:14 - r - INFO: - Episode: 3/10, Reward: 200.000, Step: 200 | |
| 2023-02-04 22:37:14 - r - INFO: - Episode: 4/10, Reward: 200.000, Step: 200 | |
| 2023-02-04 22:37:14 - r - INFO: - Episode: 5/10, Reward: 200.000, Step: 200 | |
| 2023-02-04 22:37:14 - r - INFO: - Episode: 6/10, Reward: 200.000, Step: 200 | |
| 2023-02-04 22:37:14 - r - INFO: - Episode: 7/10, Reward: 200.000, Step: 200 | |
| 2023-02-04 22:37:15 - r - INFO: - Episode: 8/10, Reward: 200.000, Step: 200 | |
| 2023-02-04 22:37:15 - r - INFO: - Episode: 9/10, Reward: 200.000, Step: 200 | |
| 2023-02-04 22:37:15 - r - INFO: - Episode: 10/10, Reward: 200.000, Step: 200 | |
| 2023-02-04 22:37:15 - r - INFO: - Finish testing! | |