File size: 4,477 Bytes
62e03a2 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 |
2023-03-11 00:15:30 - r - INFO: - Hyperparameters: 2023-03-11 00:15:30 - r - INFO: - ================================================================================ 2023-03-11 00:15:30 - r - INFO: - Name Value Type 2023-03-11 00:15:30 - r - INFO: - env_name CliffWalking-v0 <class 'str'> 2023-03-11 00:15:30 - r - INFO: - new_step_api 1 <class 'bool'> 2023-03-11 00:15:30 - r - INFO: - wrapper envs.wrappers.CliffWalkingWapper <class 'str'> 2023-03-11 00:15:30 - r - INFO: - render 1 <class 'bool'> 2023-03-11 00:15:30 - r - INFO: - algo_name Sarsa <class 'str'> 2023-03-11 00:15:30 - r - INFO: - mode test <class 'str'> 2023-03-11 00:15:30 - r - INFO: - seed 1 <class 'int'> 2023-03-11 00:15:30 - r - INFO: - device cpu <class 'str'> 2023-03-11 00:15:30 - r - INFO: - train_eps 300 <class 'int'> 2023-03-11 00:15:30 - r - INFO: - test_eps 10 <class 'int'> 2023-03-11 00:15:30 - r - INFO: - eval_eps 10 <class 'int'> 2023-03-11 00:15:30 - r - INFO: - eval_per_episode 5 <class 'int'> 2023-03-11 00:15:30 - r - INFO: - max_steps 100 <class 'int'> 2023-03-11 00:15:30 - r - INFO: - load_checkpoint 1 <class 'bool'> 2023-03-11 00:15:30 - r - INFO: - load_path Train_CliffWalking-v0_Sarsa_20230311-001504 <class 'str'> 2023-03-11 00:15:30 - r - INFO: - show_fig 0 <class 'bool'> 2023-03-11 00:15:30 - r - INFO: - save_fig 1 <class 'bool'> 2023-03-11 00:15:30 - r - INFO: - render_mode human <class 'str'> 2023-03-11 00:15:30 - r - INFO: - epsilon_start 0.95 <class 'float'> 2023-03-11 00:15:30 - r - INFO: - epsilon_end 0.01 <class 'float'> 2023-03-11 00:15:30 - r - INFO: - epsilon_decay 300 <class 'int'> 2023-03-11 00:15:30 - r - INFO: - gamma 0.99 <class 'float'> 2023-03-11 00:15:30 - r - INFO: - lr 0.1 <class 'float'> 2023-03-11 00:15:30 - r - INFO: - task_dir C:\Users\24438\Desktop\joyrl-offline/tasks/Test_CliffWalking-v0_Sarsa_20230311-001530 <class 'str'> 2023-03-11 00:15:30 - r - INFO: - res_dir C:\Users\24438\Desktop\joyrl-offline/tasks/Test_CliffWalking-v0_Sarsa_20230311-001530/results <class 'str'> 2023-03-11 00:15:30 - r - INFO: - log_dir C:\Users\24438\Desktop\joyrl-offline/tasks/Test_CliffWalking-v0_Sarsa_20230311-001530/logs <class 'str'> 2023-03-11 00:15:30 - r - INFO: - traj_dir C:\Users\24438\Desktop\joyrl-offline/tasks/Test_CliffWalking-v0_Sarsa_20230311-001530/traj <class 'str'> 2023-03-11 00:15:30 - r - INFO: - tb_dir C:\Users\24438\Desktop\joyrl-offline/tasks/Test_CliffWalking-v0_Sarsa_20230311-001530/tb_logs <class 'str'> 2023-03-11 00:15:30 - r - INFO: - ================================================================================ 2023-03-11 00:15:31 - r - INFO: - n_states: 48, n_actions: 4 2023-03-11 00:15:31 - r - INFO: - Start testing! 2023-03-11 00:15:31 - r - INFO: - Env: CliffWalking-v0, Algorithm: Sarsa, Device: cpu 2023-03-11 00:15:38 - r - INFO: - Episode: 1/10, Reward: -13.000, Step: 13 2023-03-11 00:15:42 - r - INFO: - Episode: 2/10, Reward: -13.000, Step: 13 2023-03-11 00:15:45 - r - INFO: - Episode: 3/10, Reward: -13.000, Step: 13 2023-03-11 00:15:49 - r - INFO: - Episode: 4/10, Reward: -13.000, Step: 13 2023-03-11 00:15:52 - r - INFO: - Episode: 5/10, Reward: -13.000, Step: 13 2023-03-11 00:15:56 - r - INFO: - Episode: 6/10, Reward: -13.000, Step: 13 2023-03-11 00:15:59 - r - INFO: - Episode: 7/10, Reward: -13.000, Step: 13 2023-03-11 00:16:03 - r - INFO: - Episode: 8/10, Reward: -13.000, Step: 13 2023-03-11 00:16:06 - r - INFO: - Episode: 9/10, Reward: -13.000, Step: 13 2023-03-11 00:16:10 - r - INFO: - Episode: 10/10, Reward: -13.000, Step: 13 2023-03-11 00:16:10 - r - INFO: - Finish testing! |