2023-05-19 01:09:07 - SimpleLog - INFO: - General Configs: 2023-05-19 01:09:07 - SimpleLog - INFO: - ================================================================================ 2023-05-19 01:09:07 - SimpleLog - INFO: - Name Value Type 2023-05-19 01:09:07 - SimpleLog - INFO: - env_name gym 2023-05-19 01:09:07 - SimpleLog - INFO: - algo_name Sarsa 2023-05-19 01:09:07 - SimpleLog - INFO: - mode test 2023-05-19 01:09:07 - SimpleLog - INFO: - device cpu 2023-05-19 01:09:07 - SimpleLog - INFO: - seed 1 2023-05-19 01:09:07 - SimpleLog - INFO: - max_episode 10 2023-05-19 01:09:07 - SimpleLog - INFO: - max_step 100 2023-05-19 01:09:07 - SimpleLog - INFO: - collect_traj 0 2023-05-19 01:09:07 - SimpleLog - INFO: - mp_backend single 2023-05-19 01:09:07 - SimpleLog - INFO: - n_workers 1 2023-05-19 01:09:07 - SimpleLog - INFO: - n_learners 1 2023-05-19 01:09:07 - SimpleLog - INFO: - share_buffer 1 2023-05-19 01:09:07 - SimpleLog - INFO: - online_eval 0 2023-05-19 01:09:07 - SimpleLog - INFO: - online_eval_episode 10 2023-05-19 01:09:07 - SimpleLog - INFO: - model_save_fre 500 2023-05-19 01:09:07 - SimpleLog - INFO: - load_checkpoint 1 2023-05-19 01:09:07 - SimpleLog - INFO: - load_path Train_single_CliffWalking-v0_Sarsa_20230519-010804 2023-05-19 01:09:07 - SimpleLog - INFO: - load_model_step 12000 2023-05-19 01:09:07 - SimpleLog - INFO: - ================================================================================ 2023-05-19 01:09:07 - SimpleLog - INFO: - Algo Configs: 2023-05-19 01:09:07 - SimpleLog - INFO: - ================================================================================ 2023-05-19 01:09:07 - SimpleLog - INFO: - Name Value Type 2023-05-19 01:09:07 - SimpleLog - INFO: - epsilon_start 0.95 2023-05-19 01:09:07 - SimpleLog - INFO: - epsilon_end 0.01 2023-05-19 01:09:07 - SimpleLog - INFO: - epsilon_decay 300 2023-05-19 01:09:07 - SimpleLog - INFO: - gamma 0.99 2023-05-19 01:09:07 - SimpleLog - INFO: - lr 0.1 2023-05-19 01:09:07 - SimpleLog - INFO: - ================================================================================ 2023-05-19 01:09:07 - SimpleLog - INFO: - Env Configs: 2023-05-19 01:09:07 - SimpleLog - INFO: - ================================================================================ 2023-05-19 01:09:07 - SimpleLog - INFO: - Name Value Type 2023-05-19 01:09:07 - SimpleLog - INFO: - id CliffWalking-v0 2023-05-19 01:09:07 - SimpleLog - INFO: - render_mode None 2023-05-19 01:09:07 - SimpleLog - INFO: - wrapper None 2023-05-19 01:09:07 - SimpleLog - INFO: - ignore_params ['wrapper', 'ignore_params'] 2023-05-19 01:09:07 - SimpleLog - INFO: - ================================================================================ 2023-05-19 01:09:07 - SimpleLog - INFO: - obs_space: Discrete(48), n_actions: Discrete(4) 2023-05-19 01:09:07 - SimpleLog - INFO: - Start testing! 2023-05-19 01:09:07 - SimpleLog - INFO: - episode: 0, ep_reward: -13, ep_step: 13 2023-05-19 01:09:07 - SimpleLog - INFO: - episode: 1, ep_reward: -13, ep_step: 13 2023-05-19 01:09:07 - SimpleLog - INFO: - episode: 2, ep_reward: -13, ep_step: 13 2023-05-19 01:09:07 - SimpleLog - INFO: - episode: 3, ep_reward: -13, ep_step: 13 2023-05-19 01:09:07 - SimpleLog - INFO: - episode: 4, ep_reward: -13, ep_step: 13 2023-05-19 01:09:07 - SimpleLog - INFO: - episode: 5, ep_reward: -13, ep_step: 13 2023-05-19 01:09:07 - SimpleLog - INFO: - episode: 6, ep_reward: -13, ep_step: 13 2023-05-19 01:09:07 - SimpleLog - INFO: - episode: 7, ep_reward: -13, ep_step: 13 2023-05-19 01:09:07 - SimpleLog - INFO: - episode: 8, ep_reward: -13, ep_step: 13 2023-05-19 01:09:07 - SimpleLog - INFO: - episode: 9, ep_reward: -13, ep_step: 13 2023-05-19 01:09:07 - SimpleLog - INFO: - Finish testing! total time consumed: 0.03s