johnjim0816 commited on
Commit
43d89c4
β€’
1 Parent(s): 8ba2a32

update CliffWalking-v0 QLearning

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. CliffWalking-v0/Test_CliffWalking-v0_QLearning_20221128-150537/logs/log.txt +0 -14
  2. CliffWalking-v0/Test_CliffWalking-v0_QLearning_20221128-150537/results/learning_curve.png +0 -0
  3. CliffWalking-v0/Test_CliffWalking-v0_Sarsa_20230311-001530/results/res.csv +0 -11
  4. CliffWalking-v0/Train_CliffWalking-v0_QLearning_20221128-144520/logs/log.txt +0 -342
  5. CliffWalking-v0/Train_CliffWalking-v0_QLearning_20221128-144520/results/learning_curve.png +0 -0
  6. CliffWalking-v0/Train_CliffWalking-v0_QLearning_20221128-144520/results/res.csv +0 -301
  7. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_DynaQ_20221210-095944/config.yaml +0 -0
  8. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_DynaQ_20221210-095944/logs/log.txt +0 -0
  9. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_DynaQ_20221210-095944/modelsDynaQ_model.pkl +0 -0
  10. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_DynaQ_20221210-095944/results/learning_curve.png +0 -0
  11. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_DynaQ_20221210-095944/results/res.csv +0 -0
  12. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_Sarsa_20230311-001530/config.yaml +0 -0
  13. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_Sarsa_20230311-001530/logs/log.txt +0 -0
  14. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_Sarsa_20230311-001530/models/checkpoint.pkl +0 -0
  15. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_Sarsa_20230311-001530/results/learning_curve.png +0 -0
  16. {CliffWalking-v0/Test_CliffWalking-v0_QLearning_20221128-150537 β†’ ToyText/CliffWalking-v0/Test_CliffWalking-v0_Sarsa_20230311-001530}/results/res.csv +0 -0
  17. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_Sarsa_20230311-001530/tb_logs/events.out.tfevents.1678464930.DESKTOP-H34HQIQ.51560.0 +0 -0
  18. {CliffWalking-v0/Test_CliffWalking-v0_QLearning_20221128-150537 β†’ ToyText/CliffWalking-v0/Test_single_CliffWalking-v0_QLearning_20230519-005951}/config.yaml +20 -12
  19. ToyText/CliffWalking-v0/Test_single_CliffWalking-v0_QLearning_20230519-005951/logs/log.txt +52 -0
  20. CliffWalking-v0/Train_CliffWalking-v0_QLearning_20221128-144520/models/Qleaning_model.pkl β†’ ToyText/CliffWalking-v0/Test_single_CliffWalking-v0_QLearning_20230519-005951/tb_logs/interact/events.out.tfevents.1684429191.DESKTOP-H34HQIQ.94200.0 +2 -2
  21. CliffWalking-v0/Test_CliffWalking-v0_QLearning_20221128-150537/models/Qleaning_model.pkl β†’ ToyText/CliffWalking-v0/Test_single_CliffWalking-v0_QLearning_20230519-005951/tb_logs/model/events.out.tfevents.1684429191.DESKTOP-H34HQIQ.94200.1 +2 -2
  22. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_DynaQ_20221210-095808/config.yaml +0 -0
  23. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_DynaQ_20221210-095808/logs/log.txt +0 -0
  24. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_DynaQ_20221210-095808/modelsDynaQ_model.pkl +0 -0
  25. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_DynaQ_20221210-095808/results/learning_curve.png +0 -0
  26. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_DynaQ_20221210-095808/results/res.csv +0 -0
  27. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_Sarsa_20230311-001504/config.yaml +0 -0
  28. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_Sarsa_20230311-001504/logs/log.txt +0 -0
  29. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_Sarsa_20230311-001504/models/checkpoint.pkl +0 -0
  30. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_Sarsa_20230311-001504/results/learning_curve.png +0 -0
  31. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_Sarsa_20230311-001504/results/res.csv +0 -0
  32. {CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_Sarsa_20230311-001504/tb_logs/events.out.tfevents.1678464904.DESKTOP-H34HQIQ.27128.0 +0 -0
  33. {CliffWalking-v0/Train_CliffWalking-v0_QLearning_20221128-144520 β†’ ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837}/config.yaml +20 -11
  34. ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/logs/log.txt +342 -0
  35. ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/1000 +0 -0
  36. ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/10000 +0 -0
  37. ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/10500 +0 -0
  38. ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/11000 +0 -0
  39. ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/11500 +0 -0
  40. ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/12000 +0 -0
  41. ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/1500 +0 -0
  42. ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/2000 +0 -0
  43. ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/2500 +0 -0
  44. ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/3000 +0 -0
  45. ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/3500 +0 -0
  46. ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/4000 +0 -0
  47. ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/4500 +0 -0
  48. ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/500 +0 -0
  49. ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/5000 +0 -0
  50. ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/5500 +0 -0
CliffWalking-v0/Test_CliffWalking-v0_QLearning_20221128-150537/logs/log.txt DELETED
@@ -1,14 +0,0 @@
1
- 2022-11-28 15:05:39 - r - INFO: - n_states: 48, n_actions: 4
2
- 2022-11-28 15:05:39 - r - INFO: - Start testing!
3
- 2022-11-28 15:05:39 - r - INFO: - Env: CliffWalking-v0, Algorithm: QLearning, Device: cpu
4
- 2022-11-28 15:05:44 - r - INFO: - Episode: 1/10, Reward: -13.000, Step: 13
5
- 2022-11-28 15:05:45 - r - INFO: - Episode: 2/10, Reward: -13.000, Step: 13
6
- 2022-11-28 15:05:45 - r - INFO: - Episode: 3/10, Reward: -13.000, Step: 13
7
- 2022-11-28 15:05:46 - r - INFO: - Episode: 4/10, Reward: -13.000, Step: 13
8
- 2022-11-28 15:05:46 - r - INFO: - Episode: 5/10, Reward: -13.000, Step: 13
9
- 2022-11-28 15:05:46 - r - INFO: - Episode: 6/10, Reward: -13.000, Step: 13
10
- 2022-11-28 15:05:47 - r - INFO: - Episode: 7/10, Reward: -13.000, Step: 13
11
- 2022-11-28 15:05:47 - r - INFO: - Episode: 8/10, Reward: -13.000, Step: 13
12
- 2022-11-28 15:05:48 - r - INFO: - Episode: 9/10, Reward: -13.000, Step: 13
13
- 2022-11-28 15:05:48 - r - INFO: - Episode: 10/10, Reward: -13.000, Step: 13
14
- 2022-11-28 15:05:48 - r - INFO: - Finish testing!
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
CliffWalking-v0/Test_CliffWalking-v0_QLearning_20221128-150537/results/learning_curve.png DELETED
Binary file (22.7 kB)
 
CliffWalking-v0/Test_CliffWalking-v0_Sarsa_20230311-001530/results/res.csv DELETED
@@ -1,11 +0,0 @@
1
- episodes,rewards,steps
2
- 0,-13,13
3
- 1,-13,13
4
- 2,-13,13
5
- 3,-13,13
6
- 4,-13,13
7
- 5,-13,13
8
- 6,-13,13
9
- 7,-13,13
10
- 8,-13,13
11
- 9,-13,13
 
 
 
 
 
 
 
 
 
 
 
 
CliffWalking-v0/Train_CliffWalking-v0_QLearning_20221128-144520/logs/log.txt DELETED
@@ -1,342 +0,0 @@
1
- 2022-11-28 14:45:22 - r - INFO: - n_states: 48, n_actions: 4
2
- 2022-11-28 14:45:22 - r - INFO: - Start training!
3
- 2022-11-28 14:45:22 - r - INFO: - Env: CliffWalking-v0, Algorithm: QLearning, Device: cpu
4
- 2022-11-28 14:45:22 - r - INFO: - Episode: 1/300, Reward: -397.000, Step: 100
5
- 2022-11-28 14:45:22 - r - INFO: - Episode: 2/300, Reward: -1090.000, Step: 100
6
- 2022-11-28 14:45:22 - r - INFO: - Episode: 3/300, Reward: -694.000, Step: 100
7
- 2022-11-28 14:45:22 - r - INFO: - Episode: 4/300, Reward: -397.000, Step: 100
8
- 2022-11-28 14:45:22 - r - INFO: - Episode: 5/300, Reward: -496.000, Step: 100
9
- 2022-11-28 14:45:22 - r - INFO: - Current episode 5 has the best eval reward: -100.000
10
- 2022-11-28 14:45:22 - r - INFO: - Episode: 6/300, Reward: -298.000, Step: 100
11
- 2022-11-28 14:45:22 - r - INFO: - Episode: 7/300, Reward: -199.000, Step: 100
12
- 2022-11-28 14:45:22 - r - INFO: - Episode: 8/300, Reward: -298.000, Step: 100
13
- 2022-11-28 14:45:22 - r - INFO: - Episode: 9/300, Reward: -100.000, Step: 100
14
- 2022-11-28 14:45:22 - r - INFO: - Episode: 10/300, Reward: -199.000, Step: 100
15
- 2022-11-28 14:45:22 - r - INFO: - Current episode 10 has the best eval reward: -100.000
16
- 2022-11-28 14:45:22 - r - INFO: - Episode: 11/300, Reward: -93.000, Step: 93
17
- 2022-11-28 14:45:22 - r - INFO: - Episode: 12/300, Reward: -100.000, Step: 100
18
- 2022-11-28 14:45:22 - r - INFO: - Episode: 13/300, Reward: -199.000, Step: 100
19
- 2022-11-28 14:45:22 - r - INFO: - Episode: 14/300, Reward: -199.000, Step: 100
20
- 2022-11-28 14:45:22 - r - INFO: - Episode: 15/300, Reward: -100.000, Step: 100
21
- 2022-11-28 14:45:22 - r - INFO: - Current episode 15 has the best eval reward: -100.000
22
- 2022-11-28 14:45:22 - r - INFO: - Episode: 16/300, Reward: -100.000, Step: 100
23
- 2022-11-28 14:45:22 - r - INFO: - Episode: 17/300, Reward: -33.000, Step: 33
24
- 2022-11-28 14:45:22 - r - INFO: - Episode: 18/300, Reward: -100.000, Step: 100
25
- 2022-11-28 14:45:22 - r - INFO: - Episode: 19/300, Reward: -66.000, Step: 66
26
- 2022-11-28 14:45:22 - r - INFO: - Episode: 20/300, Reward: -99.000, Step: 99
27
- 2022-11-28 14:45:22 - r - INFO: - Current episode 20 has the best eval reward: -100.000
28
- 2022-11-28 14:45:22 - r - INFO: - Episode: 21/300, Reward: -100.000, Step: 100
29
- 2022-11-28 14:45:22 - r - INFO: - Episode: 22/300, Reward: -100.000, Step: 100
30
- 2022-11-28 14:45:22 - r - INFO: - Episode: 23/300, Reward: -100.000, Step: 100
31
- 2022-11-28 14:45:22 - r - INFO: - Episode: 24/300, Reward: -54.000, Step: 54
32
- 2022-11-28 14:45:22 - r - INFO: - Episode: 25/300, Reward: -100.000, Step: 100
33
- 2022-11-28 14:45:22 - r - INFO: - Current episode 25 has the best eval reward: -100.000
34
- 2022-11-28 14:45:22 - r - INFO: - Episode: 26/300, Reward: -73.000, Step: 73
35
- 2022-11-28 14:45:22 - r - INFO: - Episode: 27/300, Reward: -100.000, Step: 100
36
- 2022-11-28 14:45:22 - r - INFO: - Episode: 28/300, Reward: -90.000, Step: 90
37
- 2022-11-28 14:45:22 - r - INFO: - Episode: 29/300, Reward: -87.000, Step: 87
38
- 2022-11-28 14:45:22 - r - INFO: - Episode: 30/300, Reward: -100.000, Step: 100
39
- 2022-11-28 14:45:22 - r - INFO: - Current episode 30 has the best eval reward: -100.000
40
- 2022-11-28 14:45:22 - r - INFO: - Episode: 31/300, Reward: -46.000, Step: 46
41
- 2022-11-28 14:45:22 - r - INFO: - Episode: 32/300, Reward: -82.000, Step: 82
42
- 2022-11-28 14:45:22 - r - INFO: - Episode: 33/300, Reward: -100.000, Step: 100
43
- 2022-11-28 14:45:22 - r - INFO: - Episode: 34/300, Reward: -100.000, Step: 100
44
- 2022-11-28 14:45:22 - r - INFO: - Episode: 35/300, Reward: -67.000, Step: 67
45
- 2022-11-28 14:45:22 - r - INFO: - Current episode 35 has the best eval reward: -100.000
46
- 2022-11-28 14:45:22 - r - INFO: - Episode: 36/300, Reward: -75.000, Step: 75
47
- 2022-11-28 14:45:22 - r - INFO: - Episode: 37/300, Reward: -100.000, Step: 100
48
- 2022-11-28 14:45:22 - r - INFO: - Episode: 38/300, Reward: -45.000, Step: 45
49
- 2022-11-28 14:45:22 - r - INFO: - Episode: 39/300, Reward: -100.000, Step: 100
50
- 2022-11-28 14:45:22 - r - INFO: - Episode: 40/300, Reward: -37.000, Step: 37
51
- 2022-11-28 14:45:22 - r - INFO: - Current episode 40 has the best eval reward: -100.000
52
- 2022-11-28 14:45:22 - r - INFO: - Episode: 41/300, Reward: -100.000, Step: 100
53
- 2022-11-28 14:45:22 - r - INFO: - Episode: 42/300, Reward: -43.000, Step: 43
54
- 2022-11-28 14:45:22 - r - INFO: - Episode: 43/300, Reward: -100.000, Step: 100
55
- 2022-11-28 14:45:22 - r - INFO: - Episode: 44/300, Reward: -56.000, Step: 56
56
- 2022-11-28 14:45:22 - r - INFO: - Episode: 45/300, Reward: -70.000, Step: 70
57
- 2022-11-28 14:45:22 - r - INFO: - Current episode 45 has the best eval reward: -100.000
58
- 2022-11-28 14:45:22 - r - INFO: - Episode: 46/300, Reward: -100.000, Step: 100
59
- 2022-11-28 14:45:22 - r - INFO: - Episode: 47/300, Reward: -47.000, Step: 47
60
- 2022-11-28 14:45:22 - r - INFO: - Episode: 48/300, Reward: -85.000, Step: 85
61
- 2022-11-28 14:45:22 - r - INFO: - Episode: 49/300, Reward: -82.000, Step: 82
62
- 2022-11-28 14:45:22 - r - INFO: - Episode: 50/300, Reward: -51.000, Step: 51
63
- 2022-11-28 14:45:22 - r - INFO: - Current episode 50 has the best eval reward: -100.000
64
- 2022-11-28 14:45:22 - r - INFO: - Episode: 51/300, Reward: -50.000, Step: 50
65
- 2022-11-28 14:45:22 - r - INFO: - Episode: 52/300, Reward: -86.000, Step: 86
66
- 2022-11-28 14:45:22 - r - INFO: - Episode: 53/300, Reward: -100.000, Step: 100
67
- 2022-11-28 14:45:22 - r - INFO: - Episode: 54/300, Reward: -40.000, Step: 40
68
- 2022-11-28 14:45:22 - r - INFO: - Episode: 55/300, Reward: -87.000, Step: 87
69
- 2022-11-28 14:45:22 - r - INFO: - Current episode 55 has the best eval reward: -100.000
70
- 2022-11-28 14:45:22 - r - INFO: - Episode: 56/300, Reward: -59.000, Step: 59
71
- 2022-11-28 14:45:22 - r - INFO: - Episode: 57/300, Reward: -51.000, Step: 51
72
- 2022-11-28 14:45:22 - r - INFO: - Episode: 58/300, Reward: -98.000, Step: 98
73
- 2022-11-28 14:45:22 - r - INFO: - Episode: 59/300, Reward: -67.000, Step: 67
74
- 2022-11-28 14:45:22 - r - INFO: - Episode: 60/300, Reward: -60.000, Step: 60
75
- 2022-11-28 14:45:22 - r - INFO: - Current episode 60 has the best eval reward: -100.000
76
- 2022-11-28 14:45:22 - r - INFO: - Episode: 61/300, Reward: -38.000, Step: 38
77
- 2022-11-28 14:45:22 - r - INFO: - Episode: 62/300, Reward: -76.000, Step: 76
78
- 2022-11-28 14:45:22 - r - INFO: - Episode: 63/300, Reward: -70.000, Step: 70
79
- 2022-11-28 14:45:22 - r - INFO: - Episode: 64/300, Reward: -60.000, Step: 60
80
- 2022-11-28 14:45:22 - r - INFO: - Episode: 65/300, Reward: -68.000, Step: 68
81
- 2022-11-28 14:45:22 - r - INFO: - Current episode 65 has the best eval reward: -100.000
82
- 2022-11-28 14:45:22 - r - INFO: - Episode: 66/300, Reward: -25.000, Step: 25
83
- 2022-11-28 14:45:22 - r - INFO: - Episode: 67/300, Reward: -69.000, Step: 69
84
- 2022-11-28 14:45:22 - r - INFO: - Episode: 68/300, Reward: -183.000, Step: 84
85
- 2022-11-28 14:45:22 - r - INFO: - Episode: 69/300, Reward: -62.000, Step: 62
86
- 2022-11-28 14:45:22 - r - INFO: - Episode: 70/300, Reward: -44.000, Step: 44
87
- 2022-11-28 14:45:22 - r - INFO: - Current episode 70 has the best eval reward: -100.000
88
- 2022-11-28 14:45:22 - r - INFO: - Episode: 71/300, Reward: -71.000, Step: 71
89
- 2022-11-28 14:45:22 - r - INFO: - Episode: 72/300, Reward: -55.000, Step: 55
90
- 2022-11-28 14:45:22 - r - INFO: - Episode: 73/300, Reward: -65.000, Step: 65
91
- 2022-11-28 14:45:22 - r - INFO: - Episode: 74/300, Reward: -61.000, Step: 61
92
- 2022-11-28 14:45:22 - r - INFO: - Episode: 75/300, Reward: -36.000, Step: 36
93
- 2022-11-28 14:45:22 - r - INFO: - Current episode 75 has the best eval reward: -100.000
94
- 2022-11-28 14:45:22 - r - INFO: - Episode: 76/300, Reward: -47.000, Step: 47
95
- 2022-11-28 14:45:22 - r - INFO: - Episode: 77/300, Reward: -63.000, Step: 63
96
- 2022-11-28 14:45:22 - r - INFO: - Episode: 78/300, Reward: -45.000, Step: 45
97
- 2022-11-28 14:45:22 - r - INFO: - Episode: 79/300, Reward: -59.000, Step: 59
98
- 2022-11-28 14:45:22 - r - INFO: - Episode: 80/300, Reward: -39.000, Step: 39
99
- 2022-11-28 14:45:23 - r - INFO: - Current episode 80 has the best eval reward: -100.000
100
- 2022-11-28 14:45:23 - r - INFO: - Episode: 81/300, Reward: -62.000, Step: 62
101
- 2022-11-28 14:45:23 - r - INFO: - Episode: 82/300, Reward: -38.000, Step: 38
102
- 2022-11-28 14:45:23 - r - INFO: - Episode: 83/300, Reward: -64.000, Step: 64
103
- 2022-11-28 14:45:23 - r - INFO: - Episode: 84/300, Reward: -40.000, Step: 40
104
- 2022-11-28 14:45:23 - r - INFO: - Episode: 85/300, Reward: -59.000, Step: 59
105
- 2022-11-28 14:45:23 - r - INFO: - Current episode 85 has the best eval reward: -100.000
106
- 2022-11-28 14:45:23 - r - INFO: - Episode: 86/300, Reward: -48.000, Step: 48
107
- 2022-11-28 14:45:23 - r - INFO: - Episode: 87/300, Reward: -39.000, Step: 39
108
- 2022-11-28 14:45:23 - r - INFO: - Episode: 88/300, Reward: -70.000, Step: 70
109
- 2022-11-28 14:45:23 - r - INFO: - Episode: 89/300, Reward: -34.000, Step: 34
110
- 2022-11-28 14:45:23 - r - INFO: - Episode: 90/300, Reward: -40.000, Step: 40
111
- 2022-11-28 14:45:23 - r - INFO: - Current episode 90 has the best eval reward: -100.000
112
- 2022-11-28 14:45:23 - r - INFO: - Episode: 91/300, Reward: -27.000, Step: 27
113
- 2022-11-28 14:45:23 - r - INFO: - Episode: 92/300, Reward: -65.000, Step: 65
114
- 2022-11-28 14:45:23 - r - INFO: - Episode: 93/300, Reward: -79.000, Step: 79
115
- 2022-11-28 14:45:23 - r - INFO: - Episode: 94/300, Reward: -30.000, Step: 30
116
- 2022-11-28 14:45:23 - r - INFO: - Episode: 95/300, Reward: -38.000, Step: 38
117
- 2022-11-28 14:45:23 - r - INFO: - Current episode 95 has the best eval reward: -100.000
118
- 2022-11-28 14:45:23 - r - INFO: - Episode: 96/300, Reward: -23.000, Step: 23
119
- 2022-11-28 14:45:23 - r - INFO: - Episode: 97/300, Reward: -60.000, Step: 60
120
- 2022-11-28 14:45:23 - r - INFO: - Episode: 98/300, Reward: -41.000, Step: 41
121
- 2022-11-28 14:45:23 - r - INFO: - Episode: 99/300, Reward: -39.000, Step: 39
122
- 2022-11-28 14:45:23 - r - INFO: - Episode: 100/300, Reward: -42.000, Step: 42
123
- 2022-11-28 14:45:23 - r - INFO: - Current episode 100 has the best eval reward: -100.000
124
- 2022-11-28 14:45:23 - r - INFO: - Episode: 101/300, Reward: -41.000, Step: 41
125
- 2022-11-28 14:45:23 - r - INFO: - Episode: 102/300, Reward: -59.000, Step: 59
126
- 2022-11-28 14:45:23 - r - INFO: - Episode: 103/300, Reward: -31.000, Step: 31
127
- 2022-11-28 14:45:23 - r - INFO: - Episode: 104/300, Reward: -43.000, Step: 43
128
- 2022-11-28 14:45:23 - r - INFO: - Episode: 105/300, Reward: -70.000, Step: 70
129
- 2022-11-28 14:45:23 - r - INFO: - Current episode 105 has the best eval reward: -100.000
130
- 2022-11-28 14:45:23 - r - INFO: - Episode: 106/300, Reward: -29.000, Step: 29
131
- 2022-11-28 14:45:23 - r - INFO: - Episode: 107/300, Reward: -161.000, Step: 62
132
- 2022-11-28 14:45:23 - r - INFO: - Episode: 108/300, Reward: -38.000, Step: 38
133
- 2022-11-28 14:45:23 - r - INFO: - Episode: 109/300, Reward: -45.000, Step: 45
134
- 2022-11-28 14:45:23 - r - INFO: - Episode: 110/300, Reward: -29.000, Step: 29
135
- 2022-11-28 14:45:23 - r - INFO: - Current episode 110 has the best eval reward: -100.000
136
- 2022-11-28 14:45:23 - r - INFO: - Episode: 111/300, Reward: -47.000, Step: 47
137
- 2022-11-28 14:45:23 - r - INFO: - Episode: 112/300, Reward: -23.000, Step: 23
138
- 2022-11-28 14:45:23 - r - INFO: - Episode: 113/300, Reward: -62.000, Step: 62
139
- 2022-11-28 14:45:23 - r - INFO: - Episode: 114/300, Reward: -34.000, Step: 34
140
- 2022-11-28 14:45:23 - r - INFO: - Episode: 115/300, Reward: -46.000, Step: 46
141
- 2022-11-28 14:45:23 - r - INFO: - Current episode 115 has the best eval reward: -100.000
142
- 2022-11-28 14:45:23 - r - INFO: - Episode: 116/300, Reward: -29.000, Step: 29
143
- 2022-11-28 14:45:23 - r - INFO: - Episode: 117/300, Reward: -46.000, Step: 46
144
- 2022-11-28 14:45:23 - r - INFO: - Episode: 118/300, Reward: -30.000, Step: 30
145
- 2022-11-28 14:45:23 - r - INFO: - Episode: 119/300, Reward: -24.000, Step: 24
146
- 2022-11-28 14:45:23 - r - INFO: - Episode: 120/300, Reward: -30.000, Step: 30
147
- 2022-11-28 14:45:23 - r - INFO: - Current episode 120 has the best eval reward: -100.000
148
- 2022-11-28 14:45:23 - r - INFO: - Episode: 121/300, Reward: -42.000, Step: 42
149
- 2022-11-28 14:45:23 - r - INFO: - Episode: 122/300, Reward: -62.000, Step: 62
150
- 2022-11-28 14:45:23 - r - INFO: - Episode: 123/300, Reward: -30.000, Step: 30
151
- 2022-11-28 14:45:23 - r - INFO: - Episode: 124/300, Reward: -31.000, Step: 31
152
- 2022-11-28 14:45:23 - r - INFO: - Episode: 125/300, Reward: -37.000, Step: 37
153
- 2022-11-28 14:45:23 - r - INFO: - Current episode 125 has the best eval reward: -100.000
154
- 2022-11-28 14:45:23 - r - INFO: - Episode: 126/300, Reward: -51.000, Step: 51
155
- 2022-11-28 14:45:23 - r - INFO: - Episode: 127/300, Reward: -32.000, Step: 32
156
- 2022-11-28 14:45:23 - r - INFO: - Episode: 128/300, Reward: -22.000, Step: 22
157
- 2022-11-28 14:45:23 - r - INFO: - Episode: 129/300, Reward: -34.000, Step: 34
158
- 2022-11-28 14:45:23 - r - INFO: - Episode: 130/300, Reward: -22.000, Step: 22
159
- 2022-11-28 14:45:23 - r - INFO: - Current episode 130 has the best eval reward: -100.000
160
- 2022-11-28 14:45:23 - r - INFO: - Episode: 131/300, Reward: -53.000, Step: 53
161
- 2022-11-28 14:45:23 - r - INFO: - Episode: 132/300, Reward: -28.000, Step: 28
162
- 2022-11-28 14:45:23 - r - INFO: - Episode: 133/300, Reward: -33.000, Step: 33
163
- 2022-11-28 14:45:23 - r - INFO: - Episode: 134/300, Reward: -39.000, Step: 39
164
- 2022-11-28 14:45:23 - r - INFO: - Episode: 135/300, Reward: -39.000, Step: 39
165
- 2022-11-28 14:45:23 - r - INFO: - Current episode 135 has the best eval reward: -100.000
166
- 2022-11-28 14:45:23 - r - INFO: - Episode: 136/300, Reward: -20.000, Step: 20
167
- 2022-11-28 14:45:23 - r - INFO: - Episode: 137/300, Reward: -30.000, Step: 30
168
- 2022-11-28 14:45:23 - r - INFO: - Episode: 138/300, Reward: -42.000, Step: 42
169
- 2022-11-28 14:45:23 - r - INFO: - Episode: 139/300, Reward: -154.000, Step: 55
170
- 2022-11-28 14:45:23 - r - INFO: - Episode: 140/300, Reward: -34.000, Step: 34
171
- 2022-11-28 14:45:23 - r - INFO: - Current episode 140 has the best eval reward: -100.000
172
- 2022-11-28 14:45:23 - r - INFO: - Episode: 141/300, Reward: -29.000, Step: 29
173
- 2022-11-28 14:45:23 - r - INFO: - Episode: 142/300, Reward: -21.000, Step: 21
174
- 2022-11-28 14:45:23 - r - INFO: - Episode: 143/300, Reward: -38.000, Step: 38
175
- 2022-11-28 14:45:23 - r - INFO: - Episode: 144/300, Reward: -21.000, Step: 21
176
- 2022-11-28 14:45:23 - r - INFO: - Episode: 145/300, Reward: -46.000, Step: 46
177
- 2022-11-28 14:45:23 - r - INFO: - Current episode 145 has the best eval reward: -100.000
178
- 2022-11-28 14:45:23 - r - INFO: - Episode: 146/300, Reward: -19.000, Step: 19
179
- 2022-11-28 14:45:23 - r - INFO: - Episode: 147/300, Reward: -37.000, Step: 37
180
- 2022-11-28 14:45:23 - r - INFO: - Episode: 148/300, Reward: -27.000, Step: 27
181
- 2022-11-28 14:45:23 - r - INFO: - Episode: 149/300, Reward: -39.000, Step: 39
182
- 2022-11-28 14:45:23 - r - INFO: - Episode: 150/300, Reward: -18.000, Step: 18
183
- 2022-11-28 14:45:23 - r - INFO: - Current episode 150 has the best eval reward: -100.000
184
- 2022-11-28 14:45:23 - r - INFO: - Episode: 151/300, Reward: -34.000, Step: 34
185
- 2022-11-28 14:45:23 - r - INFO: - Episode: 152/300, Reward: -25.000, Step: 25
186
- 2022-11-28 14:45:23 - r - INFO: - Episode: 153/300, Reward: -32.000, Step: 32
187
- 2022-11-28 14:45:23 - r - INFO: - Episode: 154/300, Reward: -40.000, Step: 40
188
- 2022-11-28 14:45:23 - r - INFO: - Episode: 155/300, Reward: -30.000, Step: 30
189
- 2022-11-28 14:45:23 - r - INFO: - Current episode 155 has the best eval reward: -100.000
190
- 2022-11-28 14:45:23 - r - INFO: - Episode: 156/300, Reward: -36.000, Step: 36
191
- 2022-11-28 14:45:23 - r - INFO: - Episode: 157/300, Reward: -29.000, Step: 29
192
- 2022-11-28 14:45:23 - r - INFO: - Episode: 158/300, Reward: -30.000, Step: 30
193
- 2022-11-28 14:45:23 - r - INFO: - Episode: 159/300, Reward: -29.000, Step: 29
194
- 2022-11-28 14:45:23 - r - INFO: - Episode: 160/300, Reward: -22.000, Step: 22
195
- 2022-11-28 14:45:23 - r - INFO: - Current episode 160 has the best eval reward: -100.000
196
- 2022-11-28 14:45:23 - r - INFO: - Episode: 161/300, Reward: -18.000, Step: 18
197
- 2022-11-28 14:45:23 - r - INFO: - Episode: 162/300, Reward: -46.000, Step: 46
198
- 2022-11-28 14:45:23 - r - INFO: - Episode: 163/300, Reward: -27.000, Step: 27
199
- 2022-11-28 14:45:23 - r - INFO: - Episode: 164/300, Reward: -22.000, Step: 22
200
- 2022-11-28 14:45:23 - r - INFO: - Episode: 165/300, Reward: -34.000, Step: 34
201
- 2022-11-28 14:45:23 - r - INFO: - Current episode 165 has the best eval reward: -15.000
202
- 2022-11-28 14:45:23 - r - INFO: - Episode: 166/300, Reward: -15.000, Step: 15
203
- 2022-11-28 14:45:23 - r - INFO: - Episode: 167/300, Reward: -24.000, Step: 24
204
- 2022-11-28 14:45:23 - r - INFO: - Episode: 168/300, Reward: -45.000, Step: 45
205
- 2022-11-28 14:45:23 - r - INFO: - Episode: 169/300, Reward: -36.000, Step: 36
206
- 2022-11-28 14:45:23 - r - INFO: - Episode: 170/300, Reward: -20.000, Step: 20
207
- 2022-11-28 14:45:23 - r - INFO: - Episode: 171/300, Reward: -26.000, Step: 26
208
- 2022-11-28 14:45:23 - r - INFO: - Episode: 172/300, Reward: -29.000, Step: 29
209
- 2022-11-28 14:45:23 - r - INFO: - Episode: 173/300, Reward: -32.000, Step: 32
210
- 2022-11-28 14:45:23 - r - INFO: - Episode: 174/300, Reward: -17.000, Step: 17
211
- 2022-11-28 14:45:23 - r - INFO: - Episode: 175/300, Reward: -31.000, Step: 31
212
- 2022-11-28 14:45:23 - r - INFO: - Current episode 175 has the best eval reward: -15.000
213
- 2022-11-28 14:45:23 - r - INFO: - Episode: 176/300, Reward: -15.000, Step: 15
214
- 2022-11-28 14:45:23 - r - INFO: - Episode: 177/300, Reward: -31.000, Step: 31
215
- 2022-11-28 14:45:23 - r - INFO: - Episode: 178/300, Reward: -29.000, Step: 29
216
- 2022-11-28 14:45:23 - r - INFO: - Episode: 179/300, Reward: -29.000, Step: 29
217
- 2022-11-28 14:45:23 - r - INFO: - Episode: 180/300, Reward: -21.000, Step: 21
218
- 2022-11-28 14:45:23 - r - INFO: - Episode: 181/300, Reward: -31.000, Step: 31
219
- 2022-11-28 14:45:23 - r - INFO: - Episode: 182/300, Reward: -21.000, Step: 21
220
- 2022-11-28 14:45:23 - r - INFO: - Episode: 183/300, Reward: -39.000, Step: 39
221
- 2022-11-28 14:45:23 - r - INFO: - Episode: 184/300, Reward: -30.000, Step: 30
222
- 2022-11-28 14:45:23 - r - INFO: - Episode: 185/300, Reward: -13.000, Step: 13
223
- 2022-11-28 14:45:23 - r - INFO: - Episode: 186/300, Reward: -30.000, Step: 30
224
- 2022-11-28 14:45:23 - r - INFO: - Episode: 187/300, Reward: -27.000, Step: 27
225
- 2022-11-28 14:45:23 - r - INFO: - Episode: 188/300, Reward: -18.000, Step: 18
226
- 2022-11-28 14:45:23 - r - INFO: - Episode: 189/300, Reward: -17.000, Step: 17
227
- 2022-11-28 14:45:23 - r - INFO: - Episode: 190/300, Reward: -24.000, Step: 24
228
- 2022-11-28 14:45:23 - r - INFO: - Episode: 191/300, Reward: -28.000, Step: 28
229
- 2022-11-28 14:45:23 - r - INFO: - Episode: 192/300, Reward: -36.000, Step: 36
230
- 2022-11-28 14:45:23 - r - INFO: - Episode: 193/300, Reward: -15.000, Step: 15
231
- 2022-11-28 14:45:23 - r - INFO: - Episode: 194/300, Reward: -40.000, Step: 40
232
- 2022-11-28 14:45:23 - r - INFO: - Episode: 195/300, Reward: -20.000, Step: 20
233
- 2022-11-28 14:45:23 - r - INFO: - Episode: 196/300, Reward: -23.000, Step: 23
234
- 2022-11-28 14:45:23 - r - INFO: - Episode: 197/300, Reward: -17.000, Step: 17
235
- 2022-11-28 14:45:23 - r - INFO: - Episode: 198/300, Reward: -28.000, Step: 28
236
- 2022-11-28 14:45:23 - r - INFO: - Episode: 199/300, Reward: -15.000, Step: 15
237
- 2022-11-28 14:45:23 - r - INFO: - Episode: 200/300, Reward: -27.000, Step: 27
238
- 2022-11-28 14:45:23 - r - INFO: - Episode: 201/300, Reward: -14.000, Step: 14
239
- 2022-11-28 14:45:23 - r - INFO: - Episode: 202/300, Reward: -31.000, Step: 31
240
- 2022-11-28 14:45:23 - r - INFO: - Episode: 203/300, Reward: -25.000, Step: 25
241
- 2022-11-28 14:45:23 - r - INFO: - Episode: 204/300, Reward: -19.000, Step: 19
242
- 2022-11-28 14:45:23 - r - INFO: - Episode: 205/300, Reward: -36.000, Step: 36
243
- 2022-11-28 14:45:23 - r - INFO: - Episode: 206/300, Reward: -29.000, Step: 29
244
- 2022-11-28 14:45:23 - r - INFO: - Episode: 207/300, Reward: -20.000, Step: 20
245
- 2022-11-28 14:45:23 - r - INFO: - Episode: 208/300, Reward: -23.000, Step: 23
246
- 2022-11-28 14:45:23 - r - INFO: - Episode: 209/300, Reward: -14.000, Step: 14
247
- 2022-11-28 14:45:23 - r - INFO: - Episode: 210/300, Reward: -28.000, Step: 28
248
- 2022-11-28 14:45:23 - r - INFO: - Episode: 211/300, Reward: -19.000, Step: 19
249
- 2022-11-28 14:45:23 - r - INFO: - Episode: 212/300, Reward: -26.000, Step: 26
250
- 2022-11-28 14:45:23 - r - INFO: - Episode: 213/300, Reward: -18.000, Step: 18
251
- 2022-11-28 14:45:23 - r - INFO: - Episode: 214/300, Reward: -26.000, Step: 26
252
- 2022-11-28 14:45:23 - r - INFO: - Episode: 215/300, Reward: -19.000, Step: 19
253
- 2022-11-28 14:45:23 - r - INFO: - Episode: 216/300, Reward: -23.000, Step: 23
254
- 2022-11-28 14:45:23 - r - INFO: - Episode: 217/300, Reward: -20.000, Step: 20
255
- 2022-11-28 14:45:23 - r - INFO: - Episode: 218/300, Reward: -48.000, Step: 48
256
- 2022-11-28 14:45:23 - r - INFO: - Episode: 219/300, Reward: -13.000, Step: 13
257
- 2022-11-28 14:45:23 - r - INFO: - Episode: 220/300, Reward: -133.000, Step: 34
258
- 2022-11-28 14:45:23 - r - INFO: - Episode: 221/300, Reward: -17.000, Step: 17
259
- 2022-11-28 14:45:23 - r - INFO: - Episode: 222/300, Reward: -20.000, Step: 20
260
- 2022-11-28 14:45:23 - r - INFO: - Episode: 223/300, Reward: -18.000, Step: 18
261
- 2022-11-28 14:45:23 - r - INFO: - Episode: 224/300, Reward: -35.000, Step: 35
262
- 2022-11-28 14:45:23 - r - INFO: - Episode: 225/300, Reward: -17.000, Step: 17
263
- 2022-11-28 14:45:23 - r - INFO: - Current episode 225 has the best eval reward: -13.000
264
- 2022-11-28 14:45:23 - r - INFO: - Episode: 226/300, Reward: -13.000, Step: 13
265
- 2022-11-28 14:45:23 - r - INFO: - Episode: 227/300, Reward: -16.000, Step: 16
266
- 2022-11-28 14:45:23 - r - INFO: - Episode: 228/300, Reward: -25.000, Step: 25
267
- 2022-11-28 14:45:23 - r - INFO: - Episode: 229/300, Reward: -25.000, Step: 25
268
- 2022-11-28 14:45:23 - r - INFO: - Episode: 230/300, Reward: -26.000, Step: 26
269
- 2022-11-28 14:45:24 - r - INFO: - Episode: 231/300, Reward: -19.000, Step: 19
270
- 2022-11-28 14:45:24 - r - INFO: - Episode: 232/300, Reward: -17.000, Step: 17
271
- 2022-11-28 14:45:24 - r - INFO: - Episode: 233/300, Reward: -27.000, Step: 27
272
- 2022-11-28 14:45:24 - r - INFO: - Episode: 234/300, Reward: -30.000, Step: 30
273
- 2022-11-28 14:45:24 - r - INFO: - Episode: 235/300, Reward: -17.000, Step: 17
274
- 2022-11-28 14:45:24 - r - INFO: - Episode: 236/300, Reward: -18.000, Step: 18
275
- 2022-11-28 14:45:24 - r - INFO: - Episode: 237/300, Reward: -122.000, Step: 23
276
- 2022-11-28 14:45:24 - r - INFO: - Episode: 238/300, Reward: -25.000, Step: 25
277
- 2022-11-28 14:45:24 - r - INFO: - Episode: 239/300, Reward: -20.000, Step: 20
278
- 2022-11-28 14:45:24 - r - INFO: - Episode: 240/300, Reward: -13.000, Step: 13
279
- 2022-11-28 14:45:24 - r - INFO: - Episode: 241/300, Reward: -39.000, Step: 39
280
- 2022-11-28 14:45:24 - r - INFO: - Episode: 242/300, Reward: -17.000, Step: 17
281
- 2022-11-28 14:45:24 - r - INFO: - Episode: 243/300, Reward: -14.000, Step: 14
282
- 2022-11-28 14:45:24 - r - INFO: - Episode: 244/300, Reward: -15.000, Step: 15
283
- 2022-11-28 14:45:24 - r - INFO: - Episode: 245/300, Reward: -22.000, Step: 22
284
- 2022-11-28 14:45:24 - r - INFO: - Episode: 246/300, Reward: -31.000, Step: 31
285
- 2022-11-28 14:45:24 - r - INFO: - Episode: 247/300, Reward: -20.000, Step: 20
286
- 2022-11-28 14:45:24 - r - INFO: - Episode: 248/300, Reward: -28.000, Step: 28
287
- 2022-11-28 14:45:24 - r - INFO: - Episode: 249/300, Reward: -15.000, Step: 15
288
- 2022-11-28 14:45:24 - r - INFO: - Episode: 250/300, Reward: -19.000, Step: 19
289
- 2022-11-28 14:45:24 - r - INFO: - Episode: 251/300, Reward: -15.000, Step: 15
290
- 2022-11-28 14:45:24 - r - INFO: - Episode: 252/300, Reward: -13.000, Step: 13
291
- 2022-11-28 14:45:24 - r - INFO: - Episode: 253/300, Reward: -21.000, Step: 21
292
- 2022-11-28 14:45:24 - r - INFO: - Episode: 254/300, Reward: -16.000, Step: 16
293
- 2022-11-28 14:45:24 - r - INFO: - Episode: 255/300, Reward: -22.000, Step: 22
294
- 2022-11-28 14:45:24 - r - INFO: - Episode: 256/300, Reward: -18.000, Step: 18
295
- 2022-11-28 14:45:24 - r - INFO: - Episode: 257/300, Reward: -23.000, Step: 23
296
- 2022-11-28 14:45:24 - r - INFO: - Episode: 258/300, Reward: -16.000, Step: 16
297
- 2022-11-28 14:45:24 - r - INFO: - Episode: 259/300, Reward: -22.000, Step: 22
298
- 2022-11-28 14:45:24 - r - INFO: - Episode: 260/300, Reward: -13.000, Step: 13
299
- 2022-11-28 14:45:24 - r - INFO: - Current episode 260 has the best eval reward: -13.000
300
- 2022-11-28 14:45:24 - r - INFO: - Episode: 261/300, Reward: -13.000, Step: 13
301
- 2022-11-28 14:45:24 - r - INFO: - Episode: 262/300, Reward: -19.000, Step: 19
302
- 2022-11-28 14:45:24 - r - INFO: - Episode: 263/300, Reward: -17.000, Step: 17
303
- 2022-11-28 14:45:24 - r - INFO: - Episode: 264/300, Reward: -32.000, Step: 32
304
- 2022-11-28 14:45:24 - r - INFO: - Episode: 265/300, Reward: -16.000, Step: 16
305
- 2022-11-28 14:45:24 - r - INFO: - Episode: 266/300, Reward: -15.000, Step: 15
306
- 2022-11-28 14:45:24 - r - INFO: - Episode: 267/300, Reward: -17.000, Step: 17
307
- 2022-11-28 14:45:24 - r - INFO: - Episode: 268/300, Reward: -13.000, Step: 13
308
- 2022-11-28 14:45:24 - r - INFO: - Episode: 269/300, Reward: -15.000, Step: 15
309
- 2022-11-28 14:45:24 - r - INFO: - Episode: 270/300, Reward: -28.000, Step: 28
310
- 2022-11-28 14:45:24 - r - INFO: - Episode: 271/300, Reward: -15.000, Step: 15
311
- 2022-11-28 14:45:24 - r - INFO: - Episode: 272/300, Reward: -13.000, Step: 13
312
- 2022-11-28 14:45:24 - r - INFO: - Episode: 273/300, Reward: -16.000, Step: 16
313
- 2022-11-28 14:45:24 - r - INFO: - Episode: 274/300, Reward: -128.000, Step: 29
314
- 2022-11-28 14:45:24 - r - INFO: - Episode: 275/300, Reward: -32.000, Step: 32
315
- 2022-11-28 14:45:24 - r - INFO: - Episode: 276/300, Reward: -24.000, Step: 24
316
- 2022-11-28 14:45:24 - r - INFO: - Episode: 277/300, Reward: -26.000, Step: 26
317
- 2022-11-28 14:45:24 - r - INFO: - Episode: 278/300, Reward: -14.000, Step: 14
318
- 2022-11-28 14:45:24 - r - INFO: - Episode: 279/300, Reward: -25.000, Step: 25
319
- 2022-11-28 14:45:24 - r - INFO: - Episode: 280/300, Reward: -22.000, Step: 22
320
- 2022-11-28 14:45:24 - r - INFO: - Current episode 280 has the best eval reward: -13.000
321
- 2022-11-28 14:45:24 - r - INFO: - Episode: 281/300, Reward: -13.000, Step: 13
322
- 2022-11-28 14:45:24 - r - INFO: - Episode: 282/300, Reward: -15.000, Step: 15
323
- 2022-11-28 14:45:24 - r - INFO: - Episode: 283/300, Reward: -15.000, Step: 15
324
- 2022-11-28 14:45:24 - r - INFO: - Episode: 284/300, Reward: -13.000, Step: 13
325
- 2022-11-28 14:45:24 - r - INFO: - Episode: 285/300, Reward: -13.000, Step: 13
326
- 2022-11-28 14:45:24 - r - INFO: - Episode: 286/300, Reward: -16.000, Step: 16
327
- 2022-11-28 14:45:24 - r - INFO: - Episode: 287/300, Reward: -21.000, Step: 21
328
- 2022-11-28 14:45:24 - r - INFO: - Episode: 288/300, Reward: -19.000, Step: 19
329
- 2022-11-28 14:45:24 - r - INFO: - Episode: 289/300, Reward: -26.000, Step: 26
330
- 2022-11-28 14:45:24 - r - INFO: - Episode: 290/300, Reward: -16.000, Step: 16
331
- 2022-11-28 14:45:24 - r - INFO: - Current episode 290 has the best eval reward: -13.000
332
- 2022-11-28 14:45:24 - r - INFO: - Episode: 291/300, Reward: -13.000, Step: 13
333
- 2022-11-28 14:45:24 - r - INFO: - Episode: 292/300, Reward: -13.000, Step: 13
334
- 2022-11-28 14:45:24 - r - INFO: - Episode: 293/300, Reward: -13.000, Step: 13
335
- 2022-11-28 14:45:24 - r - INFO: - Episode: 294/300, Reward: -15.000, Step: 15
336
- 2022-11-28 14:45:24 - r - INFO: - Episode: 295/300, Reward: -13.000, Step: 13
337
- 2022-11-28 14:45:24 - r - INFO: - Episode: 296/300, Reward: -24.000, Step: 24
338
- 2022-11-28 14:45:24 - r - INFO: - Episode: 297/300, Reward: -19.000, Step: 19
339
- 2022-11-28 14:45:24 - r - INFO: - Episode: 298/300, Reward: -14.000, Step: 14
340
- 2022-11-28 14:45:24 - r - INFO: - Episode: 299/300, Reward: -16.000, Step: 16
341
- 2022-11-28 14:45:24 - r - INFO: - Episode: 300/300, Reward: -17.000, Step: 17
342
- 2022-11-28 14:45:24 - r - INFO: - Finish training!
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
CliffWalking-v0/Train_CliffWalking-v0_QLearning_20221128-144520/results/learning_curve.png DELETED
Binary file (40.7 kB)
 
CliffWalking-v0/Train_CliffWalking-v0_QLearning_20221128-144520/results/res.csv DELETED
@@ -1,301 +0,0 @@
1
- episodes,rewards,steps
2
- 0,-397,100
3
- 1,-1090,100
4
- 2,-694,100
5
- 3,-397,100
6
- 4,-496,100
7
- 5,-298,100
8
- 6,-199,100
9
- 7,-298,100
10
- 8,-100,100
11
- 9,-199,100
12
- 10,-93,93
13
- 11,-100,100
14
- 12,-199,100
15
- 13,-199,100
16
- 14,-100,100
17
- 15,-100,100
18
- 16,-33,33
19
- 17,-100,100
20
- 18,-66,66
21
- 19,-99,99
22
- 20,-100,100
23
- 21,-100,100
24
- 22,-100,100
25
- 23,-54,54
26
- 24,-100,100
27
- 25,-73,73
28
- 26,-100,100
29
- 27,-90,90
30
- 28,-87,87
31
- 29,-100,100
32
- 30,-46,46
33
- 31,-82,82
34
- 32,-100,100
35
- 33,-100,100
36
- 34,-67,67
37
- 35,-75,75
38
- 36,-100,100
39
- 37,-45,45
40
- 38,-100,100
41
- 39,-37,37
42
- 40,-100,100
43
- 41,-43,43
44
- 42,-100,100
45
- 43,-56,56
46
- 44,-70,70
47
- 45,-100,100
48
- 46,-47,47
49
- 47,-85,85
50
- 48,-82,82
51
- 49,-51,51
52
- 50,-50,50
53
- 51,-86,86
54
- 52,-100,100
55
- 53,-40,40
56
- 54,-87,87
57
- 55,-59,59
58
- 56,-51,51
59
- 57,-98,98
60
- 58,-67,67
61
- 59,-60,60
62
- 60,-38,38
63
- 61,-76,76
64
- 62,-70,70
65
- 63,-60,60
66
- 64,-68,68
67
- 65,-25,25
68
- 66,-69,69
69
- 67,-183,84
70
- 68,-62,62
71
- 69,-44,44
72
- 70,-71,71
73
- 71,-55,55
74
- 72,-65,65
75
- 73,-61,61
76
- 74,-36,36
77
- 75,-47,47
78
- 76,-63,63
79
- 77,-45,45
80
- 78,-59,59
81
- 79,-39,39
82
- 80,-62,62
83
- 81,-38,38
84
- 82,-64,64
85
- 83,-40,40
86
- 84,-59,59
87
- 85,-48,48
88
- 86,-39,39
89
- 87,-70,70
90
- 88,-34,34
91
- 89,-40,40
92
- 90,-27,27
93
- 91,-65,65
94
- 92,-79,79
95
- 93,-30,30
96
- 94,-38,38
97
- 95,-23,23
98
- 96,-60,60
99
- 97,-41,41
100
- 98,-39,39
101
- 99,-42,42
102
- 100,-41,41
103
- 101,-59,59
104
- 102,-31,31
105
- 103,-43,43
106
- 104,-70,70
107
- 105,-29,29
108
- 106,-161,62
109
- 107,-38,38
110
- 108,-45,45
111
- 109,-29,29
112
- 110,-47,47
113
- 111,-23,23
114
- 112,-62,62
115
- 113,-34,34
116
- 114,-46,46
117
- 115,-29,29
118
- 116,-46,46
119
- 117,-30,30
120
- 118,-24,24
121
- 119,-30,30
122
- 120,-42,42
123
- 121,-62,62
124
- 122,-30,30
125
- 123,-31,31
126
- 124,-37,37
127
- 125,-51,51
128
- 126,-32,32
129
- 127,-22,22
130
- 128,-34,34
131
- 129,-22,22
132
- 130,-53,53
133
- 131,-28,28
134
- 132,-33,33
135
- 133,-39,39
136
- 134,-39,39
137
- 135,-20,20
138
- 136,-30,30
139
- 137,-42,42
140
- 138,-154,55
141
- 139,-34,34
142
- 140,-29,29
143
- 141,-21,21
144
- 142,-38,38
145
- 143,-21,21
146
- 144,-46,46
147
- 145,-19,19
148
- 146,-37,37
149
- 147,-27,27
150
- 148,-39,39
151
- 149,-18,18
152
- 150,-34,34
153
- 151,-25,25
154
- 152,-32,32
155
- 153,-40,40
156
- 154,-30,30
157
- 155,-36,36
158
- 156,-29,29
159
- 157,-30,30
160
- 158,-29,29
161
- 159,-22,22
162
- 160,-18,18
163
- 161,-46,46
164
- 162,-27,27
165
- 163,-22,22
166
- 164,-34,34
167
- 165,-15,15
168
- 166,-24,24
169
- 167,-45,45
170
- 168,-36,36
171
- 169,-20,20
172
- 170,-26,26
173
- 171,-29,29
174
- 172,-32,32
175
- 173,-17,17
176
- 174,-31,31
177
- 175,-15,15
178
- 176,-31,31
179
- 177,-29,29
180
- 178,-29,29
181
- 179,-21,21
182
- 180,-31,31
183
- 181,-21,21
184
- 182,-39,39
185
- 183,-30,30
186
- 184,-13,13
187
- 185,-30,30
188
- 186,-27,27
189
- 187,-18,18
190
- 188,-17,17
191
- 189,-24,24
192
- 190,-28,28
193
- 191,-36,36
194
- 192,-15,15
195
- 193,-40,40
196
- 194,-20,20
197
- 195,-23,23
198
- 196,-17,17
199
- 197,-28,28
200
- 198,-15,15
201
- 199,-27,27
202
- 200,-14,14
203
- 201,-31,31
204
- 202,-25,25
205
- 203,-19,19
206
- 204,-36,36
207
- 205,-29,29
208
- 206,-20,20
209
- 207,-23,23
210
- 208,-14,14
211
- 209,-28,28
212
- 210,-19,19
213
- 211,-26,26
214
- 212,-18,18
215
- 213,-26,26
216
- 214,-19,19
217
- 215,-23,23
218
- 216,-20,20
219
- 217,-48,48
220
- 218,-13,13
221
- 219,-133,34
222
- 220,-17,17
223
- 221,-20,20
224
- 222,-18,18
225
- 223,-35,35
226
- 224,-17,17
227
- 225,-13,13
228
- 226,-16,16
229
- 227,-25,25
230
- 228,-25,25
231
- 229,-26,26
232
- 230,-19,19
233
- 231,-17,17
234
- 232,-27,27
235
- 233,-30,30
236
- 234,-17,17
237
- 235,-18,18
238
- 236,-122,23
239
- 237,-25,25
240
- 238,-20,20
241
- 239,-13,13
242
- 240,-39,39
243
- 241,-17,17
244
- 242,-14,14
245
- 243,-15,15
246
- 244,-22,22
247
- 245,-31,31
248
- 246,-20,20
249
- 247,-28,28
250
- 248,-15,15
251
- 249,-19,19
252
- 250,-15,15
253
- 251,-13,13
254
- 252,-21,21
255
- 253,-16,16
256
- 254,-22,22
257
- 255,-18,18
258
- 256,-23,23
259
- 257,-16,16
260
- 258,-22,22
261
- 259,-13,13
262
- 260,-13,13
263
- 261,-19,19
264
- 262,-17,17
265
- 263,-32,32
266
- 264,-16,16
267
- 265,-15,15
268
- 266,-17,17
269
- 267,-13,13
270
- 268,-15,15
271
- 269,-28,28
272
- 270,-15,15
273
- 271,-13,13
274
- 272,-16,16
275
- 273,-128,29
276
- 274,-32,32
277
- 275,-24,24
278
- 276,-26,26
279
- 277,-14,14
280
- 278,-25,25
281
- 279,-22,22
282
- 280,-13,13
283
- 281,-15,15
284
- 282,-15,15
285
- 283,-13,13
286
- 284,-13,13
287
- 285,-16,16
288
- 286,-21,21
289
- 287,-19,19
290
- 288,-26,26
291
- 289,-16,16
292
- 290,-13,13
293
- 291,-13,13
294
- 292,-13,13
295
- 293,-15,15
296
- 294,-13,13
297
- 295,-24,24
298
- 296,-19,19
299
- 297,-14,14
300
- 298,-16,16
301
- 299,-17,17
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_DynaQ_20221210-095944/config.yaml RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_DynaQ_20221210-095944/logs/log.txt RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_DynaQ_20221210-095944/modelsDynaQ_model.pkl RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_DynaQ_20221210-095944/results/learning_curve.png RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_DynaQ_20221210-095944/results/res.csv RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_Sarsa_20230311-001530/config.yaml RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_Sarsa_20230311-001530/logs/log.txt RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_Sarsa_20230311-001530/models/checkpoint.pkl RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_Sarsa_20230311-001530/results/learning_curve.png RENAMED
File without changes
{CliffWalking-v0/Test_CliffWalking-v0_QLearning_20221128-150537 β†’ ToyText/CliffWalking-v0/Test_CliffWalking-v0_Sarsa_20230311-001530}/results/res.csv RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Test_CliffWalking-v0_Sarsa_20230311-001530/tb_logs/events.out.tfevents.1678464930.DESKTOP-H34HQIQ.51560.0 RENAMED
File without changes
{CliffWalking-v0/Test_CliffWalking-v0_QLearning_20221128-150537 β†’ ToyText/CliffWalking-v0/Test_single_CliffWalking-v0_QLearning_20230519-005951}/config.yaml RENAMED
@@ -1,24 +1,32 @@
1
  general_cfg:
2
  algo_name: QLearning
 
3
  device: cpu
4
- env_name: CliffWalking-v0
5
- eval_eps: 10
6
- eval_per_episode: 5
7
  load_checkpoint: true
8
- load_path: Train_CliffWalking-v0_QLearning_20221128-144520
9
- max_steps: 100
 
 
10
  mode: test
11
- new_step_api: true
12
- render: true
13
- save_fig: true
 
 
 
14
  seed: 1
15
- show_fig: false
16
- test_eps: 10
17
- train_eps: 300
18
- wrapper: envs.wrappers.CliffWalkingWapper
19
  algo_cfg:
20
  epsilon_decay: 300
21
  epsilon_end: 0.01
22
  epsilon_start: 0.95
23
  gamma: 0.99
24
  lr: 0.1
 
 
 
 
 
 
 
 
1
  general_cfg:
2
  algo_name: QLearning
3
+ collect_traj: false
4
  device: cpu
5
+ env_name: gym
 
 
6
  load_checkpoint: true
7
+ load_model_step: 12000
8
+ load_path: Train_single_CliffWalking-v0_QLearning_20230519-005837
9
+ max_episode: 10
10
+ max_step: 100
11
  mode: test
12
+ model_save_fre: 500
13
+ mp_backend: single
14
+ n_learners: 1
15
+ n_workers: 1
16
+ online_eval: false
17
+ online_eval_episode: 10
18
  seed: 1
19
+ share_buffer: true
 
 
 
20
  algo_cfg:
21
  epsilon_decay: 300
22
  epsilon_end: 0.01
23
  epsilon_start: 0.95
24
  gamma: 0.99
25
  lr: 0.1
26
+ env_cfg:
27
+ id: CliffWalking-v0
28
+ ignore_params:
29
+ - wrapper
30
+ - ignore_params
31
+ render_mode: null
32
+ wrapper: null
ToyText/CliffWalking-v0/Test_single_CliffWalking-v0_QLearning_20230519-005951/logs/log.txt ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - General Configs:
2
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - ================================================================================
3
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - Name Value Type
4
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - env_name gym <class 'str'>
5
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - algo_name QLearning <class 'str'>
6
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - mode test <class 'str'>
7
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - device cpu <class 'str'>
8
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - seed 1 <class 'int'>
9
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - max_episode 10 <class 'int'>
10
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - max_step 100 <class 'int'>
11
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - collect_traj 0 <class 'bool'>
12
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - mp_backend single <class 'str'>
13
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - n_workers 1 <class 'int'>
14
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - n_learners 1 <class 'int'>
15
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - share_buffer 1 <class 'bool'>
16
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - online_eval 0 <class 'bool'>
17
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - online_eval_episode 10 <class 'int'>
18
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - model_save_fre 500 <class 'int'>
19
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - load_checkpoint 1 <class 'bool'>
20
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - load_path Train_single_CliffWalking-v0_QLearning_20230519-005837 <class 'str'>
21
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - load_model_step 12000 <class 'int'>
22
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - ================================================================================
23
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - Algo Configs:
24
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - ================================================================================
25
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - Name Value Type
26
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - epsilon_start 0.95 <class 'float'>
27
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - epsilon_end 0.01 <class 'float'>
28
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - epsilon_decay 300 <class 'int'>
29
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - gamma 0.99 <class 'float'>
30
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - lr 0.1 <class 'float'>
31
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - ================================================================================
32
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - Env Configs:
33
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - ================================================================================
34
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - Name Value Type
35
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - id CliffWalking-v0 <class 'str'>
36
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - render_mode None <class 'str'>
37
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - wrapper None <class 'str'>
38
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - ignore_params ['wrapper', 'ignore_params'] <class 'str'>
39
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - ================================================================================
40
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - obs_space: Discrete(48), n_actions: Discrete(4)
41
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - Start testing!
42
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - episode: 0, ep_reward: -13, ep_step: 13
43
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - episode: 1, ep_reward: -13, ep_step: 13
44
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - episode: 2, ep_reward: -13, ep_step: 13
45
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - episode: 3, ep_reward: -13, ep_step: 13
46
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - episode: 4, ep_reward: -13, ep_step: 13
47
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - episode: 5, ep_reward: -13, ep_step: 13
48
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - episode: 6, ep_reward: -13, ep_step: 13
49
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - episode: 7, ep_reward: -13, ep_step: 13
50
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - episode: 8, ep_reward: -13, ep_step: 13
51
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - episode: 9, ep_reward: -13, ep_step: 13
52
+ 2023-05-19 00:59:51 - SimpleLog - INFO: - Finish testing! total time consumed: 0.02s
CliffWalking-v0/Train_CliffWalking-v0_QLearning_20221128-144520/models/Qleaning_model.pkl β†’ ToyText/CliffWalking-v0/Test_single_CliffWalking-v0_QLearning_20230519-005951/tb_logs/interact/events.out.tfevents.1684429191.DESKTOP-H34HQIQ.94200.0 RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0a5088e21ba086ef3631d0381b7b57ec20f56261d403a159a6c8d0cae3d6ec63
3
- size 5999
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:715f68373647ab2fa023781cd81d1c6abed325f8f63359a5572827a8794835cc
3
+ size 750
CliffWalking-v0/Test_CliffWalking-v0_QLearning_20221128-150537/models/Qleaning_model.pkl β†’ ToyText/CliffWalking-v0/Test_single_CliffWalking-v0_QLearning_20230519-005951/tb_logs/model/events.out.tfevents.1684429191.DESKTOP-H34HQIQ.94200.1 RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0a5088e21ba086ef3631d0381b7b57ec20f56261d403a159a6c8d0cae3d6ec63
3
- size 5999
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48523c05279b11aaebb4f245670d2d649b949be219aa05dfcc99c7bc3048c9b2
3
+ size 40
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_DynaQ_20221210-095808/config.yaml RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_DynaQ_20221210-095808/logs/log.txt RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_DynaQ_20221210-095808/modelsDynaQ_model.pkl RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_DynaQ_20221210-095808/results/learning_curve.png RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_DynaQ_20221210-095808/results/res.csv RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_Sarsa_20230311-001504/config.yaml RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_Sarsa_20230311-001504/logs/log.txt RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_Sarsa_20230311-001504/models/checkpoint.pkl RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_Sarsa_20230311-001504/results/learning_curve.png RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_Sarsa_20230311-001504/results/res.csv RENAMED
File without changes
{CliffWalking-v0 β†’ ToyText/CliffWalking-v0}/Train_CliffWalking-v0_Sarsa_20230311-001504/tb_logs/events.out.tfevents.1678464904.DESKTOP-H34HQIQ.27128.0 RENAMED
File without changes
{CliffWalking-v0/Train_CliffWalking-v0_QLearning_20221128-144520 β†’ ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837}/config.yaml RENAMED
@@ -1,23 +1,32 @@
1
  general_cfg:
2
  algo_name: QLearning
 
3
  device: cpu
4
- env_name: CliffWalking-v0
5
- eval_eps: 10
6
- eval_per_episode: 5
7
  load_checkpoint: false
8
- load_path: Train_CartPole-v1_DQN_20221026-054757
9
- max_steps: 100
 
 
10
  mode: train
11
- new_step_api: true
12
- save_fig: true
 
 
 
 
13
  seed: 1
14
- show_fig: false
15
- test_eps: 10
16
- train_eps: 300
17
- wrapper: envs.wrappers.CliffWalkingWapper
18
  algo_cfg:
19
  epsilon_decay: 300
20
  epsilon_end: 0.01
21
  epsilon_start: 0.95
22
  gamma: 0.99
23
  lr: 0.1
 
 
 
 
 
 
 
 
1
  general_cfg:
2
  algo_name: QLearning
3
+ collect_traj: false
4
  device: cpu
5
+ env_name: gym
 
 
6
  load_checkpoint: false
7
+ load_model_step: best
8
+ load_path: Train_single_CartPole-v1_DQN_20230515-211721
9
+ max_episode: 300
10
+ max_step: 100
11
  mode: train
12
+ model_save_fre: 500
13
+ mp_backend: single
14
+ n_learners: 1
15
+ n_workers: 1
16
+ online_eval: false
17
+ online_eval_episode: 10
18
  seed: 1
19
+ share_buffer: true
 
 
 
20
  algo_cfg:
21
  epsilon_decay: 300
22
  epsilon_end: 0.01
23
  epsilon_start: 0.95
24
  gamma: 0.99
25
  lr: 0.1
26
+ env_cfg:
27
+ id: CliffWalking-v0
28
+ ignore_params:
29
+ - wrapper
30
+ - ignore_params
31
+ render_mode: null
32
+ wrapper: null
ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/logs/log.txt ADDED
@@ -0,0 +1,342 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - General Configs:
2
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - ================================================================================
3
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - Name Value Type
4
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - env_name gym <class 'str'>
5
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - algo_name QLearning <class 'str'>
6
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - mode train <class 'str'>
7
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - device cpu <class 'str'>
8
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - seed 1 <class 'int'>
9
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - max_episode 300 <class 'int'>
10
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - max_step 100 <class 'int'>
11
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - collect_traj 0 <class 'bool'>
12
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - mp_backend single <class 'str'>
13
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - n_workers 1 <class 'int'>
14
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - n_learners 1 <class 'int'>
15
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - share_buffer 1 <class 'bool'>
16
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - online_eval 0 <class 'bool'>
17
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - online_eval_episode 10 <class 'int'>
18
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - model_save_fre 500 <class 'int'>
19
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - load_checkpoint 0 <class 'bool'>
20
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - load_path Train_single_CartPole-v1_DQN_20230515-211721 <class 'str'>
21
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - load_model_step best <class 'str'>
22
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - ================================================================================
23
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - Algo Configs:
24
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - ================================================================================
25
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - Name Value Type
26
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - epsilon_start 0.95 <class 'float'>
27
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - epsilon_end 0.01 <class 'float'>
28
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - epsilon_decay 300 <class 'int'>
29
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - gamma 0.99 <class 'float'>
30
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - lr 0.1 <class 'float'>
31
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - ================================================================================
32
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - Env Configs:
33
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - ================================================================================
34
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - Name Value Type
35
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - id CliffWalking-v0 <class 'str'>
36
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - render_mode None <class 'str'>
37
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - wrapper None <class 'str'>
38
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - ignore_params ['wrapper', 'ignore_params'] <class 'str'>
39
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - ================================================================================
40
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - obs_space: Discrete(48), n_actions: Discrete(4)
41
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - Start training!
42
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 0, ep_reward: -397, ep_step: 100
43
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 1, ep_reward: -1090, ep_step: 100
44
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 2, ep_reward: -694, ep_step: 100
45
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 3, ep_reward: -397, ep_step: 100
46
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 4, ep_reward: -496, ep_step: 100
47
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 5, ep_reward: -298, ep_step: 100
48
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 6, ep_reward: -199, ep_step: 100
49
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 7, ep_reward: -298, ep_step: 100
50
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 8, ep_reward: -100, ep_step: 100
51
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 9, ep_reward: -199, ep_step: 100
52
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 10, ep_reward: -93, ep_step: 93
53
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 11, ep_reward: -100, ep_step: 100
54
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 12, ep_reward: -199, ep_step: 100
55
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 13, ep_reward: -199, ep_step: 100
56
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 14, ep_reward: -100, ep_step: 100
57
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 15, ep_reward: -100, ep_step: 100
58
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 16, ep_reward: -33, ep_step: 33
59
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 17, ep_reward: -100, ep_step: 100
60
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 18, ep_reward: -66, ep_step: 66
61
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 19, ep_reward: -99, ep_step: 99
62
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 20, ep_reward: -100, ep_step: 100
63
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 21, ep_reward: -100, ep_step: 100
64
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 22, ep_reward: -100, ep_step: 100
65
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 23, ep_reward: -54, ep_step: 54
66
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 24, ep_reward: -100, ep_step: 100
67
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 25, ep_reward: -73, ep_step: 73
68
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 26, ep_reward: -100, ep_step: 100
69
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 27, ep_reward: -90, ep_step: 90
70
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 28, ep_reward: -87, ep_step: 87
71
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 29, ep_reward: -100, ep_step: 100
72
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 30, ep_reward: -46, ep_step: 46
73
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 31, ep_reward: -82, ep_step: 82
74
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 32, ep_reward: -100, ep_step: 100
75
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 33, ep_reward: -100, ep_step: 100
76
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 34, ep_reward: -67, ep_step: 67
77
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 35, ep_reward: -75, ep_step: 75
78
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 36, ep_reward: -100, ep_step: 100
79
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 37, ep_reward: -45, ep_step: 45
80
+ 2023-05-19 00:58:37 - SimpleLog - INFO: - episode: 38, ep_reward: -100, ep_step: 100
81
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 39, ep_reward: -37, ep_step: 37
82
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 40, ep_reward: -100, ep_step: 100
83
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 41, ep_reward: -43, ep_step: 43
84
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 42, ep_reward: -100, ep_step: 100
85
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 43, ep_reward: -56, ep_step: 56
86
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 44, ep_reward: -70, ep_step: 70
87
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 45, ep_reward: -100, ep_step: 100
88
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 46, ep_reward: -47, ep_step: 47
89
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 47, ep_reward: -85, ep_step: 85
90
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 48, ep_reward: -82, ep_step: 82
91
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 49, ep_reward: -51, ep_step: 51
92
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 50, ep_reward: -50, ep_step: 50
93
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 51, ep_reward: -86, ep_step: 86
94
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 52, ep_reward: -100, ep_step: 100
95
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 53, ep_reward: -40, ep_step: 40
96
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 54, ep_reward: -87, ep_step: 87
97
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 55, ep_reward: -59, ep_step: 59
98
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 56, ep_reward: -51, ep_step: 51
99
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 57, ep_reward: -98, ep_step: 98
100
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 58, ep_reward: -67, ep_step: 67
101
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 59, ep_reward: -60, ep_step: 60
102
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 60, ep_reward: -38, ep_step: 38
103
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 61, ep_reward: -76, ep_step: 76
104
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 62, ep_reward: -70, ep_step: 70
105
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 63, ep_reward: -60, ep_step: 60
106
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 64, ep_reward: -68, ep_step: 68
107
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 65, ep_reward: -25, ep_step: 25
108
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 66, ep_reward: -69, ep_step: 69
109
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 67, ep_reward: -183, ep_step: 84
110
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 68, ep_reward: -62, ep_step: 62
111
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 69, ep_reward: -44, ep_step: 44
112
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 70, ep_reward: -71, ep_step: 71
113
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 71, ep_reward: -55, ep_step: 55
114
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 72, ep_reward: -65, ep_step: 65
115
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 73, ep_reward: -61, ep_step: 61
116
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 74, ep_reward: -36, ep_step: 36
117
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 75, ep_reward: -47, ep_step: 47
118
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 76, ep_reward: -63, ep_step: 63
119
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 77, ep_reward: -45, ep_step: 45
120
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 78, ep_reward: -59, ep_step: 59
121
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 79, ep_reward: -39, ep_step: 39
122
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 80, ep_reward: -62, ep_step: 62
123
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 81, ep_reward: -38, ep_step: 38
124
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 82, ep_reward: -64, ep_step: 64
125
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 83, ep_reward: -40, ep_step: 40
126
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 84, ep_reward: -59, ep_step: 59
127
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 85, ep_reward: -48, ep_step: 48
128
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 86, ep_reward: -39, ep_step: 39
129
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 87, ep_reward: -70, ep_step: 70
130
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 88, ep_reward: -34, ep_step: 34
131
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 89, ep_reward: -40, ep_step: 40
132
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 90, ep_reward: -27, ep_step: 27
133
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 91, ep_reward: -65, ep_step: 65
134
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 92, ep_reward: -79, ep_step: 79
135
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 93, ep_reward: -30, ep_step: 30
136
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 94, ep_reward: -38, ep_step: 38
137
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 95, ep_reward: -23, ep_step: 23
138
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 96, ep_reward: -60, ep_step: 60
139
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 97, ep_reward: -41, ep_step: 41
140
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 98, ep_reward: -39, ep_step: 39
141
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 99, ep_reward: -42, ep_step: 42
142
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 100, ep_reward: -41, ep_step: 41
143
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 101, ep_reward: -59, ep_step: 59
144
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 102, ep_reward: -31, ep_step: 31
145
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 103, ep_reward: -43, ep_step: 43
146
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 104, ep_reward: -70, ep_step: 70
147
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 105, ep_reward: -29, ep_step: 29
148
+ 2023-05-19 00:58:38 - SimpleLog - INFO: - episode: 106, ep_reward: -161, ep_step: 62
149
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 107, ep_reward: -38, ep_step: 38
150
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 108, ep_reward: -45, ep_step: 45
151
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 109, ep_reward: -29, ep_step: 29
152
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 110, ep_reward: -47, ep_step: 47
153
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 111, ep_reward: -23, ep_step: 23
154
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 112, ep_reward: -62, ep_step: 62
155
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 113, ep_reward: -34, ep_step: 34
156
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 114, ep_reward: -46, ep_step: 46
157
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 115, ep_reward: -29, ep_step: 29
158
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 116, ep_reward: -46, ep_step: 46
159
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 117, ep_reward: -30, ep_step: 30
160
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 118, ep_reward: -24, ep_step: 24
161
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 119, ep_reward: -30, ep_step: 30
162
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 120, ep_reward: -42, ep_step: 42
163
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 121, ep_reward: -62, ep_step: 62
164
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 122, ep_reward: -30, ep_step: 30
165
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 123, ep_reward: -31, ep_step: 31
166
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 124, ep_reward: -37, ep_step: 37
167
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 125, ep_reward: -51, ep_step: 51
168
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 126, ep_reward: -32, ep_step: 32
169
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 127, ep_reward: -22, ep_step: 22
170
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 128, ep_reward: -34, ep_step: 34
171
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 129, ep_reward: -22, ep_step: 22
172
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 130, ep_reward: -53, ep_step: 53
173
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 131, ep_reward: -28, ep_step: 28
174
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 132, ep_reward: -33, ep_step: 33
175
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 133, ep_reward: -39, ep_step: 39
176
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 134, ep_reward: -39, ep_step: 39
177
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 135, ep_reward: -20, ep_step: 20
178
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 136, ep_reward: -30, ep_step: 30
179
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 137, ep_reward: -42, ep_step: 42
180
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 138, ep_reward: -154, ep_step: 55
181
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 139, ep_reward: -34, ep_step: 34
182
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 140, ep_reward: -29, ep_step: 29
183
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 141, ep_reward: -21, ep_step: 21
184
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 142, ep_reward: -38, ep_step: 38
185
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 143, ep_reward: -21, ep_step: 21
186
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 144, ep_reward: -46, ep_step: 46
187
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 145, ep_reward: -19, ep_step: 19
188
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 146, ep_reward: -37, ep_step: 37
189
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 147, ep_reward: -27, ep_step: 27
190
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 148, ep_reward: -39, ep_step: 39
191
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 149, ep_reward: -18, ep_step: 18
192
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 150, ep_reward: -34, ep_step: 34
193
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 151, ep_reward: -25, ep_step: 25
194
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 152, ep_reward: -32, ep_step: 32
195
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 153, ep_reward: -40, ep_step: 40
196
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 154, ep_reward: -30, ep_step: 30
197
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 155, ep_reward: -36, ep_step: 36
198
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 156, ep_reward: -29, ep_step: 29
199
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 157, ep_reward: -30, ep_step: 30
200
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 158, ep_reward: -29, ep_step: 29
201
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 159, ep_reward: -22, ep_step: 22
202
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 160, ep_reward: -18, ep_step: 18
203
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 161, ep_reward: -46, ep_step: 46
204
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 162, ep_reward: -27, ep_step: 27
205
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 163, ep_reward: -22, ep_step: 22
206
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 164, ep_reward: -34, ep_step: 34
207
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 165, ep_reward: -15, ep_step: 15
208
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 166, ep_reward: -24, ep_step: 24
209
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 167, ep_reward: -45, ep_step: 45
210
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 168, ep_reward: -36, ep_step: 36
211
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 169, ep_reward: -20, ep_step: 20
212
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 170, ep_reward: -26, ep_step: 26
213
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 171, ep_reward: -29, ep_step: 29
214
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 172, ep_reward: -32, ep_step: 32
215
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 173, ep_reward: -17, ep_step: 17
216
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 174, ep_reward: -31, ep_step: 31
217
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 175, ep_reward: -15, ep_step: 15
218
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 176, ep_reward: -31, ep_step: 31
219
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 177, ep_reward: -29, ep_step: 29
220
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 178, ep_reward: -29, ep_step: 29
221
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 179, ep_reward: -21, ep_step: 21
222
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 180, ep_reward: -31, ep_step: 31
223
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 181, ep_reward: -21, ep_step: 21
224
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 182, ep_reward: -39, ep_step: 39
225
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 183, ep_reward: -30, ep_step: 30
226
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 184, ep_reward: -13, ep_step: 13
227
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 185, ep_reward: -30, ep_step: 30
228
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 186, ep_reward: -27, ep_step: 27
229
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 187, ep_reward: -18, ep_step: 18
230
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 188, ep_reward: -17, ep_step: 17
231
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 189, ep_reward: -24, ep_step: 24
232
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 190, ep_reward: -28, ep_step: 28
233
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 191, ep_reward: -36, ep_step: 36
234
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 192, ep_reward: -15, ep_step: 15
235
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 193, ep_reward: -40, ep_step: 40
236
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 194, ep_reward: -20, ep_step: 20
237
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 195, ep_reward: -23, ep_step: 23
238
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 196, ep_reward: -17, ep_step: 17
239
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 197, ep_reward: -28, ep_step: 28
240
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 198, ep_reward: -15, ep_step: 15
241
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 199, ep_reward: -27, ep_step: 27
242
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 200, ep_reward: -14, ep_step: 14
243
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 201, ep_reward: -31, ep_step: 31
244
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 202, ep_reward: -25, ep_step: 25
245
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 203, ep_reward: -19, ep_step: 19
246
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 204, ep_reward: -36, ep_step: 36
247
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 205, ep_reward: -29, ep_step: 29
248
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 206, ep_reward: -20, ep_step: 20
249
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 207, ep_reward: -23, ep_step: 23
250
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 208, ep_reward: -14, ep_step: 14
251
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 209, ep_reward: -28, ep_step: 28
252
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 210, ep_reward: -19, ep_step: 19
253
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 211, ep_reward: -26, ep_step: 26
254
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 212, ep_reward: -18, ep_step: 18
255
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 213, ep_reward: -26, ep_step: 26
256
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 214, ep_reward: -19, ep_step: 19
257
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 215, ep_reward: -23, ep_step: 23
258
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 216, ep_reward: -20, ep_step: 20
259
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 217, ep_reward: -48, ep_step: 48
260
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 218, ep_reward: -13, ep_step: 13
261
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 219, ep_reward: -133, ep_step: 34
262
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 220, ep_reward: -17, ep_step: 17
263
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 221, ep_reward: -20, ep_step: 20
264
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 222, ep_reward: -18, ep_step: 18
265
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 223, ep_reward: -35, ep_step: 35
266
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 224, ep_reward: -17, ep_step: 17
267
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 225, ep_reward: -13, ep_step: 13
268
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 226, ep_reward: -16, ep_step: 16
269
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 227, ep_reward: -25, ep_step: 25
270
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 228, ep_reward: -25, ep_step: 25
271
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 229, ep_reward: -26, ep_step: 26
272
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 230, ep_reward: -19, ep_step: 19
273
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 231, ep_reward: -17, ep_step: 17
274
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 232, ep_reward: -27, ep_step: 27
275
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 233, ep_reward: -30, ep_step: 30
276
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 234, ep_reward: -17, ep_step: 17
277
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 235, ep_reward: -18, ep_step: 18
278
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 236, ep_reward: -122, ep_step: 23
279
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 237, ep_reward: -25, ep_step: 25
280
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 238, ep_reward: -20, ep_step: 20
281
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 239, ep_reward: -13, ep_step: 13
282
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 240, ep_reward: -39, ep_step: 39
283
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 241, ep_reward: -17, ep_step: 17
284
+ 2023-05-19 00:58:39 - SimpleLog - INFO: - episode: 242, ep_reward: -14, ep_step: 14
285
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 243, ep_reward: -15, ep_step: 15
286
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 244, ep_reward: -22, ep_step: 22
287
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 245, ep_reward: -31, ep_step: 31
288
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 246, ep_reward: -20, ep_step: 20
289
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 247, ep_reward: -28, ep_step: 28
290
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 248, ep_reward: -15, ep_step: 15
291
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 249, ep_reward: -19, ep_step: 19
292
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 250, ep_reward: -15, ep_step: 15
293
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 251, ep_reward: -13, ep_step: 13
294
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 252, ep_reward: -21, ep_step: 21
295
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 253, ep_reward: -16, ep_step: 16
296
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 254, ep_reward: -22, ep_step: 22
297
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 255, ep_reward: -18, ep_step: 18
298
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 256, ep_reward: -23, ep_step: 23
299
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 257, ep_reward: -16, ep_step: 16
300
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 258, ep_reward: -22, ep_step: 22
301
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 259, ep_reward: -13, ep_step: 13
302
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 260, ep_reward: -13, ep_step: 13
303
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 261, ep_reward: -19, ep_step: 19
304
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 262, ep_reward: -17, ep_step: 17
305
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 263, ep_reward: -32, ep_step: 32
306
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 264, ep_reward: -16, ep_step: 16
307
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 265, ep_reward: -15, ep_step: 15
308
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 266, ep_reward: -17, ep_step: 17
309
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 267, ep_reward: -13, ep_step: 13
310
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 268, ep_reward: -15, ep_step: 15
311
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 269, ep_reward: -28, ep_step: 28
312
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 270, ep_reward: -15, ep_step: 15
313
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 271, ep_reward: -13, ep_step: 13
314
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 272, ep_reward: -16, ep_step: 16
315
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 273, ep_reward: -128, ep_step: 29
316
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 274, ep_reward: -32, ep_step: 32
317
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 275, ep_reward: -24, ep_step: 24
318
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 276, ep_reward: -26, ep_step: 26
319
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 277, ep_reward: -14, ep_step: 14
320
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 278, ep_reward: -25, ep_step: 25
321
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 279, ep_reward: -22, ep_step: 22
322
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 280, ep_reward: -13, ep_step: 13
323
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 281, ep_reward: -15, ep_step: 15
324
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 282, ep_reward: -15, ep_step: 15
325
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 283, ep_reward: -13, ep_step: 13
326
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 284, ep_reward: -13, ep_step: 13
327
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 285, ep_reward: -16, ep_step: 16
328
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 286, ep_reward: -21, ep_step: 21
329
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 287, ep_reward: -19, ep_step: 19
330
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 288, ep_reward: -26, ep_step: 26
331
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 289, ep_reward: -16, ep_step: 16
332
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 290, ep_reward: -13, ep_step: 13
333
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 291, ep_reward: -13, ep_step: 13
334
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 292, ep_reward: -13, ep_step: 13
335
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 293, ep_reward: -15, ep_step: 15
336
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 294, ep_reward: -13, ep_step: 13
337
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 295, ep_reward: -24, ep_step: 24
338
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 296, ep_reward: -19, ep_step: 19
339
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 297, ep_reward: -14, ep_step: 14
340
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 298, ep_reward: -16, ep_step: 16
341
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - episode: 299, ep_reward: -17, ep_step: 17
342
+ 2023-05-19 00:58:40 - SimpleLog - INFO: - Finish training! total time consumed: 3.10s
ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/1000 ADDED
Binary file (2.52 kB). View file
 
ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/10000 ADDED
Binary file (2.59 kB). View file
 
ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/10500 ADDED
Binary file (2.59 kB). View file
 
ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/11000 ADDED
Binary file (2.59 kB). View file
 
ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/11500 ADDED
Binary file (2.59 kB). View file
 
ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/12000 ADDED
Binary file (2.59 kB). View file
 
ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/1500 ADDED
Binary file (2.59 kB). View file
 
ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/2000 ADDED
Binary file (2.59 kB). View file
 
ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/2500 ADDED
Binary file (2.59 kB). View file
 
ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/3000 ADDED
Binary file (2.59 kB). View file
 
ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/3500 ADDED
Binary file (2.59 kB). View file
 
ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/4000 ADDED
Binary file (2.59 kB). View file
 
ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/4500 ADDED
Binary file (2.59 kB). View file
 
ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/500 ADDED
Binary file (2.46 kB). View file
 
ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/5000 ADDED
Binary file (2.59 kB). View file
 
ToyText/CliffWalking-v0/Train_single_CliffWalking-v0_QLearning_20230519-005837/models/5500 ADDED
Binary file (2.59 kB). View file