File size: 9,218 Bytes
62e03a2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
2022-11-22 12:54:03 - r - INFO: - n_states: 4, n_actions: 2
2022-11-22 12:54:06 - r - INFO: - Start training!
2022-11-22 12:54:06 - r - INFO: - Env: CartPole-v1, Algorithm: DuelingDQN, Device: cuda
2022-11-22 12:54:06 - r - INFO: - Episode: 1/100, Reward: 18.000, Step: 18
2022-11-22 12:54:06 - r - INFO: - Episode: 2/100, Reward: 35.000, Step: 35
2022-11-22 12:54:06 - r - INFO: - Episode: 3/100, Reward: 13.000, Step: 13
2022-11-22 12:54:06 - r - INFO: - Episode: 4/100, Reward: 32.000, Step: 32
2022-11-22 12:54:06 - r - INFO: - Episode: 5/100, Reward: 16.000, Step: 16
2022-11-22 12:54:06 - r - INFO: - Current episode 5 has the best eval reward: 9.100
2022-11-22 12:54:06 - r - INFO: - Episode: 6/100, Reward: 9.000, Step: 9
2022-11-22 12:54:06 - r - INFO: - Episode: 7/100, Reward: 12.000, Step: 12
2022-11-22 12:54:06 - r - INFO: - Episode: 8/100, Reward: 16.000, Step: 16
2022-11-22 12:54:06 - r - INFO: - Episode: 9/100, Reward: 14.000, Step: 14
2022-11-22 12:54:06 - r - INFO: - Episode: 10/100, Reward: 12.000, Step: 12
2022-11-22 12:54:06 - r - INFO: - Current episode 10 has the best eval reward: 9.200
2022-11-22 12:54:06 - r - INFO: - Episode: 11/100, Reward: 13.000, Step: 13
2022-11-22 12:54:06 - r - INFO: - Episode: 12/100, Reward: 14.000, Step: 14
2022-11-22 12:54:06 - r - INFO: - Episode: 13/100, Reward: 19.000, Step: 19
2022-11-22 12:54:06 - r - INFO: - Episode: 14/100, Reward: 9.000, Step: 9
2022-11-22 12:54:06 - r - INFO: - Episode: 15/100, Reward: 15.000, Step: 15
2022-11-22 12:54:06 - r - INFO: - Current episode 15 has the best eval reward: 9.300
2022-11-22 12:54:06 - r - INFO: - Episode: 16/100, Reward: 12.000, Step: 12
2022-11-22 12:54:06 - r - INFO: - Episode: 17/100, Reward: 11.000, Step: 11
2022-11-22 12:54:06 - r - INFO: - Episode: 18/100, Reward: 9.000, Step: 9
2022-11-22 12:54:07 - r - INFO: - Episode: 19/100, Reward: 13.000, Step: 13
2022-11-22 12:54:07 - r - INFO: - Episode: 20/100, Reward: 17.000, Step: 17
2022-11-22 12:54:07 - r - INFO: - Current episode 20 has the best eval reward: 9.900
2022-11-22 12:54:07 - r - INFO: - Episode: 21/100, Reward: 14.000, Step: 14
2022-11-22 12:54:07 - r - INFO: - Episode: 22/100, Reward: 20.000, Step: 20
2022-11-22 12:54:07 - r - INFO: - Episode: 23/100, Reward: 11.000, Step: 11
2022-11-22 12:54:07 - r - INFO: - Episode: 24/100, Reward: 24.000, Step: 24
2022-11-22 12:54:07 - r - INFO: - Episode: 25/100, Reward: 11.000, Step: 11
2022-11-22 12:54:07 - r - INFO: - Episode: 26/100, Reward: 11.000, Step: 11
2022-11-22 12:54:07 - r - INFO: - Episode: 27/100, Reward: 11.000, Step: 11
2022-11-22 12:54:07 - r - INFO: - Episode: 28/100, Reward: 13.000, Step: 13
2022-11-22 12:54:07 - r - INFO: - Episode: 29/100, Reward: 11.000, Step: 11
2022-11-22 12:54:07 - r - INFO: - Episode: 30/100, Reward: 8.000, Step: 8
2022-11-22 12:54:07 - r - INFO: - Episode: 31/100, Reward: 13.000, Step: 13
2022-11-22 12:54:07 - r - INFO: - Episode: 32/100, Reward: 9.000, Step: 9
2022-11-22 12:54:07 - r - INFO: - Episode: 33/100, Reward: 34.000, Step: 34
2022-11-22 12:54:07 - r - INFO: - Episode: 34/100, Reward: 10.000, Step: 10
2022-11-22 12:54:07 - r - INFO: - Episode: 35/100, Reward: 10.000, Step: 10
2022-11-22 12:54:07 - r - INFO: - Episode: 36/100, Reward: 10.000, Step: 10
2022-11-22 12:54:07 - r - INFO: - Episode: 37/100, Reward: 34.000, Step: 34
2022-11-22 12:54:07 - r - INFO: - Episode: 38/100, Reward: 35.000, Step: 35
2022-11-22 12:54:07 - r - INFO: - Episode: 39/100, Reward: 32.000, Step: 32
2022-11-22 12:54:08 - r - INFO: - Episode: 40/100, Reward: 37.000, Step: 37
2022-11-22 12:54:08 - r - INFO: - Current episode 40 has the best eval reward: 27.500
2022-11-22 12:54:08 - r - INFO: - Episode: 41/100, Reward: 29.000, Step: 29
2022-11-22 12:54:08 - r - INFO: - Episode: 42/100, Reward: 52.000, Step: 52
2022-11-22 12:54:08 - r - INFO: - Episode: 43/100, Reward: 54.000, Step: 54
2022-11-22 12:54:08 - r - INFO: - Episode: 44/100, Reward: 90.000, Step: 90
2022-11-22 12:54:08 - r - INFO: - Episode: 45/100, Reward: 91.000, Step: 91
2022-11-22 12:54:09 - r - INFO: - Current episode 45 has the best eval reward: 87.500
2022-11-22 12:54:09 - r - INFO: - Episode: 46/100, Reward: 51.000, Step: 51
2022-11-22 12:54:09 - r - INFO: - Episode: 47/100, Reward: 101.000, Step: 101
2022-11-22 12:54:09 - r - INFO: - Episode: 48/100, Reward: 67.000, Step: 67
2022-11-22 12:54:09 - r - INFO: - Episode: 49/100, Reward: 103.000, Step: 103
2022-11-22 12:54:10 - r - INFO: - Episode: 50/100, Reward: 45.000, Step: 45
2022-11-22 12:54:10 - r - INFO: - Episode: 51/100, Reward: 137.000, Step: 137
2022-11-22 12:54:10 - r - INFO: - Episode: 52/100, Reward: 47.000, Step: 47
2022-11-22 12:54:10 - r - INFO: - Episode: 53/100, Reward: 89.000, Step: 89
2022-11-22 12:54:11 - r - INFO: - Episode: 54/100, Reward: 95.000, Step: 95
2022-11-22 12:54:11 - r - INFO: - Episode: 55/100, Reward: 55.000, Step: 55
2022-11-22 12:54:11 - r - INFO: - Episode: 56/100, Reward: 92.000, Step: 92
2022-11-22 12:54:12 - r - INFO: - Episode: 57/100, Reward: 155.000, Step: 155
2022-11-22 12:54:12 - r - INFO: - Episode: 58/100, Reward: 125.000, Step: 125
2022-11-22 12:54:12 - r - INFO: - Episode: 59/100, Reward: 152.000, Step: 152
2022-11-22 12:54:13 - r - INFO: - Episode: 60/100, Reward: 199.000, Step: 199
2022-11-22 12:54:13 - r - INFO: - Current episode 60 has the best eval reward: 179.100
2022-11-22 12:54:14 - r - INFO: - Episode: 61/100, Reward: 88.000, Step: 88
2022-11-22 12:54:14 - r - INFO: - Episode: 62/100, Reward: 200.000, Step: 200
2022-11-22 12:54:14 - r - INFO: - Episode: 63/100, Reward: 176.000, Step: 176
2022-11-22 12:54:15 - r - INFO: - Episode: 64/100, Reward: 200.000, Step: 200
2022-11-22 12:54:15 - r - INFO: - Episode: 65/100, Reward: 200.000, Step: 200
2022-11-22 12:54:16 - r - INFO: - Current episode 65 has the best eval reward: 198.700
2022-11-22 12:54:16 - r - INFO: - Episode: 66/100, Reward: 193.000, Step: 193
2022-11-22 12:54:17 - r - INFO: - Episode: 67/100, Reward: 200.000, Step: 200
2022-11-22 12:54:17 - r - INFO: - Episode: 68/100, Reward: 200.000, Step: 200
2022-11-22 12:54:18 - r - INFO: - Episode: 69/100, Reward: 200.000, Step: 200
2022-11-22 12:54:18 - r - INFO: - Episode: 70/100, Reward: 200.000, Step: 200
2022-11-22 12:54:19 - r - INFO: - Current episode 70 has the best eval reward: 200.000
2022-11-22 12:54:20 - r - INFO: - Episode: 71/100, Reward: 200.000, Step: 200
2022-11-22 12:54:20 - r - INFO: - Episode: 72/100, Reward: 200.000, Step: 200
2022-11-22 12:54:20 - r - INFO: - Episode: 73/100, Reward: 200.000, Step: 200
2022-11-22 12:54:21 - r - INFO: - Episode: 74/100, Reward: 200.000, Step: 200
2022-11-22 12:54:21 - r - INFO: - Episode: 75/100, Reward: 200.000, Step: 200
2022-11-22 12:54:22 - r - INFO: - Current episode 75 has the best eval reward: 200.000
2022-11-22 12:54:23 - r - INFO: - Episode: 76/100, Reward: 200.000, Step: 200
2022-11-22 12:54:23 - r - INFO: - Episode: 77/100, Reward: 200.000, Step: 200
2022-11-22 12:54:24 - r - INFO: - Episode: 78/100, Reward: 200.000, Step: 200
2022-11-22 12:54:24 - r - INFO: - Episode: 79/100, Reward: 200.000, Step: 200
2022-11-22 12:54:24 - r - INFO: - Episode: 80/100, Reward: 200.000, Step: 200
2022-11-22 12:54:25 - r - INFO: - Current episode 80 has the best eval reward: 200.000
2022-11-22 12:54:26 - r - INFO: - Episode: 81/100, Reward: 200.000, Step: 200
2022-11-22 12:54:26 - r - INFO: - Episode: 82/100, Reward: 200.000, Step: 200
2022-11-22 12:54:27 - r - INFO: - Episode: 83/100, Reward: 200.000, Step: 200
2022-11-22 12:54:27 - r - INFO: - Episode: 84/100, Reward: 200.000, Step: 200
2022-11-22 12:54:27 - r - INFO: - Episode: 85/100, Reward: 200.000, Step: 200
2022-11-22 12:54:28 - r - INFO: - Current episode 85 has the best eval reward: 200.000
2022-11-22 12:54:29 - r - INFO: - Episode: 86/100, Reward: 200.000, Step: 200
2022-11-22 12:54:29 - r - INFO: - Episode: 87/100, Reward: 200.000, Step: 200
2022-11-22 12:54:30 - r - INFO: - Episode: 88/100, Reward: 200.000, Step: 200
2022-11-22 12:54:30 - r - INFO: - Episode: 89/100, Reward: 200.000, Step: 200
2022-11-22 12:54:30 - r - INFO: - Episode: 90/100, Reward: 200.000, Step: 200
2022-11-22 12:54:31 - r - INFO: - Current episode 90 has the best eval reward: 200.000
2022-11-22 12:54:32 - r - INFO: - Episode: 91/100, Reward: 200.000, Step: 200
2022-11-22 12:54:32 - r - INFO: - Episode: 92/100, Reward: 200.000, Step: 200
2022-11-22 12:54:33 - r - INFO: - Episode: 93/100, Reward: 200.000, Step: 200
2022-11-22 12:54:33 - r - INFO: - Episode: 94/100, Reward: 200.000, Step: 200
2022-11-22 12:54:34 - r - INFO: - Episode: 95/100, Reward: 200.000, Step: 200
2022-11-22 12:54:34 - r - INFO: - Current episode 95 has the best eval reward: 200.000
2022-11-22 12:54:35 - r - INFO: - Episode: 96/100, Reward: 200.000, Step: 200
2022-11-22 12:54:35 - r - INFO: - Episode: 97/100, Reward: 200.000, Step: 200
2022-11-22 12:54:36 - r - INFO: - Episode: 98/100, Reward: 200.000, Step: 200
2022-11-22 12:54:36 - r - INFO: - Episode: 99/100, Reward: 200.000, Step: 200
2022-11-22 12:54:37 - r - INFO: - Episode: 100/100, Reward: 200.000, Step: 200
2022-11-22 12:54:37 - r - INFO: - Current episode 100 has the best eval reward: 200.000
2022-11-22 12:54:37 - r - INFO: - Finish training!