File size: 632 Bytes
079c32c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
## BitFlip Environment
A simple environment to flip a 01 sequence into a specific state. With the bits number increasing, the task becomes harder.
Well suited for testing Hindsight Experience Replay.
## DI-engine's HER on BitFlip
The table shows how many envsteps are needed at least to converge for PureDQN and HER-DQN implemented in DI-engine. '-' means no convergence in 20M envsteps.
| n_bit | PureDQN | HER-DQN |
| ------ | ------- | ------- |
| 15 | - | 150K |
| 20 | - | 1.5M |
DI-engine's HER-DQN can converge
You can refer to the RL algorithm doc for implementation and experiment details.
|