| --- | |
| license: apache-2.0 | |
| tags: | |
| --- | |
| # DQN | |
| DQN model applied to the this discrete environments CartPole-v1 | |
| ## Model Description | |
| The model was trained from the CleanRl library using the DQN algorithm on CartPole-v1 | |
| ## Intended Use & Limitation | |
| The model is intended to be used for the following environments CartPole-v1 | |
| and understand the implication of Quantization on this type of model from a pretrained state | |
| ## Training Procdure | |
| ### Training Hyperparameters | |
| The folloing hyperparameters were used during training: | |
| - exp_name: functional_dqn | |
| - seed: 0 | |
| - torch_deterministic: True | |
| - cuda: False | |
| - track: True | |
| - wandb_project_name: cleanRL | |
| - wandb_entity: compress_rl | |
| - capture_video: False | |
| - env_id: CartPole-v1 | |
| - total_timesteps: 500000 | |
| - learning_rate: 0.00025 | |
| - buffer_size: 10000 | |
| - gamma: 0.99 | |
| - target_network_frequency: 500 | |
| - batch_size: 128 | |
| - start_e: 1 | |
| - end_e: 0.05 | |
| - exploration_fraction: 0.5 | |
| - learning_starts: 10000 | |
| - train_frequency: 10 | |
| - optimizer: Adan | |
| - max_grad_norm: 0.0 | |
| - weight_decay: 0.02 | |
| - opt_eps: None | |
| - opt_betas: None | |
| - no_prox: False | |
| - wandb_project: cleanrl | |
| ### Framework and version | |
| Pytorch 1.12.1+cu102 | |
| gym 0.23.1 | |
| Weights and Biases 0.13.3 | |
| Hugging Face Hub 0.11.1 | |
| Python Version 3.8.16 (default, Dec 7 2022, 01:12:13) | |
| [GCC 7.5.0] | |
| ## Citation | |
| ```bibtex | |
| ``` | |