First Push
Browse files- README.md +29 -0
- config.json +1 -0
- configuration.yaml +31 -0
README.md
ADDED
@@ -0,0 +1,29 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
library_name: ml-agents
|
3 |
+
tags:
|
4 |
+
- Pyramids
|
5 |
+
- deep-reinforcement-learning
|
6 |
+
- reinforcement-learning
|
7 |
+
- ML-Agents-Pyramids
|
8 |
+
---
|
9 |
+
|
10 |
+
# **ppo** Agent playing **Pyramids**
|
11 |
+
This is a trained model of a **ppo** agent playing **Pyramids** using the [Unity ML-Agents Library](https://github.com/Unity-Technologies/ml-agents).
|
12 |
+
|
13 |
+
## Usage (with ML-Agents)
|
14 |
+
The Documentation: https://github.com/huggingface/ml-agents#get-started
|
15 |
+
We wrote a complete tutorial to learn to train your first agent using ML-Agents and publish it to the Hub:
|
16 |
+
|
17 |
+
|
18 |
+
### Resume the training
|
19 |
+
```
|
20 |
+
mlagents-learn <your_configuration_file_path.yaml> --run-id=<run_id> --resume
|
21 |
+
```
|
22 |
+
### Watch your Agent play
|
23 |
+
You can watch your agent **playing directly in your browser:**.
|
24 |
+
|
25 |
+
1. Go to https://huggingface.co/spaces/unity/ML-Agents-Pyramids
|
26 |
+
2. Step 1: Find your model_id: sonny-dev/ppo-Pyramids
|
27 |
+
3. Step 2: Select your *.nn /*.onnx file
|
28 |
+
4. Click on Watch the agent play 👀
|
29 |
+
|
config.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"behaviors": {"Pyramids": {"trainer_type": "ppo", "hyperparameters": {"batch_size": 128, "buffer_size": 2048, "learning_rate": 0.0003, "beta": 0.01, "epsilon": 0.2, "lambd": 0.95, "num_epoch": 3, "learning_rate_schedule": "linear"}, "network_settings": {"normalize": false, "hidden_units": 512, "num_layers": 2, "vis_encode_type": "simple"}, "reward_signals": {"extrinsic": {"gamma": 0.99, "strength": 1.0}, "curiosity": {"gamma": 0.99, "strength": 0.02, "network_settings": {"hidden_units": 256}, "learning_rate": 0.0003}}, "keep_checkpoints": 5, "max_steps": 1000000, "time_horizon": 128, "summary_freq": 30000}}}
|
configuration.yaml
ADDED
@@ -0,0 +1,31 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
behaviors:
|
2 |
+
Pyramids:
|
3 |
+
trainer_type: ppo
|
4 |
+
hyperparameters:
|
5 |
+
batch_size: 128
|
6 |
+
buffer_size: 2048
|
7 |
+
learning_rate: 0.0003
|
8 |
+
beta: 0.01
|
9 |
+
epsilon: 0.2
|
10 |
+
lambd: 0.95
|
11 |
+
num_epoch: 3
|
12 |
+
learning_rate_schedule: linear
|
13 |
+
network_settings:
|
14 |
+
normalize: false
|
15 |
+
hidden_units: 512
|
16 |
+
num_layers: 2
|
17 |
+
vis_encode_type: simple
|
18 |
+
reward_signals:
|
19 |
+
extrinsic:
|
20 |
+
gamma: 0.99
|
21 |
+
strength: 1.0
|
22 |
+
curiosity:
|
23 |
+
gamma: 0.99
|
24 |
+
strength: 0.02
|
25 |
+
network_settings:
|
26 |
+
hidden_units: 256
|
27 |
+
learning_rate: 0.0003
|
28 |
+
keep_checkpoints: 5
|
29 |
+
max_steps: 1000000
|
30 |
+
time_horizon: 128
|
31 |
+
summary_freq: 30000
|