aliberts HF staff commited on
Commit
e0fb822
·
1 Parent(s): 2e01cce

Update results

Browse files
Files changed (1) hide show
  1. README.md +3 -4
README.md CHANGED
@@ -21,7 +21,7 @@ See the [LeRobot library](https://github.com/huggingface/lerobot) (particularly
21
 
22
  ## Training Details
23
 
24
- Trained with [LeRobot@TODO](https://github.com/huggingface/lerobot/tree/TODO).
25
 
26
  The model was trained using [LeRobot's training script](https://github.com/huggingface/lerobot/blob/main/lerobot/scripts/train.py) and with the [aloha_sim_transfer_cube_human](https://huggingface.co/datasets/lerobot/aloha_sim_transfer_cube_human) dataset, using this command:
27
 
@@ -44,12 +44,11 @@ This took about 1h45 to train on an Nvida A100.
44
 
45
  The model was evaluated on the `AlohaTransferCube` task from [gym-aloha](https://github.com/huggingface/gym-aloha) and compared to a similar model trained with the original [ACT repository](https://github.com/tonyzhaozh/act). Each episode marks a success if the cube is successfully picked by one robot arm and transferred to the other robot arm.
46
 
47
- Here are the success rate results for 500 episodes worth of evaluation. The first row is the naive mean. The second row assumes a uniform prior and computes the beta posterior, then calculates the mean and lower/upper confidence bounds (with a 68.2% confidence interval centered on the mean). The "Theirs" column is for an equivalent model trained on the original ACT repository and evaluated on LeRobot (the model weights may be found in the [`original_act_repo`](https://huggingface.co/lerobot/act_aloha_sim_transfer_cube_human/tree/original_act_repo) branch of this respository). The results of each of the individual rollouts may be found in [eval_info.json](eval_info.json).
48
 
49
  <blank>|Ours|Theirs
50
  -|-|-
51
- Success rate for 500 episodes (%) | 87.6 | 68.0
52
- Beta distribution lower/mean/upper (%) | 86.0 / 87.5 / 88.9 | 65.8 / 67.9 / 70.0
53
 
54
  It was produced after training with this command:
55
  ```bash
 
21
 
22
  ## Training Details
23
 
24
+ Trained with [LeRobot@3c0a209](https://github.com/huggingface/lerobot/tree/3c0a209f9fac4d2a57617e686a7f2a2309144ba2).
25
 
26
  The model was trained using [LeRobot's training script](https://github.com/huggingface/lerobot/blob/main/lerobot/scripts/train.py) and with the [aloha_sim_transfer_cube_human](https://huggingface.co/datasets/lerobot/aloha_sim_transfer_cube_human) dataset, using this command:
27
 
 
44
 
45
  The model was evaluated on the `AlohaTransferCube` task from [gym-aloha](https://github.com/huggingface/gym-aloha) and compared to a similar model trained with the original [ACT repository](https://github.com/tonyzhaozh/act). Each episode marks a success if the cube is successfully picked by one robot arm and transferred to the other robot arm.
46
 
47
+ Here are the success rate results for 500 episodes worth of evaluation. The "Theirs" column is for an equivalent model trained on the original ACT repository and evaluated on LeRobot (the model weights may be found in the [`original_act_repo`](https://huggingface.co/lerobot/act_aloha_sim_transfer_cube_human/tree/original_act_repo) branch of this respository). The results of each of the individual rollouts may be found in [eval_info.json](eval_info.json).
48
 
49
  <blank>|Ours|Theirs
50
  -|-|-
51
+ Success rate for 500 episodes (%) | 83.0 | 68.0
 
52
 
53
  It was produced after training with this command:
54
  ```bash