Skip to content

Commit

Permalink
[update] update README
Browse files Browse the repository at this point in the history
  • Loading branch information
yzqin committed May 17, 2024
1 parent 656e2a5 commit 801dea6
Show file tree
Hide file tree
Showing 3 changed files with 10 additions and 7 deletions.
3 changes: 2 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,8 @@ pip install -e ".[example]"

### Retargeting from human hand video

This type of retargeting can be used for applications like teleoperation.
This type of retargeting can be used for applications like teleoperation,
e.g. [AnyTeleop](https://yzqin.github.io/anyteleop/).

[Tutorial on retargeting from human hand video](example/vector_retargeting/README.md)

Expand Down
12 changes: 6 additions & 6 deletions example/position_retargeting/README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Retarget Robot Motion from Hand Object Pose Dataset
## Retarget Robot Motion from Hand Object Pose Dataset

## Setting up DexYCB Dataset
### Setting up DexYCB Dataset

This example illustrates how you can utilize the impressive DexYCB dataset to create a robot motion trajectory.
The [DexYCB](https://dex-ycb.github.io/) is a hand-object dataset developed by NVIDIA.
Expand Down Expand Up @@ -35,7 +35,7 @@ Counter({'002_master_chef_can': 12, '005_tomato_soup_can': 9, '004_sugar_box': 6
dict_keys(['hand_pose', 'object_pose', 'extrinsics', 'ycb_ids', 'hand_shape', 'object_mesh_file', 'capture_name'])
```

## Setting up manopth
### Setting up manopth

Now, we will set up manopth similar to how it is done in [dex-ycb-toolkit](https://github.com/NVlabs/dex-ycb-toolkit).

Expand All @@ -59,13 +59,13 @@ Now, we will set up manopth similar to how it is done in [dex-ycb-toolkit](https
ln -s ../mano_v1_2/models models
```

## Installing Additional Python Dependencies
### Installing Additional Python Dependencies

```shell
pip install tyro pyyaml sapien==3.0.0b0
```

## Visualizing Human Hand-Object Interaction
### Visualizing Human Hand-Object Interaction

Before proceeding to retargeting, we can first visualize the original dataset in SAPIEN renderer. The hand mesh is
computed via manopth.
Expand All @@ -75,7 +75,7 @@ python visualize_hand_object.py --dexycb-dir=PATH_TO_YOUR_DEXYCB_DIR_ROOT
# Close the viewer window to quit
```

## Visualizing Robot Hand-Object Interaction
### Visualizing Robot Hand-Object Interaction

Visualize the retargeting results for multiple robot hands along with the human hand.

Expand Down
2 changes: 2 additions & 0 deletions example/vector_retargeting/README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,7 @@
## Retarget Robot Motion from Human Hand Video

![teaser](teaser.webp)

### Generate the robot joint pose trajectory from our pre-recorded video

```shell
Expand Down

0 comments on commit 801dea6

Please sign in to comment.