Multi Person PoseEstimation By PyTorch

1. Pytorch

1. git submodule init && git submodule update

• Download converted pytorch model.
• Compile the C++ postprocessing: cd lib/pafprocess; sh make.sh
• python demo/picture_demo.py to run the picture demo.
• python demo/web_demo.py to run the web demo.

• python evaluate/evaluation.py to evaluate the model on coco val2017 dataset.
• It should have mAP 0.653 for the rtpose, previous rtpose have mAP 0.577 because we do left and right flip for heatmap and PAF for the evaluation. c

Download link: rtpose

The code is developed using python 3.6 on Ubuntu 18.04. NVIDIA GPUs are needed. The code is developed and tested using 4 1080ti GPU cards. Other platforms or GPU cards are not fully tested.

• cd training; bash getData.sh to obtain the COCO 2017 images in /data/root/coco/images/, keypoints annotations in /data/root/coco/annotations/, make them look like this:

${DATA_ROOT}
|-- coco
    |-- annotations
        |-- person_keypoints_train2017.json
        |-- person_keypoints_val2017.json
    |-- images
        |-- train2017
            |-- 000000000009.jpg
            |-- 000000000025.jpg
            |-- 000000000030.jpg
            |-- ... 
        |-- val2017
            |-- 000000000139.jpg
            |-- 000000000285.jpg
            |-- 000000000632.jpg
            |-- ... 
        

• Modify the data directory in train/train_VGG19.py and python train/train_VGG19.py

• CVPR'17, Realtime Multi-Person Pose Estimation.

• testing architecture

• training architecture

All contributions are welcomed. If you encounter any issue (including examples of images where it fails) feel free to open an issue.

Please cite the paper in your publications if it helps your research:

@InProceedings{cao2017realtime,
  title = {Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields},
  author = {Zhe Cao and Tomas Simon and Shih-En Wei and Yaser Sheikh},
  booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
  year = {2017}
  }