OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields
Top Cited Papers
- 17 July 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 43 (1) , 172-186
Abstract
Realtime multi-person 2D pose estimation is a key component in enabling machines to have an understanding of people in images and videos. In this work, we present a realtime approach to detect the 2D pose of multiple people in an image. The proposed method uses a nonparametric representation, which we refer to as Part Affinity Fields (PAFs), to learn to associate body parts with individuals in the image. This bottom-up system achieves high accuracy and realtime performance, regardless of the number of people in the image. In previous work, PAFs and body part location estimation were refined simultaneously across training stages. We demonstrate that using a PAF-only refinement is able to achieve a substantial increase in both runtime performance and accuracy. We also present the first combined body and foot keypoint detector, based on an annotated foot dataset that we have publicly released. We show that the combined detector not only reduces the inference time compared to running them sequentially, but also maintains the accuracy of each component individually. This work has culminated in the release of OpenPose, the first open-source realtime system for multi-person 2D pose detection, including body, foot, hand, and facial keypoints.Keywords
Funding Information
- Intelligence Advanced Research Projects Activity
- Department of Interior / Interior Business Center (D17PC00340)
This publication has 62 references indexed in Scilit:
- SMPLACM Transactions on Graphics, 2015
- DeepPose: Human Pose Estimation via Deep Neural Networks2014
- Human Pose Estimation Using Body Parts Dependent Joint Regressors2013
- Poselet Conditioned Pictorial Structures2013
- Using Linking Features in Learning Non-parametric Part Models2012
- We Are Family: Joint Pose Estimation of Multiple Persons2010
- Multiple Tree Models for Occlusion and Spatial Constraints in Human Pose Estimation2008
- Pictorial Structures for Object RecognitionInternational Journal of Computer Vision, 2005
- An Algorithm for Least-Squares Estimation of Nonlinear ParametersJournal of the Society for Industrial and Applied Mathematics, 1963
- The Hungarian method for the assignment problemNaval Research Logistics Quarterly, 1955