Two-Stage Representation Refinement Based on Convex Combination for 3-D Human Poses Estimation
- 22 July 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Artificial Intelligence
- Vol. 5 (12) , 6500-6508
Abstract
In the human pose estimation task, on the one hand, 3D pose always has difficulty in dividing different 2D poses if the view is limited; on the other hand, it is hard to reduce the lifting ambiguity because of the lack of depth information, it is an important and challenging problem. Therefore, Two-stage representation refinement based on the convex combination for 3D human pose estimation is proposed, in which the two-stage method includes a dense-spatial-temporal convolutional network and a local-to-refine network. The former is applied to determine the features between each video frame; the latter is used to get the different scales of pose details. It aims to address the difficulty of estimating 3D human pose from 2D image sequences. In such a way, it can better use the relations between every frame in the sequence of the pose video to produce more accurate results. Finally, we combine the above network with a block called convex combination to helps refine the 3D pose location. We test the proposed approach on both Human3.6m and MPII datasets. The result confirms that our method can achieve better performance than improved CNN supervision, a simple yet effective baseline, and coarse-to-fine volumetric prediction. Besides, a robustness test experiment is carried out for the proposed method while the input is interrupted. The result verifies that our method shows better robustness.Keywords
Funding Information
- National Natural Science Foundation of China (62373334, 62273317, 61973286)
- Higher Education Discipline Innovation Project (B17040)
- Fundamental Research Funds for the Central Universities, China University of Geosciences (2021063)
This publication has 44 references indexed in Scilit:
- Low-resolution human pose estimationPattern Recognition, 2022
- Monocular multi-person pose estimation: A surveyPattern Recognition, 2021
- An end-to-end framework for unconstrained monocular 3D hand pose estimationPattern Recognition, 2021
- Single-shot 3D multi-person pose estimation in complex imagesPattern Recognition, 2021
- SDM3d: shape decomposition of multiple geometric priors for 3D pose estimationNeural Computing and Applications, 2020
- Pose recognition using convolutional neural networks on omni-directional imagesNeurocomputing, 2018
- Learning Latent Representations of 3D Human Pose with Deep Neural NetworksInternational Journal of Computer Vision, 2018
- Maximum-Margin Structured Learning with Deep Networks for 3D Human Pose EstimationInternational Journal of Computer Vision, 2016
- 3D Human Pose Tracking Priors using Geodesic Mixture ModelsInternational Journal of Computer Vision, 2016
- Human pose recovery by supervised spectral embeddingNeurocomputing, 2015