Dynamic manifold Boltzmann optimization based on self‐supervised learning for human motion estimation
Open Access
- 3 January 2022
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Image Processing
- Vol. 16 (4) , 1162-1180
Abstract
It is a challenge work to estimate the 3D human motion from image sequence. There are some problems, such as unsatisfactory estimation error, ambiguous matching and transient occlusion. Although the prior information of learning large‐scale samples exists, these problems are still difficult to be solved. How to extract the feature of the high‐dimensional (HD) sample of 3D human motion and find the desired one will become the key to solve these problems above. Some dimension reduction methods can extract the sample features and build the low‐dimensional (LD) space to view their LD features, but how to search the relevant valid and desired LD samples remains the bottleneck problem, which can be used to reconstruct the 3D human motions denoted by the corresponding high‐dimensional samples. Thus, a new method called dynamic manifold Boltzmann optimization (DMBO) is proposed to estimate the 3D human motion from multi‐view images. DMBO can find the best matching 3D human motion model by the help of the self‐supervised learning from Gaussian incremental dimension reduction model (GIDRM). DMBO can avoid the local optimum during searching and solve the problems above, so that the generation of the accurate 3D human motion corresponding to multi‐view images can be achieved.Keywords
Funding Information
- Natural Science Foundation of Guangdong Province (2018A0303130169)
This publication has 32 references indexed in Scilit:
- Fast scene analysis using vision and artificial intelligence for object prehension by an assistive robotEngineering Applications of Artificial Intelligence, 2017
- Keep It SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Image2016
- Development of Cognitive Maps by Individuals with Blindness Using a Multisensory ApplicationProcedia Computer Science, 2015
- Gaussian particle filtering in high-dimensional systems2014
- Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural EnvironmentsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Markerless Motion Capture of Multiple Characters Using Multiview Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- HumanEva: Synchronized Video and Motion Capture Dataset and Baseline Algorithm for Evaluation of Articulated Human MotionInternational Journal of Computer Vision, 2009
- Gaussian Process Dynamical Models for Human MotionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Nonlinear Dimensionality Reduction by Locally Linear EmbeddingScience, 2000
- A Global Geometric Framework for Nonlinear Dimensionality ReductionScience, 2000