Human Posture Recognition Based on Images Captured by the Kinect Sensor
Authors:
Open Access
- 1 January 2016
- journal article
- research article
- Published by SAGE Publications in International Journal of Advanced Robotic Systems
- Vol. 13 (2)
Abstract
In this paper we combine several image processing techniques with the depth images captured by a Kinect sensor to successfully recognize the five distinct human postures of sitting, standing, stooping, kneeling, and lying. The proposed recognition procedure first uses background subtraction on the depth image to extract a silhouette contour of a human. Then, a horizontal projection of the silhouette contour is employed to ascertain whether or not the human is kneeling. If the figure is not kneeling, the star skeleton technique is applied to the silhouette contour to obtain its feature points. We can then use the feature points together with the centre of gravity to calculate the feature vectors and depth values of the body. Next, we input the feature vectors and the depth values into a pre-trained LVQ (learning vector quantization) neural network; the outputs of this will determine the postures of sitting (or standing), stooping, and lying. Lastly, if an output indicates sitting or standing, one further, similar feature identification technique is needed to confirm this output. Based on the results of many experiments, using the proposed method, the rate of successful recognition is higher than 97% in the test data, even though the subjects of the experiments may not have been facing the Kinect sensor and may have had different statures. The proposed method can be called a “hybrid recognition method”, as many techniques are combined in order to achieve a very high recognition rate paired with a very short processing time.Keywords
This publication has 30 references indexed in Scilit:
- Image Recognition and Force Measurement Application in the Humanoid Robot ImitationIEEE Transactions on Instrumentation and Measurement, 2011
- Estimating Posture-Recognition Performance in Sensing Garments Using Geometric Wrinkle ModelingIEEE Transactions on Information Technology in Biomedicine, 2010
- Rapid prototyping of smart garments for activity-aware applicationsJournal of Ambient Intelligence and Smart Environments, 2009
- Classification of Posture and Movement Using a 3-axis Accelerometer2007
- Recognizing Upper Body Postures using Textile Strain Sensors2007
- Applying 3D human model in a posture recognition systemPattern Recognition Letters, 2006
- Human Posture Recognition by Simple Rules2006
- Retrieval and constraint-based human posture reconstruction from a single imageJournal of Visual Communication and Image Representation, 2006
- Human Motion Capture System using Color Markers and Silhouette2006
- Implementation of a Real-Time Human Movement Classifier Using a Triaxial Accelerometer for Ambulatory MonitoringIEEE Transactions on Information Technology in Biomedicine, 2006