A Human Activity Recognition System Based on Dynamic Clustering of Skeleton Data
Open Access
Abstract
Human activity recognition is an important area in computer vision, with its wide range of applications including ambient assisted living. In this paper, an activity recognition system based on skeleton data extracted from a depth camera is presented. The system makes use of machine learning techniques to classify the actions that are described with a set of a few basic postures. The training phase creates several models related to the number of clustered postures by means of a multiclass Support Vector Machine (SVM), trained with Sequential Minimal Optimization (SMO). The classification phase adopts the X-means algorithm to find the optimal number of clusters dynamically. The contribution of the paper is twofold. The first aim is to perform activity recognition employing features based on a small number of informative postures, extracted independently from each activity instance; secondly, it aims to assess the minimum number of frames needed for an adequate classification. The system is evaluated on two publicly available datasets, the Cornell Activity Dataset (CAD-60) and the Telecommunication Systems Team (TST) Fall detection dataset. The number of clusters needed to model each instance ranges from two to four elements. The proposed approach reaches excellent performances using only about 4 s of input data (~100 frames) and outperforms the state of the art when it uses approximately 500 frames on the CAD-60 dataset. The results are promising for the test in real context.Keywords
This publication has 34 references indexed in Scilit:
- Visual Privacy by Context: Proposal and Evaluation of a Level-Based Visualisation SchemeSensors, 2015
- Human Activity Recognition Process Using 3-D Posture DataIEEE Transactions on Human-Machine Systems, 2014
- Human activity recognition from 3D data: A reviewPattern Recognition Letters, 2014
- Evaluating spatiotemporal interest point features for depth-based action recognitionImage and Vision Computing, 2014
- Real-time human pose recognition in parts from single depth imagesCommunications of the ACM, 2013
- Technology and Innovative ServicesIEEE Pulse, 2011
- Human activity analysisACM Computing Surveys, 2011
- A survey of vision-based methods for action representation, segmentation and recognitionComputer Vision and Image Understanding, 2011
- Photometric stereo with an arbitrary number of illuminantsComputer Vision and Image Understanding, 2010
- A survey on vision-based human action recognitionImage and Vision Computing, 2010