Abstract
In this paper, we study the problem of human action recognition from multiple feature modalities. We propose Bimodal Hybrid Centroid Canonical Correlation Analysis (BHCCCA) and Multimodal Hybrid Centroid Canonical Correlation Analysis (MHCCCA) to learn the discriminative and informative shared space, by considering the correlation among different classes across two modalities (BHCCCA) and three or more modalities (MHCCCA). We then introduce a new human action recognition framework by using BHCCCA/MHCCCA for fusing different modalities (RGB, depth, skeleton, and accelerometer data). Performance evaluation on four publicly accessible datasets (MSR Action3D, UTD-MHAD, UTD-MHAD-Kinect V2, and Berkeley MHAD) demonstrated the effectiveness of the proposed framework.

This publication has 46 references indexed in Scilit: