vioHAR: A visual-inertial odometry-based human activity recognition system
- 1 June 2026
- journal article
- Published by AIP Publishing in Biophysics Reviews
- Vol. 7 (2)
Abstract
Human activity recognition (HAR) remains a pivotal research domain with extensive applications in healthcare, elderly care, and assistive technology. However, traditional systems relying solely on inertial measurement units (IMUs) face significant limitations, particularly regarding precision and vulnerability to varying device orientations. To address this urgent need, this study introduces visual inertial odometry based human activity recognition (vioHAR), a novel methodology and public dataset that seamlessly fuses visual and inertial data. By leveraging the visual-inertial odometry system for monocular cameras (VINS-Mono) state estimator, the proposed system generates precise, orientation-independent trajectories, facilitating robust classification across eight distinct daily behaviors and fall scenarios. Extensive evaluation using leave-one-subject-out (LOSO) cross-validation demonstrates that the vioHAR method achieves a robust average accuracy of 73.96%. This represents a substantial improvement over the standard IMU-only baseline (43.35%), yielding specific accuracy gains of +27.60% for the random forest (RF) model and +41.11% for the long short-term memory (LSTM) model. Furthermore, comparing computational efficiency, the LSTM network trained nearly ten times faster than the RF model (44.79 vs 415.81 s) while maintaining a minimal false alarm rate of 0.038, highlighting its superior potential for edge computing applications. Despite hardware challenges such as asynchronous sensor clocks, vioHAR establishes a rigorous and efficient foundation for real-world HAR deployment on emerging head-worn devices.Keywords
This publication has 28 references indexed in Scilit:
- An analytical comparison of datasets of Real-World and simulated falls intended for the evaluation of wearable fall alerting systemsMeasurement, 2022
- The Ethics of Privacy in Research and Design: Principles, Practices, and Potential2022
- A review of multimodal human activity recognition with special emphasis on classification, applications, challenges and future directionsKnowledge-Based Systems, 2021
- A fusion fall detection algorithm combining threshold-based method and convolutional neural networkMicroprocessors and Microsystems, 2021
- Dataset for gait analysis and assessment of fall risk for older adultsData in Brief, 2020
- Fall detection system for elderly people using IoT and ensemble machine learning algorithmPersonal and Ubiquitous Computing, 2019
- A robust human activity recognition system using smartphone sensors and deep learningFuture Generation Computer Systems, 2018
- A survey of video datasets for human action and activity recognitionComputer Vision and Image Understanding, 2013
- A survey on fall detection: Principles and approachesNeurocomputing, 2013
- HumanEva: Synchronized Video and Motion Capture Dataset and Baseline Algorithm for Evaluation of Articulated Human MotionInternational Journal of Computer Vision, 2009