Cross-Domain Fall Detection and Activity Recognition Using Low-Resolution Infrared Sensors and Deep Learning
- 1 May 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 26 (12) , 18991-18999
Abstract
Falls in health and social care require privacy-preserving and cost-effective monitoring solutions to ensure safety. Low-resolution infrared (IR) array sensors provide a promising balance between invasiveness and information content; however, their performance can be strongly affected by ambient temperature variations and thermal interference. In this work, an environment-adaptive fall-detection system was developed to achieve cross-domain robustness and embedded real-time feasibility. A 24×32 MLX90640 IR array integrated with an ESP32 microcontroller captures thermal sequences at 8 fps. The processing pipeline includes temperature-based filtering, background removal based on a U-Net architecture for isolating human motion, Farneback optical flow extraction, and a lightweight CNN–BiLSTM–Attention network for spatiotemporal modeling. Experiments conducted across three thermally distinct indoor environments (11,148 samples, six activity classes) demonstrate that the U-Net-based background subtraction significantly enhances model robustness, achieving a six-class classification accuracy of 86.31% and reaching 98.27% in a simplified three-class (normal/falling/empty) configuration. Ablation and profiling analyses confirm the contribution of each processing stage while maintaining a compact model (≈0.83 M parameters, ≈3.17 MB) operating in real time at 8 fps on the ESP32–MLX90640 platform.Keywords
Funding Information
- National Science and Technology Council, Taiwan (111-2622-E-A49-004)
- National Science and Technology Council, Taiwan (114-2221-E-A49-172)
This publication has 23 references indexed in Scilit:
- A new framework for deep learning video based Human Action Recognition on the edgeExpert Systems with Applications, 2023
- Fall detection system based on infrared array sensor and multi-dimensional feature fusionMeasurement, 2022
- 2-D LIDAR-Based Approach for Activity Identification and Fall DetectionIEEE Internet of Things Journal, 2021
- A Novel Hybrid Deep Learning Model for Activity Detection Using Wide-Angle Low-Resolution Infrared Array SensorIEEE Access, 2021
- Fall Detection System for Elderly based on 2D LiDAR: A Preliminary Study of Fall Incident and Activities of Daily Living (ADL) Detection2020
- Deep Learning Based Systems Developed for Fall Detection: A ReviewIEEE Access, 2020
- A Thermal Camera-based Activity Recognition Using Discriminant Skeleton Features and RNN2019
- Deep neural network based body posture recognitions and fall detection from low resolution infrared array sensor2018
- A Depth Camera-based Human Activity Recognition via Deep Learning Recurrent Neural Network for Health and Social Care ServicesProcedia Computer Science, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015