Multi-User Activity Recognition Using Plot Images Based on Ambiental Sensors
Open Access
- 28 February 2025
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 15 (5) , 2610
Abstract
Artificial intelligence has increasingly taken over various aspects of daily life, resulting in the proliferation of smart devices and the development of smart living and working environments. One significant domain within this technological advancement is human activity recognition, which includes a broad spectrum of applications such as patient monitoring and supervision of children’s activities. In this research, we endeavor to design a human activity recognition system that effectively analyzes multi-user data through a machine learning framework centered on graphical plot images. The proposed methodology uses a PIR sensor-based system. This system uses a two-stage process; the first one involves generating new image datasets as density map images and graphical representations based on the Kyoto CASAS multi-user dataset. In the second stage, the generated data are provided to a sequential convolutional neural network, which predicts the 16 activities developed by two users. To generate the new datasets, we only used data from ambient sensors, which were organized in windows. We tested many types of window dimensions and extra features such as temporal aspect and the limitation of two activities in one window. The neural network was optimized by increasing the deconvolutional layers and adding the AdamW optimizer. The results demonstrate the viability of this method, evidencing an accuracy rate of 83% for multi-user activity and an accuracy rate of 99% for single-user activity. This study successfully achieved its objective of identifying an efficient activity recognition methodology and a data image representation. Furthermore, future enhancements are anticipated by integrating data sourced from PIR sensors, with information gathered from user-personal devices such as smartphones. This approach is also applicable to real-time recognition systems.Keywords
This publication has 30 references indexed in Scilit:
- CIR-DFENet: Incorporating cross-modal image representation and dual-stream feature enhanced network for activity recognitionExpert Systems with Applications, 2024
- CNN-based gesture recognition using raw numerical gray-scale images of surface electromyographyBiomedical Signal Processing and Control, 2024
- Class imbalance in multi-resident activity recognition: an evaluative study on explainability of deep learning approachesUniversal Access in the Information Society, 2024
- Human activity recognition based on multienvironment sensor dataInformation Fusion, 2022
- MultiCNN-FilterLSTM: Resource-efficient sensor-based human activity recognition in IoT applicationsFuture Generation Computer Systems, 2022
- Multi-user activity recognition: Challenges and opportunitiesInformation Fusion, 2020
- Identifying multiuser activity with overlapping acoustic data for mobile decision making in smart home environmentsExpert Systems with Applications, 2017
- Deep Learning with Python2017
- Human activity recognition with smartphone sensors using deep learning neural networksExpert Systems with Applications, 2016
- Recognizing independent and joint activities among multiple residents in smart environmentsJournal of Ambient Intelligence and Humanized Computing, 2009