LastAct: Trajectory-Guided Latest-Activity Localization for Real-Time Smart-Home Activity Recognition
Open Access
- 30 September 2026
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 10 (3) , 1-47
Abstract
Human Activity Recognition (HAR) from ambient sensors enables smart-home applications such as health monitoring and assisted living. In realistic deployments, however, sensor events arrive as a continuous stream and activity boundaries are unknown. Sliding-window inference therefore produces many windows that straddle transitions and contain mixed activities, creating boundary contamination that violates the pre-segmented instance assumption used by most benchmarks and models. Moreover, many pipelines under-use spatial context by treating sensor IDs as independent tokens. We present LastAct, a trajectory-centric framework for streaming smart-home HAR that targets the most recent activity under mixed windows while explicitly modeling spatial structure. LastAct projects sensor events onto the home floorplan to form a layout-aligned trajectory image sequence that preserves spatial continuity. A lightweight gate identifies contaminated windows, and a boundary localizer estimates the last transition to enable boundary-guided masking that emphasizes post-boundary evidence and suppresses stale context. For efficiency, we reuse a precomputed layout-aligned template cache to avoid repeated rendering. Empirically, across four public smart-home datasets under near-realistic mixed-activity protocols, LastAct achieves competitive or superior performance on pure windows and yields substantial Macro-F1 gains on cross/mixed windows, demonstrating improved robustness under near-realistic sliding-window regimes.Keywords
All Related Versions
This publication has 43 references indexed in Scilit:
- Action Recognition for Privacy-Preserving Ambient Assisted Living2024
- Fully Convolutional Network Bootstrapped by Word Encoding and Embedding for Activity Recognition in Smart Homes2021
- A sequential deep learning application for recognising human activities in smart homesNeurocomputing, 2020
- Smart home resident identification based on behavioral patterns using ambient sensorsPersonal and Ubiquitous Computing, 2019
- Online human activity recognition employing hierarchical hidden Markov modelsJournal of Ambient Intelligence and Humanized Computing, 2019
- Sensor-Based Activity Recognition Review2019
- Monitoring meaningful activities using small low-cost devices in a smart homePersonal and Ubiquitous Computing, 2019
- Convolutional and Recurrent Neural Networks for Activity Recognition in Smart Environment2017
- A Dataset of Routine Daily Activities in an Instrumented Home2017
- Dynamic detection of window starting positions and its implementation within an activity recognition frameworkJournal of Biomedical Informatics, 2016