Sozo Inoue
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Sozo Inoue has a total of 106 co-authors. Here are the top co-authors by number of shared publications:
- Haru Kaneko
Sozo Lab, Department of Life Science and Systems Engineering, Kyushu Institute of Technology, 2-4 Hibikino, Wakamatsu-ku, Kitakyushu-shi, Fukuoka 808-0196, Japan
6 shared publications - Atiqur Rahman Ahad
Department of Computer Science and Digital Technologies, University of East London, London, U.K.
5 shared publications - John Noel Victorino
Ateneo de Manila University,Department of Information Systems and Computer Science,Quezon City,Philippines
4 shared publications - Nattaya Mairittha
Graduate School of Engineering, Kyushu Institute of Technology, 1-1 Sensui-cho, Tobata-ku, Kitakyushu-shi, Fukuoka 804-8550, Japan
4 shared publications - Nazmun Nahid
Kyushu Institute of Technology, Kitakyushu, Fukuoka, Japan
4 shared publications - Tahera Hossain
Graduate School of Engineering, Nagoya University, Nagoya, Japan
4 shared publications
Latest Publications
- Open Access
- 15 July 2026
- Published by MDPI AG in BioMedInformatics
- Vol. 6 (4) , 47
Adaptive Retrieval-Augmented Generation (RAG) for Structured Clinical Notes from Patient–Provider Transcripts: A Multilingual Study
Background/Objectives: Clinical documentation places a significant time burden on healthcare professionals, including in the context of home care. Large language models (LLMs) offer potential for automated note generation, but current approaches rely on static prompt templates that fail to generalize across care settings, languages, and documentation formats. This study proposes and evaluates an adaptive retrieval-augmented generation (RAG) framework that uses retrieval as a format adaptation mechanism, enabling the generation of structured clinical notes from patient–provider transcripts across various documentation formats without model fine-tuning. Methods: The proposed framework retrieves dialogue–note pairs that demonstrate the structure of specific sections, allowing the transfer of formatting knowledge during inference. Experiments were conducted on three datasets covering two languages and various documentation formats: the Japanese Visiting Nurse corpus (JP-VN), MTS-Dialog, and ACI-BENCH. Six controlled conditions were evaluated: zero-shot prompting (C1), static few-shot prompting (C2), dense retrieval (C3), random retrieval (C4), sparse BM25 retrieval (C5), and hybrid retrieval using reciprocal rank fusion (RRF) (C6). Performance metrics include structural adherence to required section headings, content quality (ROUGE-1, BLEU, BERTScore), and the number of hallucinated clinical entities per generated record. Results: Structure compliance increased from 0–37% under static conditions (C1/C2) to 91–100% under all adaptive RAG conditions (C3–C6) across all datasets. On MTS-Dialog, dense retrieval achieved the highest content quality (ROUGE-1: 0.519 vs. 0.446–0.492 for C4–C6; ). Hallucinated entities in JP-VN decreased from 2.73–3.58 per note (C1/C2) to 1.15–1.30 (C3–C6), an approximately 55–56% reduction. Conclusions: Adaptive RAG can improve structure compliance and reduce hallucinations in multilingual clinical note generation without dataset-specific prompt engineering or model fine-tuning. These findings support retrieval-based format adaptation as a generalizable mechanism for diverse clinical documentation contexts.- 15 July 2026
- Published by MDPI AG in BioMedInformatics
- Vol. 6 (4) , 47
Open AccessAdaptive Retrieval-Augmented Generation (RAG) for Structured Clinical Notes from Patient–Provider Transcripts: A Multilingual Study
Background/Objectives: Clinical documentation places a significant time burden on healthcare professionals, including in the context of home care. Large language models (LLMs) offer potential for automated note generation, but current approaches rely on static prompt templates that fail to generalize across care settings, languages, and documentation formats. This study proposes and evaluates an adaptive retrieval-augmented generation (RAG) framework that uses retrieval as a format adaptation mechanism, enabling the generation of structured clinical notes from patient–provider transcripts across various documentation formats without model fine-tuning. Methods: The proposed framework retrieves dialogue–note pairs that demonstrate the structure of specific sections, allowing the transfer of formatting knowledge during inference. Experiments were conducted on three datasets covering two languages and various documentation formats: the Japanese Visiting Nurse corpus (JP-VN), MTS-Dialog, and ACI-BENCH. Six controlled conditions were evaluated: zero-shot prompting (C1), static few-shot prompting (C2), dense retrieval (C3), random retrieval (C4), sparse BM25 retrieval (C5), and hybrid retrieval using reciprocal rank fusion (RRF) (C6). Performance metrics include structural adherence to required section headings, content quality (ROUGE-1, BLEU, BERTScore), and the number of hallucinated clinical entities per generated record. Results: Structure compliance increased from 0–37% under static conditions (C1/C2) to 91–100% under all adaptive RAG conditions (C3–C6) across all datasets. On MTS-Dialog, dense retrieval achieved the highest content quality (ROUGE-1: 0.519 vs. 0.446–0.492 for C4–C6; ). Hallucinated entities in JP-VN decreased from 2.73–3.58 per note (C1/C2) to 1.15–1.30 (C3–C6), an approximately 55–56% reduction. Conclusions: Adaptive RAG can improve structure compliance and reduce hallucinations in multilingual clinical note generation without dataset-specific prompt engineering or model fine-tuning. These findings support retrieval-based format adaptation as a generalizable mechanism for diverse clinical documentation contexts. - Open Access
No More False Alert: Contrastive Learning for Predicting Health Deterioration from Imbalanced Care Records
In this paper, we propose an outcome-based contrastive loss for imbalanced binary classification to alert to next-day health deterioration using care records and meteorological data. Long-term care facilities maintain daily care and observation records to monitor the health of older adults. Such objective records are particularly valuable when sudden deterioration occurs, enabling timely coordination with medical institutions. Predicting deterioration one day in advance could provide care staff with an actionable window to intensify observation and adjust care plans (e.g., scheduling additional vital checks or increasing fluid intake monitoring). This could potentially reduce emergency transports and ease the burden on already understaffed care facilities. However, for such predictions to be useful in practice, false positives must be suppressed. Because deterioration events are rare, class imbalance generates an excess of false positives, causing alert fatigue and increasing the risk that actual events go unnoticed. To address these challenges, we propose an outcome-based contrastive loss that contrasts actual deteriorating samples against false alarms conditioned on mini-batch prediction outcomes. The proposed loss contracts same-label pairs to shape local structure within each ground-truth label. The loss also separates actual deteriorating samples from false alarms among samples predicted as deteriorating, thereby directly reducing unnecessary alerts. As a result, compared with random oversampling with standard cross-entropy, the proposed model improved precision from 3.97% to 12.94% (+8.97 percentage points), while limiting the F1-score decrease to 0.71 percentage points (from 7.28% to 6.57%). Pair-design ablations and UMAP projections supported this mechanism by indicating clearer separation between actually deteriorating and false-alarm samples in the learned representation space. These results suggest a viable direction for alert systems that produce fewer unnecessary alerts, reducing alert fatigue and supporting more reliable deterioration detection in care settings.
Open AccessNo More False Alert: Contrastive Learning for Predicting Health Deterioration from Imbalanced Care Records
In this paper, we propose an outcome-based contrastive loss for imbalanced binary classification to alert to next-day health deterioration using care records and meteorological data. Long-term care facilities maintain daily care and observation records to monitor the health of older adults. Such objective records are particularly valuable when sudden deterioration occurs, enabling timely coordination with medical institutions. Predicting deterioration one day in advance could provide care staff with an actionable window to intensify observation and adjust care plans (e.g., scheduling additional vital checks or increasing fluid intake monitoring). This could potentially reduce emergency transports and ease the burden on already understaffed care facilities. However, for such predictions to be useful in practice, false positives must be suppressed. Because deterioration events are rare, class imbalance generates an excess of false positives, causing alert fatigue and increasing the risk that actual events go unnoticed. To address these challenges, we propose an outcome-based contrastive loss that contrasts actual deteriorating samples against false alarms conditioned on mini-batch prediction outcomes. The proposed loss contracts same-label pairs to shape local structure within each ground-truth label. The loss also separates actual deteriorating samples from false alarms among samples predicted as deteriorating, thereby directly reducing unnecessary alerts. As a result, compared with random oversampling with standard cross-entropy, the proposed model improved precision from 3.97% to 12.94% (+8.97 percentage points), while limiting the F1-score decrease to 0.71 percentage points (from 7.28% to 6.57%). Pair-design ablations and UMAP projections supported this mechanism by indicating clearer separation between actually deteriorating and false-alarm samples in the learned representation space. These results suggest a viable direction for alert systems that produce fewer unnecessary alerts, reducing alert fatigue and supporting more reliable deterioration detection in care settings.
- Open Access
- 30 April 2026
- Published by MDPI AG in Healthcare
- Vol. 14 (9) , 1208
Job Satisfaction Among Frontline Caregivers: The Mediating Role of Psychological Safety and Personality Traits
Background: Job satisfaction remains a persistent concern in care facilities, where frontline caregivers work in highly relational and emotionally demanding environments. Although both personality traits and psychological safety have been associated with job satisfaction, their relative contributions and potential interrelationships in routine care settings remain unclear. Methods: Drawing on organizational and psychological theory, we hypothesized a priori that personality traits, psychological safety, and job satisfaction would be statistically associated, with psychological safety mediating the relationship between personality traits and job satisfaction. A cross-sectional questionnaire survey was conducted in care facilities, and the final analytical sample consisted of 183 frontline caregivers selected according to predefined inclusion criteria. Structural equation modeling (SEM) was used to test the hypothesized mediation model. Group comparison analyses examined differences in psychological safety across levels of job satisfaction. In addition, machine learning models were applied to explore predictive patterns among personality traits, psychological safety, and job satisfaction. Results: In the SEM analyses, psychological safety was significantly associated with job satisfaction ( = 0.207, p < 0.05), although the effect size was modest. Personality traits did not show direct associations with job satisfaction. Instead, agreeableness ( = 0.232, p < 0.01) and neuroticism ( = −0.235, p < 0.01) were associated with psychological safety, which, in turn, was related to job satisfaction. Bootstrap resampling supported the presence of significant indirect associations. At the item level, communication-related aspects of psychological safety were particularly salient. Caregivers with different levels of job satisfaction differed most clearly in communication-related items. Consistent with this pattern, exploratory machine learning analyses (XGBoost) also identified psychological safety as a more important predictor of job satisfaction than personality traits. Conclusions: These findings suggest that, among frontline caregivers working in healthcare facilities, psychological safety was more closely associated with job satisfaction than individual personality traits. In particular, the ability to speak openly and raise concerns was more strongly associated with higher levels of job satisfaction within this care context. Personality traits were associated with job satisfaction primarily through their relationship with psychological safety rather than through direct associations.- 30 April 2026
- Published by MDPI AG in Healthcare
- Vol. 14 (9) , 1208
Open AccessJob Satisfaction Among Frontline Caregivers: The Mediating Role of Psychological Safety and Personality Traits
Background: Job satisfaction remains a persistent concern in care facilities, where frontline caregivers work in highly relational and emotionally demanding environments. Although both personality traits and psychological safety have been associated with job satisfaction, their relative contributions and potential interrelationships in routine care settings remain unclear. Methods: Drawing on organizational and psychological theory, we hypothesized a priori that personality traits, psychological safety, and job satisfaction would be statistically associated, with psychological safety mediating the relationship between personality traits and job satisfaction. A cross-sectional questionnaire survey was conducted in care facilities, and the final analytical sample consisted of 183 frontline caregivers selected according to predefined inclusion criteria. Structural equation modeling (SEM) was used to test the hypothesized mediation model. Group comparison analyses examined differences in psychological safety across levels of job satisfaction. In addition, machine learning models were applied to explore predictive patterns among personality traits, psychological safety, and job satisfaction. Results: In the SEM analyses, psychological safety was significantly associated with job satisfaction ( = 0.207, p < 0.05), although the effect size was modest. Personality traits did not show direct associations with job satisfaction. Instead, agreeableness ( = 0.232, p < 0.01) and neuroticism ( = −0.235, p < 0.01) were associated with psychological safety, which, in turn, was related to job satisfaction. Bootstrap resampling supported the presence of significant indirect associations. At the item level, communication-related aspects of psychological safety were particularly salient. Caregivers with different levels of job satisfaction differed most clearly in communication-related items. Consistent with this pattern, exploratory machine learning analyses (XGBoost) also identified psychological safety as a more important predictor of job satisfaction than personality traits. Conclusions: These findings suggest that, among frontline caregivers working in healthcare facilities, psychological safety was more closely associated with job satisfaction than individual personality traits. In particular, the ability to speak openly and raise concerns was more strongly associated with higher levels of job satisfaction within this care context. Personality traits were associated with job satisfaction primarily through their relationship with psychological safety rather than through direct associations. - Open Access
- 2 April 2026
- Published by JMIR Publications Inc. in JMIR Aging
- Vol. 9, e80102
Integrating Care Context With Skeleton and Depth Information for Older Adult Activity Recognition in a Care Facility Using Care-Assessment-Aware Spatiotemporal Transformer: Method and Validation Study
Background: Older adult activity recognition is a critical task in long-term care monitoring; yet, it remains challenging due to postural deformities and health-related variability. These factors cause different activities to appear visually similar, or the same activity to appear dissimilar, undermining the effectiveness of traditional human activity recognition models developed for the general population. Objective: This study aims to develop an improved older adult activity recognition method that integrates care assessment information with motion data to capture and understand movement variability arising from different health conditions. Methods: To achieve our objective, we propose a care-assessment-aware spatiotemporal transformer (CSTT) model that integrates body key points, heatmaps, and care level data for personalized and context-aware activity recognition. The model dynamically adjusts its attention mechanism based on care level context to improve recognition accuracy. CSTT was trained and validated on real-world older adult motion data. A total of 51 older adult participants (30 men and 21 women; age range of 64-95 years) were included in the study. Among them, 7 (13.7%) required high care assistance, 26 (51.0%) required medium care assistance, and 18 (35.3%) required low care assistance. Results: Despite data imbalance and considerable intraclass variation due to differing care needs, the proposed CSTT model achieved an F1-score and accuracy of 0.96 and area under the curve is 0.98. Analysis revealed that movement patterns differ significantly across care levels and that similar motions occur in distinct activities, highlighting the importance of care-aware modeling. Conclusions: Incorporating care level information into activity recognition models significantly enhances performance in older adult care settings. The proposed CSTT framework demonstrates the value of personalized, context-sensitive approaches for accurate and ethical monitoring in long-term care environments.
- 2 April 2026
- Published by JMIR Publications Inc. in JMIR Aging
- Vol. 9, e80102
Open AccessIntegrating Care Context With Skeleton and Depth Information for Older Adult Activity Recognition in a Care Facility Using Care-Assessment-Aware Spatiotemporal Transformer: Method and Validation Study
Background: Older adult activity recognition is a critical task in long-term care monitoring; yet, it remains challenging due to postural deformities and health-related variability. These factors cause different activities to appear visually similar, or the same activity to appear dissimilar, undermining the effectiveness of traditional human activity recognition models developed for the general population. Objective: This study aims to develop an improved older adult activity recognition method that integrates care assessment information with motion data to capture and understand movement variability arising from different health conditions. Methods: To achieve our objective, we propose a care-assessment-aware spatiotemporal transformer (CSTT) model that integrates body key points, heatmaps, and care level data for personalized and context-aware activity recognition. The model dynamically adjusts its attention mechanism based on care level context to improve recognition accuracy. CSTT was trained and validated on real-world older adult motion data. A total of 51 older adult participants (30 men and 21 women; age range of 64-95 years) were included in the study. Among them, 7 (13.7%) required high care assistance, 26 (51.0%) required medium care assistance, and 18 (35.3%) required low care assistance. Results: Despite data imbalance and considerable intraclass variation due to differing care needs, the proposed CSTT model achieved an F1-score and accuracy of 0.96 and area under the curve is 0.98. Analysis revealed that movement patterns differ significantly across care levels and that similar motions occur in distinct activities, highlighting the importance of care-aware modeling. Conclusions: Incorporating care level information into activity recognition models significantly enhances performance in older adult care settings. The proposed CSTT framework demonstrates the value of personalized, context-sensitive approaches for accurate and ethical monitoring in long-term care environments.
- 1 April 2026
- Published by Springer Nature
- p. 230-244
Sample Selection Strategy for Synthetic Data Generation on Gesture Phase Recognition
- 1 April 2026
- Published by Springer Nature
- p. 230-244
Sample Selection Strategy for Synthetic Data Generation on Gesture Phase Recognition
- 12 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 26 (4) , 6173-6187
Position-Aware Indoor Human Activity Recognition and Fall Detection
With increasing life expectancy, particularly in developed nations, the proportion of elderly individuals is rising rapidly, necessitating advanced systems for continuous monitoring and timely intervention to support independent living and enhance safety in assisted care environments. Falls are among the leading causes of hospitalizations and deaths related to injuries in this demographic, highlighting the urgent need for intelligent fall detection systems. However, most existing solutions struggle with real-world deployment due to incomplete anomaly modeling and a lack of contextual location awareness. This article introduces a novel position-aware indoor activity recognition and fall detection approach that uses spatial and motion data to detect falls with high accuracy and contextual relevance. The system integrates ultrawideband (UWB) positioning technology with a multilayer perceptron (MLP) model to achieve indoor localization. Furthermore, accelerometer and gyroscope data are used for activity monitoring, which is processed using a hybrid deep learning (DL) architecture that combines a variational autoencoder (VAE), convolutional neural networks (CNNs), and long short-term memory (LSTM) networks. This architecture takes advantage of temporal and spatial feature extraction for improved fall detection. The localization module achieves over 96% accuracy. For activity recognition, the VAE CNN-LSTM model achieves fall detection accuracy exceeding 97%. A late fusion decision layer combines spatial and activity-level insights to enable precise detection and localization of fall events within indoor environments. The proposed system is validated in a real-world smart home setting and demonstrates strong performance in terms of accuracy, scalability, and adaptability.
- 12 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 26 (4) , 6173-6187
Position-Aware Indoor Human Activity Recognition and Fall Detection
With increasing life expectancy, particularly in developed nations, the proportion of elderly individuals is rising rapidly, necessitating advanced systems for continuous monitoring and timely intervention to support independent living and enhance safety in assisted care environments. Falls are among the leading causes of hospitalizations and deaths related to injuries in this demographic, highlighting the urgent need for intelligent fall detection systems. However, most existing solutions struggle with real-world deployment due to incomplete anomaly modeling and a lack of contextual location awareness. This article introduces a novel position-aware indoor activity recognition and fall detection approach that uses spatial and motion data to detect falls with high accuracy and contextual relevance. The system integrates ultrawideband (UWB) positioning technology with a multilayer perceptron (MLP) model to achieve indoor localization. Furthermore, accelerometer and gyroscope data are used for activity monitoring, which is processed using a hybrid deep learning (DL) architecture that combines a variational autoencoder (VAE), convolutional neural networks (CNNs), and long short-term memory (LSTM) networks. This architecture takes advantage of temporal and spatial feature extraction for improved fall detection. The localization module achieves over 96% accuracy. For activity recognition, the VAE CNN-LSTM model achieves fall detection accuracy exceeding 97%. A late fusion decision layer combines spatial and activity-level insights to enable precise detection and localization of fall events within indoor environments. The proposed system is validated in a real-world smart home setting and demonstrates strong performance in terms of accuracy, scalability, and adaptability.
- Open Access
Context-Aware Alerting in Elderly Care Facilities: A Hybrid Framework Integrating LLM Reasoning with Rule-Based Logic
The rising demand for elderly care amid ongoing nursing shortages has highlighted the limitations of conventional alert systems, which frequently generate excessive alerts and contribute to alarm fatigue. The objective of this study is to develop a hybrid, context-aware nurse alerting framework for long-term care (LTC) facilities that minimizes redundant alarms, reduces alarm fatigue, and enhances patient safety and caregiving balance during multi-person care scenarios such as mealtimes. To do so, we aimed to intelligently suppress, delay, and validate alerts by integrating rule-based logic with Large Language Model (LLM)-driven semantic reasoning. We conducted an experimental study in a real-world LTC environment involving 28 elderly residents (6 high, 8 medium, and 14 low care levels) and four nurses across three rooms over seven days. The proposed system utilizes video-derived skeletal motion, care-level annotations, and dynamic nurse–elderly proximity for decision making. Statistical analyses were performed using F1 score, accuracy, false positive rate (FPR), and false negative rate (FNR) to evaluate performance improvements. Compared to the baseline where all nurses were notified (100% alarm load), the proposed method reduced average alarm load to 27.5%, achieving a 72.5% reduction, with suppression rates reaching 100% in some rooms for some nurses. Performance metrics further validate the system’s effectiveness: the macro F1 score improved from 0.18 (baseline) to 0.97, while accuracy rose from 0.21 (baseline) to 0.98. Compared to the baseline error rates (FPR 0.20, FNR 0.79), the proposed method achieved drastically lower values (FPR 0.005, FNR 0.023). Across both spatial (room-level) and temporal (day-level) validations, the proposed approach consistently outperformed baseline and purely rule-based methods. These findings demonstrate that the proposed approach effectively minimizes false alarms while maintaining strong operational efficiency. By integrating rule-based mechanisms with LLM-based contextual reasoning, the framework significantly enhances alert accuracy, mitigates alarm fatigue, and promotes safer, more sustainable, and human-centered care practices, making it suitable for practical deployment within real-world long-term care environments.
Open AccessContext-Aware Alerting in Elderly Care Facilities: A Hybrid Framework Integrating LLM Reasoning with Rule-Based Logic
The rising demand for elderly care amid ongoing nursing shortages has highlighted the limitations of conventional alert systems, which frequently generate excessive alerts and contribute to alarm fatigue. The objective of this study is to develop a hybrid, context-aware nurse alerting framework for long-term care (LTC) facilities that minimizes redundant alarms, reduces alarm fatigue, and enhances patient safety and caregiving balance during multi-person care scenarios such as mealtimes. To do so, we aimed to intelligently suppress, delay, and validate alerts by integrating rule-based logic with Large Language Model (LLM)-driven semantic reasoning. We conducted an experimental study in a real-world LTC environment involving 28 elderly residents (6 high, 8 medium, and 14 low care levels) and four nurses across three rooms over seven days. The proposed system utilizes video-derived skeletal motion, care-level annotations, and dynamic nurse–elderly proximity for decision making. Statistical analyses were performed using F1 score, accuracy, false positive rate (FPR), and false negative rate (FNR) to evaluate performance improvements. Compared to the baseline where all nurses were notified (100% alarm load), the proposed method reduced average alarm load to 27.5%, achieving a 72.5% reduction, with suppression rates reaching 100% in some rooms for some nurses. Performance metrics further validate the system’s effectiveness: the macro F1 score improved from 0.18 (baseline) to 0.97, while accuracy rose from 0.21 (baseline) to 0.98. Compared to the baseline error rates (FPR 0.20, FNR 0.79), the proposed method achieved drastically lower values (FPR 0.005, FNR 0.023). Across both spatial (room-level) and temporal (day-level) validations, the proposed approach consistently outperformed baseline and purely rule-based methods. These findings demonstrate that the proposed approach effectively minimizes false alarms while maintaining strong operational efficiency. By integrating rule-based mechanisms with LLM-based contextual reasoning, the framework significantly enhances alert accuracy, mitigates alarm fatigue, and promotes safer, more sustainable, and human-centered care practices, making it suitable for practical deployment within real-world long-term care environments.
- Open Access
- 12 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 1082-1088
Two-Stage Reservoir Computing for Sensor-Specific Activity Recognition Using the WEAR Inertial Dataset
- 12 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 1082-1088
Open AccessTwo-Stage Reservoir Computing for Sensor-Specific Activity Recognition Using the WEAR Inertial Dataset
- Open Access
- 4 July 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Integrating Care Context With Skeleton and Depth Information for Older Adult Activity Recognition in a Care Facility Using Care-Assessment-Aware Spatiotemporal Transformer: Method and Validation Study (Preprint)
BACKGROUND Older adult activity recognition is a critical task in long-term care monitoring; yet, it remains challenging due to postural deformities and health-related variability. These factors cause different activities to appear visually similar, or the same activity to appear dissimilar, undermining the effectiveness of traditional human activity recognition models developed for the general population. OBJECTIVE This study aims to develop an improved older adult activity recognition method that integrates care assessment information with motion data to capture and understand movement variability arising from different health conditions. METHODS To achieve our objective, we propose a care-assessment-aware spatiotemporal transformer (CSTT) model that integrates body key points, heatmaps, and care level data for personalized and context-aware activity recognition. The model dynamically adjusts its attention mechanism based on care level context to improve recognition accuracy. CSTT was trained and validated on real-world older adult motion data. A total of 51 older adult participants (30 men and 21 women; age range of 64-95 years) were included in the study. Among them, 7 (13.7%) required high care assistance, 26 (51.0%) required medium care assistance, and 18 (35.3%) required low care assistance. RESULTS Despite data imbalance and considerable intraclass variation due to differing care needs, the proposed CSTT model achieved an F1-score and accuracy of 0.96 and area under the curve is 0.98. Analysis revealed that movement patterns differ significantly across care levels and that similar motions occur in distinct activities, highlighting the importance of care-aware modeling. CONCLUSIONS Incorporating care level information into activity recognition models significantly enhances performance in older adult care settings. The proposed CSTT framework demonstrates the value of personalized, context-sensitive approaches for accurate and ethical monitoring in long-term care environments. CLINICALTRIAL
- 4 July 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessIntegrating Care Context With Skeleton and Depth Information for Older Adult Activity Recognition in a Care Facility Using Care-Assessment-Aware Spatiotemporal Transformer: Method and Validation Study (Preprint)
BACKGROUND Older adult activity recognition is a critical task in long-term care monitoring; yet, it remains challenging due to postural deformities and health-related variability. These factors cause different activities to appear visually similar, or the same activity to appear dissimilar, undermining the effectiveness of traditional human activity recognition models developed for the general population. OBJECTIVE This study aims to develop an improved older adult activity recognition method that integrates care assessment information with motion data to capture and understand movement variability arising from different health conditions. METHODS To achieve our objective, we propose a care-assessment-aware spatiotemporal transformer (CSTT) model that integrates body key points, heatmaps, and care level data for personalized and context-aware activity recognition. The model dynamically adjusts its attention mechanism based on care level context to improve recognition accuracy. CSTT was trained and validated on real-world older adult motion data. A total of 51 older adult participants (30 men and 21 women; age range of 64-95 years) were included in the study. Among them, 7 (13.7%) required high care assistance, 26 (51.0%) required medium care assistance, and 18 (35.3%) required low care assistance. RESULTS Despite data imbalance and considerable intraclass variation due to differing care needs, the proposed CSTT model achieved an F1-score and accuracy of 0.96 and area under the curve is 0.98. Analysis revealed that movement patterns differ significantly across care levels and that similar motions occur in distinct activities, highlighting the importance of care-aware modeling. CONCLUSIONS Incorporating care level information into activity recognition models significantly enhances performance in older adult care settings. The proposed CSTT framework demonstrates the value of personalized, context-sensitive approaches for accurate and ethical monitoring in long-term care environments. CLINICALTRIAL
- Open Access
Few-Shot Optimization for Sensor Data Using Large Language Models: A Case Study on Fatigue Detection
In this paper, we propose a novel few-shot optimization with Hybrid Euclidean Distance with Large Language Models (HED-LM) to improve example selection for sensor-based classification tasks. While few-shot prompting enables efficient inference with limited labeled data, its performance largely depends on the quality of selected examples. HED-LM addresses this challenge through a hybrid selection pipeline that filters candidate examples based on Euclidean distance and re-ranks them using contextual relevance scored by large language models (LLMs). To validate its effectiveness, we apply HED-LM to a fatigue detection task using accelerometer data characterized by overlapping patterns and high inter-subject variability. Unlike simpler tasks such as activity recognition, fatigue detection demands more nuanced example selection due to subtle differences in physiological signals. Our experiments show that HED-LM achieves a mean macro F1-score of 69.13 ± 10.71%, outperforming both random selection (59.30 ± 10.13%) and distance-only filtering (67.61 ± 11.39%). These represent relative improvements of 16.6% and 2.3%, respectively. The results confirm that combining numerical similarity with contextual relevance improves the robustness of few-shot prompting. Overall, HED-LM offers a practical solution to improve performance in real-world sensor-based learning tasks and shows potential for broader applications in healthcare monitoring, human activity recognition, and industrial safety scenarios.
Open AccessFew-Shot Optimization for Sensor Data Using Large Language Models: A Case Study on Fatigue Detection
In this paper, we propose a novel few-shot optimization with Hybrid Euclidean Distance with Large Language Models (HED-LM) to improve example selection for sensor-based classification tasks. While few-shot prompting enables efficient inference with limited labeled data, its performance largely depends on the quality of selected examples. HED-LM addresses this challenge through a hybrid selection pipeline that filters candidate examples based on Euclidean distance and re-ranks them using contextual relevance scored by large language models (LLMs). To validate its effectiveness, we apply HED-LM to a fatigue detection task using accelerometer data characterized by overlapping patterns and high inter-subject variability. Unlike simpler tasks such as activity recognition, fatigue detection demands more nuanced example selection due to subtle differences in physiological signals. Our experiments show that HED-LM achieves a mean macro F1-score of 69.13 ± 10.71%, outperforming both random selection (59.30 ± 10.13%) and distance-only filtering (67.61 ± 11.39%). These represent relative improvements of 16.6% and 2.3%, respectively. The results confirm that combining numerical similarity with contextual relevance improves the robustness of few-shot prompting. Overall, HED-LM offers a practical solution to improve performance in real-world sensor-based learning tasks and shows potential for broader applications in healthcare monitoring, human activity recognition, and industrial safety scenarios.