Abstract
Accurate objective physical fatigue (OPF) assessment is critical for enhancing safety in labor-intensive industries, optimizing athletic performance, and supporting personalized health management. With the advancement of wearable sensing technologies, wearable OPF assessment methods based on multi-source information fusion is emerging is gradually becoming an critical approach for sports and health monitoring. However, wearable OPF assessment methods face the following challenges: spatial modeling deficiency, ineffective multimodal fusion and limited long-range dependency capture. To address these limitations, we propose DBMNet, a dual-branch multi-modal network with spatial-temporal fusion for fatigue level classification. DBMNet captures temporal dynamics and spatial patterns separately from raw 12-lead electrocardiogram (ECG) and multi-site inertial measurement unit (IMU) signals. A novel Convolutional Additive Adaptive Cross-refinement Fusion (CAACF) module is introduced to enable adaptive, efficient, and interpretable fusion of heterogeneous modalities. We collected synchronized ECG and IMU data from 65 subjects during treadmill exercise following a modified Bruce protocol, annotated with both coarse- and fine-grained fatigue levels. Extensive experiments demonstrate that DBMNet achieves significant improvements over baseline and state-of-the-art methods, with up to 7% increase in classification accuracy and superior performance across multiple evaluation metrics. Moreover, DBMNet maintains a lightweight architecture suitable for deployment on mobile and wearable devices. This work provides an effective and scalable framework for real-time, objective fatigue monitoring using multi-source physiological signals.
Funding Information
  • Key Research and Development Plan of Guangdong Province (2022B1515120062)
  • Shenzhen International Cooperation Project (GJHZ20220913142808016)
  • Shenzhen Sustainable Development Special Project (KCXFZ20230731094100001)
  • Shenzhen Sustainable Development Special Project (KCXFZ20240903094300001)
  • Joint Fund of NSFC and Chongqing (U21A20447)
  • Joint Fund of Yeqisun and NSFC (U2241210)
  • International Collaboration Fund for Creative Research Teams (W2541011)

This publication has 38 references indexed in Scilit: