DRLFormer: A Data Rebalancing Loss-Constrained Light Transformer for OSA Detection

Authors:
Publisher website
Google Scholar
Abstract
Although Transformer-based methods have achieved significant success in Obstructive sleep apnea (OSA) detection, they suffer from higher computational costs, lower feature capturing ability in frequency domain, and class imbalance at the data level. To address these problems, this paper proposes a data rebalancing loss constrained light transformer for OSA detection, called DRLFormer. The core of the proposed method lies in the following two aspects: the development of the Additive Temporal-Frequency Fusion Attention (ATFA) module, and the propose of Data Re-balancing Loss (DRLoss) function. The purpose of the ATFA module is to fuse the frequency domain features extracted by the frequency domain enhancement module (FEM) with the important time domain features extracted by the learnable time domain attention (LTA) in a very low computational cost by novel using the summation strategy. The purpose of DRLoss is to solve the problem of imbalanced samples within batches which usually ignored by existing common used CrossEntropy loss (CELoss) . the novelty of the designing of DRLoss lies in by designing weight memory units (WMU), and allocatting different weights for correctly and incorrectly predicted samples to achieve prediction level balance through classification penalty item (CPI). Extensive experiments are conducted on the Apnea-ECG dataset, and compared with the state-of-the-art method. Our method achieving an improving by 0.44% in accuracy (from 91.68% improved to 92.12%) with a reduction of parameter size by 74% and FLOPs by 53%. Furthermore, the excellent performance was achieved on UCD, PhysioNet, and clinical XJ300 datasets, thoroughly verifying the effectiveness and clinical application potential of DRLFormer.
Funding Information
  • National Natural Science Foundation of China (62076198)
  • Key Natural Science Foundation of Shaanxi Province of China (2020GXLH-Y005)
  • Natural Science Foundation of Shaanxi Province of China (2020JM-463)

This publication has 46 references indexed in Scilit: