XZXiaobiao Zhang

Xiaobiao Zhang

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Xiaobiao Zhang has a total of 7 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Illumination Variation-Resistant Network for Heart Rate Measurement by Exploring RGB and MSR Spaces

    by Lili Liu, Zhaoqiang Xia, Xiaobiao Zhang, Xiaoyi Feng, Guoying Zhao

    Remote photoplethysmography (rPPG) is an essential way of monitoring the physiological indicator heart rate (HR), which has important guiding significance for preventing and controlling cardiovascular diseases. However, most existing HR measurement approaches require ideal illumination conditions, and the illumination variation in a realistic situation is complicated. In view of this issue, this article proposes a robust HR measurement method to reduce performance degradation due to unstable illumination in facial videos. Specifically, two complementary color spaces [RGB and multiscale retinex (MSR)] are abundantly utilized by exploring the potential of space-shared information and space-specific characteristics. Subsequently, the time-space Transformer with sequential feature aggregation (TST-SFA) is exploited to extract physiological signal features. In addition, a novel optimization strategy for model learning, including affinity variation, discrepancy, and task losses, is proposed to train the whole algorithm in an end-to-end manner jointly. Experimental results on three public datasets show that our proposed method outperforms other approaches and can achieve more accurate HR measurement under different illuminations. The code will be released at https://github.com/Llili314/IRHrNet .


  • MSDN: A Multistage Deep Network for Heart-Rate Estimation From Facial Videos

    by Xiaobiao Zhang, Zhaoqiang Xia, Jing Dai, Lili Liu, Jinye Peng, Xiaoyi Feng

    Noncontact heart rate (HR) measurement is a very important trend in clinical medicine. Recently, a variety of deep networks have been applied to estimate HRs from facial videos. However, due to limited data resources and poor parameter optimization, few existing models have achieved incredible performance in complicated scenarios, such as those with illumination changes, different skin tones, and facial motion. To address these challenges, this paper proposes a novel multi-stage deep network (MSDN) that can decentralize the learnable parameters into different stages to reduce the difficulty of learning through multiple training steps. Specifically, the proposed network consists of three stages in an end-to-end way. In the first stage, an HR-aware feature extractor utilizes the next convolutional neural network (ConvNeXt) embedded with a newly designed bandpass filter as its backbone to extract spatial-temporal features for determining heart rate changes. Moreover, pseudolabels are generated to make the features compatible with illumination, motion, and color variance. In the second stage, various modules, including singular value decomposition (SVD) pooling and enhanced difference convolution modules, are then designed and combined with a Transformer encoder to construct a feature-compressed remote photoplethysmography (rPPG) generator. In the third stage, an HR estimator with an interbeat interval analyzer and a 1D filter is newly designed for HR estimation. Extensive experiments are performed on three publicly available databases (i.e., VIPL-HR, COHFACE, and PURE), and the results demonstrate the effectiveness of the proposed method through ablation studies and comparison experiments with state-of-the-art (SOTA) methods.


  • Demodulation Based Transformer for rPPG Generation and Heart Rate Estimation

    by Xiaobiao Zhang, Zhaoqiang Xia, Lili Liu, Xiaoyi Feng

    As a convenient, efficient and inexpensive medical technology, heart rate (HR) estimation from face videos has gradually become a hot topic and many methods have been exploited to learn a spatial-temporal map for HR estimation. However, these methods have poor performance under time-varying ambient lighting. The main reason is that the current methods neglect the optical modeling of extracting the contactless physiological signal from skin. In this study, we describe the signal extraction as a modulation process and draw the conclusion that light changing could produce amplitude modulation jamming after modeling analysis. Therefore, a demodulation-based Transformer is newly designed for rPPG signal purification. In addition, a Pwelch-based Softmax operation is incorporated for HR estimation to improve accuracy. Finally, the hybrid loss combined with the negative Pearson correlation coefficient and cross-entropy loss is introduced for entire network learning. The experimental results on two databases (COHFACE and PURE) are performed to verify the effectiveness of the proposed method.


  • Information-Enhanced Network for Noncontact Heart Rate Estimation From Facial Videos

    by Lili Liu, Zhaoqiang Xia, Xiaobiao Zhang, Jinye Peng, Xiaoyi Feng, Guoying Zhao

    Remote photoplethysmography (rPPG) is a vital way of measuring heart rate (HR) to reflect human physical and mental health, which is useful for diagnosing cardiovascular and neurological diseases. Many non-contact HR estimation methods have been proposed gradually in recent years, but the majority of approaches are based on a single-modal HR information source, resulting in ineffective and unsatisfactory estimation results due to noise and insufficient information. This paper proposes a novel information-enhanced network for HR estimation based on multimodal (e.g., RGB and NIR) sources to address these problems. In the network, context and modal difference information are sequentially enhanced from spatiotemporal and modal views for accurately describing HR-aware features, while maximum frequency information is enhanced for inhibiting heartbeat noise. Specifically, a context-enhanced video Swin-Transformer (CET) module is exploited to extract useful rPPG signal features from facial visible-light and near-infrared videos. Then, a novel modal difference enhanced fusion (MDEF) module is designed to acquire a fused rPPG signal, which is taken as the input of the frequency-enhanced estimation (FEE) module to obtain the corresponding HR value. These three modules are integrated and jointly learned in an end-to-end way, and the multimodal combinations can provide highly complementary information for estimating HR value. Experimental and evaluation results on three multimodal datasets show that the proposed model achieves a superior effect compared to the state-of-the-art methods.