ZLZhiyang Lu

Zhiyang Lu

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Zhiyang Lu has a total of 13 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Two-Stage Self-Supervised Cycle-Consistency Transformer Network for Reducing Slice Gap in MR Images

    by Zhiyang Lu, Jian Wang, Zheng Li, Shihui Ying, Jun Wang, Jun Shi, Dinggang Shen

    Magnetic resonance (MR) images are usually acquired with large slice gap in clinical practice, i.e. , low resolution (LR) along the through-plane direction. It is feasible to reduce the slice gap and reconstruct high-resolution (HR) images with the deep learning (DL) methods. To this end, the paired LR and HR images are generally required to train a DL model in a popular fully supervised manner. However, since the HR images are hardly acquired in clinical routine, it is difficult to get sufficient paired samples to train a robust model. Moreover, the widely used convolutional Neural Network (CNN) still cannot capture long-range image dependencies to combine useful information of similar contents, which are often spatially far away from each other across neighboring slices. To this end, a Two-stage Self-supervised Cycle-consistency Transformer Network (TSCTNet) is proposed to reduce the slice gap for MR images in this work. A novel self-supervised learning (SSL) strategy is designed with two stages respectively for robust network pre-training and specialized network refinement based on a cycle-consistency constraint. A hybrid Transformer and CNN structure is utilized to build an interpolation model, which explores both local and global slice representations. The experimental results on two public MR image datasets indicate that TSCTNet achieves superior performance over other compared SSL-based algorithms.


  • Open Access

    A Self-Supervised Learning Based Channel Attention MLP-Mixer Network for Motor Imagery Decoding

    by Yanbin He, Zhiyang Lu, Jun Wang, Shihui Ying, Jun Shi

    Convolutional Neural Network (CNN) is commonly used for the Electroencephalogram (EEG) based motor-imagery (MI) decoding. However, its performance is generally limited due to the small size sample problem. An alternative way to address such issue is to segment EEG trials into small slices for data augmentation, but this approach usually inevitably loses the valuable long-range dependencies of temporal information in EEG signals. To this end, we propose a novel self-supervised learning (SSL) based channel attention MLP-Mixer network (S-CAMLP-Net) for MI decoding with EEG. Specifically, a new EEG slice prediction task is designed as the pretext task to capture the long-range information of EEG trials in the time domain. In the downstream task, a newly proposed MLP-Mixer is applied to the classification task for signals rather than for images. Moreover, in order to effectively learn the discriminative spatial representations in EEG slices, an attention mechanism is integrated into MLP-Mixer to adaptively estimate the importance of each EEG channel without any prior information. Thus, the proposed S-CAMLP-Net can effectively learn more long-range temporal information and global spatial features of EEG signals. Extensive experiments are conducted on the public MI-2 dataset and the BCI Competition IV Dataset 2A. The experimental results indicate that our proposed S-CAMLP-Net achieves superior classification performance over all the compared algorithms.


  • S2Q-Net: Mining the High-Pass Filtered Phase Data in Susceptibility Weighted Imaging for Quantitative Susceptibility Mapping

    by Zhiyang Lu, Jun Li, Chaoyue Wang, Rongjun Ge, Lili Chen, Hongjian He, Jun Shi

    Susceptibility weighted imaging (SWI) is a routine magnetic resonance imaging (MRI) sequence that combines the magnitude and high-pass filtered phase images to qualitatively enhance the image contrasts related to tissue susceptibility. Tremendous amounts of the high-pass filtered phase data with low signal to noise ratio and incomplete background field removal have thus been collected under default clinical settings. Since SWI cannot quantitatively estimate the susceptibility, it is thus non-trivial to derive quantitative susceptibility mapping (QSM) directly from these redundant phase data, which effectively promotes the mining of the SWI data collected previously. To this end, a novel deep learning based SWI-to-QSM-Net (S2Q-Net) is proposed for QSM reconstruction from SWI high-pass filtered phase data. S2Q-Net firstly estimates the edge maps of QSM to integrate edge prior into features, which benefits the network to reconstruct QSM with realistic and clear tissue boundaries. Furthermore, a novel Second-order Cross Dense Block is proposed in S2Q-Net, which can capture rich inter-region interactions to provide more non-local phase information related to local tissue susceptibility. Experimental results on both simulated and in-vivo data indicate its superiority over all the compared deep learning based QSM reconstruction methods.


  • A Convolutional Neural Network and Graph Convolutional Network Based Framework for Classification of Breast Histopathological Images

    by Zhiyang Gao, Zhiyang Lu, Jun Wang, Shihui Ying, Jun Shi

    The spatial correlation among different tissue components is an essential characteristic for diagnosis of breast cancers based on histopathological images. Graph convolutional network (GCN) can effectively capture this spatial feature representation, and has been successfully applied to the histopathological image based computer-aided diagnosis (CAD). However, the current GCN-based approaches need complicated image preprocessing for graph construction. In this work, we propose a novel CAD framework for classification of breast histopathological images, which integrates both convolutional neural network (CNN) and GCN (named CNN-GCN) into a unified framework, where CNN learns high-level features from histopathological images for further adaptive graph construction, and the generated graph is then fed to GCN to learn the spatial features of histopathological images for the classification task. In particular, a novel clique GCN (cGCN) is proposed to learn more effective graph representation, which can arrange both forward and backward connections between any two graph convolution layers. Moreover, a new group graph convolution is further developed to replace the classical graph convolution of each layer in cGCN, so as to reduce redundant information and implicitly select superior fused feature representation. The proposed clique group GCN (cgGCN) is then embedded in the CNN-GCN framework (named CNN-cgGCN) to promote the learned spatial representation for diagnosis of breast cancers. The experimental results on two public breast histopathological image datasets indicate the effectiveness of the proposed CNN-cgGCN with superior performance to all the compared algorithms.


  • Meta-Learning Based Interactively Connected Clique U-Net for Quantitative Susceptibility Mapping

    by Zheng Li, Jun Li, Chaoyue Wang, Zhiyang Lu, Jun Wang, Hongjian He, Jun Shi

    Quantitative susceptibility mapping (QSM) is a phase-based magnetic resonance imaging (MRI) technique that quantitatively estimates magnetic susceptibility values of tissues and has shown great potential in clinical practice. However, the ill-posed dipole inversion greatly affects the estimation accuracy of the susceptibility values. In this work, an interactively connected clique U-Net (named ICCU-Net) is proposed to perform the nonlinear mapping from single-echo phase maps to QSM maps. The interactive connection provides hierarchical feature fusions and multi-scale representations for the recovery of detailed tissue and edges, while the embedded clique block further promotes the gradients and information flow. Besides, the time-consuming data acquisition results in small amounts of in-vivo data, which degrades the performance of the deep Learning (DL) based QSM reconstruction algorithm. A novel two-stage meta-learning strategy is further proposed for the ICCU-Net to promote the reconstruction quality with limited in-vivo data. Benefiting from large quantities of self-generated synthetic data, the ICCU-Net effectively learns the nonlinear mapping through multiple meta-tasks as the prior knowledge in the first-stage meta-learning. The learned model is then further improved on the in-vivo data through the second-stage meta-learning instead of being directly applied on them to reduce the distribution differences between the in-vivo and synthetic data. This novel two-stage procedure alleviates the issue of insufficient in-vivo data and provides more accurate reconstructed QSM maps. The experimental results demonstrate that the proposed algorithm outperforms other conventional and DL-based QSM reconstruction algorithms.