Zhiyang Lu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Zhiyang Lu has a total of 13 co-authors. Here are the top co-authors by number of shared publications:
- Jun Shi
School of Communication and Information Engineering, Shanghai University, Shanghai, China
5 shared publications - Jun Wang
School of Civil and Hydraulic Engineering, Hefei University of Technology, Hefei, China
4 shared publications - Shihui Ying
Shanghai University
3 shared publications - Chaoyue Wang
University of Oxford Centre for Integrative Neuroimaging (OxCIN), Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
2 shared publications - Hongjiang Wei
School of Physics, Zhejiang University, Hangzhou, China
2 shared publications Jun Li
Center for Brain Imaging Science and Technology, College of Biomedical Engineering and Instrumental Science, Zhejiang University, Zhejiang, China
2 shared publications
Latest Publications
- 1 May 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 27 (7) , 3337-3348
Two-Stage Self-Supervised Cycle-Consistency Transformer Network for Reducing Slice Gap in MR Images
Magnetic resonance (MR) images are usually acquired with large slice gap in clinical practice, i.e. , low resolution (LR) along the through-plane direction. It is feasible to reduce the slice gap and reconstruct high-resolution (HR) images with the deep learning (DL) methods. To this end, the paired LR and HR images are generally required to train a DL model in a popular fully supervised manner. However, since the HR images are hardly acquired in clinical routine, it is difficult to get sufficient paired samples to train a robust model. Moreover, the widely used convolutional Neural Network (CNN) still cannot capture long-range image dependencies to combine useful information of similar contents, which are often spatially far away from each other across neighboring slices. To this end, a Two-stage Self-supervised Cycle-consistency Transformer Network (TSCTNet) is proposed to reduce the slice gap for MR images in this work. A novel self-supervised learning (SSL) strategy is designed with two stages respectively for robust network pre-training and specialized network refinement based on a cycle-consistency constraint. A hybrid Transformer and CNN structure is utilized to build an interpolation model, which explores both local and global slice representations. The experimental results on two public MR image datasets indicate that TSCTNet achieves superior performance over other compared SSL-based algorithms.
- 1 May 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 27 (7) , 3337-3348
Two-Stage Self-Supervised Cycle-Consistency Transformer Network for Reducing Slice Gap in MR Images
Magnetic resonance (MR) images are usually acquired with large slice gap in clinical practice, i.e. , low resolution (LR) along the through-plane direction. It is feasible to reduce the slice gap and reconstruct high-resolution (HR) images with the deep learning (DL) methods. To this end, the paired LR and HR images are generally required to train a DL model in a popular fully supervised manner. However, since the HR images are hardly acquired in clinical routine, it is difficult to get sufficient paired samples to train a robust model. Moreover, the widely used convolutional Neural Network (CNN) still cannot capture long-range image dependencies to combine useful information of similar contents, which are often spatially far away from each other across neighboring slices. To this end, a Two-stage Self-supervised Cycle-consistency Transformer Network (TSCTNet) is proposed to reduce the slice gap for MR images in this work. A novel self-supervised learning (SSL) strategy is designed with two stages respectively for robust network pre-training and specialized network refinement based on a cycle-consistency constraint. A hybrid Transformer and CNN structure is utilized to build an interpolation model, which explores both local and global slice representations. The experimental results on two public MR image datasets indicate that TSCTNet achieves superior performance over other compared SSL-based algorithms.
- Open Access
- 17 August 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Systems and Rehabilitation Engineering
- Vol. 30 (15344320) , 2406-2417
A Self-Supervised Learning Based Channel Attention MLP-Mixer Network for Motor Imagery Decoding
Convolutional Neural Network (CNN) is commonly used for the Electroencephalogram (EEG) based motor-imagery (MI) decoding. However, its performance is generally limited due to the small size sample problem. An alternative way to address such issue is to segment EEG trials into small slices for data augmentation, but this approach usually inevitably loses the valuable long-range dependencies of temporal information in EEG signals. To this end, we propose a novel self-supervised learning (SSL) based channel attention MLP-Mixer network (S-CAMLP-Net) for MI decoding with EEG. Specifically, a new EEG slice prediction task is designed as the pretext task to capture the long-range information of EEG trials in the time domain. In the downstream task, a newly proposed MLP-Mixer is applied to the classification task for signals rather than for images. Moreover, in order to effectively learn the discriminative spatial representations in EEG slices, an attention mechanism is integrated into MLP-Mixer to adaptively estimate the importance of each EEG channel without any prior information. Thus, the proposed S-CAMLP-Net can effectively learn more long-range temporal information and global spatial features of EEG signals. Extensive experiments are conducted on the public MI-2 dataset and the BCI Competition IV Dataset 2A. The experimental results indicate that our proposed S-CAMLP-Net achieves superior classification performance over all the compared algorithms.
- 17 August 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Systems and Rehabilitation Engineering
- Vol. 30 (15344320) , 2406-2417
Open AccessA Self-Supervised Learning Based Channel Attention MLP-Mixer Network for Motor Imagery Decoding
Convolutional Neural Network (CNN) is commonly used for the Electroencephalogram (EEG) based motor-imagery (MI) decoding. However, its performance is generally limited due to the small size sample problem. An alternative way to address such issue is to segment EEG trials into small slices for data augmentation, but this approach usually inevitably loses the valuable long-range dependencies of temporal information in EEG signals. To this end, we propose a novel self-supervised learning (SSL) based channel attention MLP-Mixer network (S-CAMLP-Net) for MI decoding with EEG. Specifically, a new EEG slice prediction task is designed as the pretext task to capture the long-range information of EEG trials in the time domain. In the downstream task, a newly proposed MLP-Mixer is applied to the classification task for signals rather than for images. Moreover, in order to effectively learn the discriminative spatial representations in EEG slices, an attention mechanism is integrated into MLP-Mixer to adaptively estimate the importance of each EEG channel without any prior information. Thus, the proposed S-CAMLP-Net can effectively learn more long-range temporal information and global spatial features of EEG signals. Extensive experiments are conducted on the public MI-2 dataset and the BCI Competition IV Dataset 2A. The experimental results indicate that our proposed S-CAMLP-Net achieves superior classification performance over all the compared algorithms.
- 7 March 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 26 (8) , 3938-3949
S2Q-Net: Mining the High-Pass Filtered Phase Data in Susceptibility Weighted Imaging for Quantitative Susceptibility Mapping
Susceptibility weighted imaging (SWI) is a routine magnetic resonance imaging (MRI) sequence that combines the magnitude and high-pass filtered phase images to qualitatively enhance the image contrasts related to tissue susceptibility. Tremendous amounts of the high-pass filtered phase data with low signal to noise ratio and incomplete background field removal have thus been collected under default clinical settings. Since SWI cannot quantitatively estimate the susceptibility, it is thus non-trivial to derive quantitative susceptibility mapping (QSM) directly from these redundant phase data, which effectively promotes the mining of the SWI data collected previously. To this end, a novel deep learning based SWI-to-QSM-Net (S2Q-Net) is proposed for QSM reconstruction from SWI high-pass filtered phase data. S2Q-Net firstly estimates the edge maps of QSM to integrate edge prior into features, which benefits the network to reconstruct QSM with realistic and clear tissue boundaries. Furthermore, a novel Second-order Cross Dense Block is proposed in S2Q-Net, which can capture rich inter-region interactions to provide more non-local phase information related to local tissue susceptibility. Experimental results on both simulated and in-vivo data indicate its superiority over all the compared deep learning based QSM reconstruction methods.
- 7 March 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 26 (8) , 3938-3949
S2Q-Net: Mining the High-Pass Filtered Phase Data in Susceptibility Weighted Imaging for Quantitative Susceptibility Mapping
Susceptibility weighted imaging (SWI) is a routine magnetic resonance imaging (MRI) sequence that combines the magnitude and high-pass filtered phase images to qualitatively enhance the image contrasts related to tissue susceptibility. Tremendous amounts of the high-pass filtered phase data with low signal to noise ratio and incomplete background field removal have thus been collected under default clinical settings. Since SWI cannot quantitatively estimate the susceptibility, it is thus non-trivial to derive quantitative susceptibility mapping (QSM) directly from these redundant phase data, which effectively promotes the mining of the SWI data collected previously. To this end, a novel deep learning based SWI-to-QSM-Net (S2Q-Net) is proposed for QSM reconstruction from SWI high-pass filtered phase data. S2Q-Net firstly estimates the edge maps of QSM to integrate edge prior into features, which benefits the network to reconstruct QSM with realistic and clear tissue boundaries. Furthermore, a novel Second-order Cross Dense Block is proposed in S2Q-Net, which can capture rich inter-region interactions to provide more non-local phase information related to local tissue susceptibility. Experimental results on both simulated and in-vivo data indicate its superiority over all the compared deep learning based QSM reconstruction methods.
- 23 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 26 (7) , 3163-3173
A Convolutional Neural Network and Graph Convolutional Network Based Framework for Classification of Breast Histopathological Images
The spatial correlation among different tissue components is an essential characteristic for diagnosis of breast cancers based on histopathological images. Graph convolutional network (GCN) can effectively capture this spatial feature representation, and has been successfully applied to the histopathological image based computer-aided diagnosis (CAD). However, the current GCN-based approaches need complicated image preprocessing for graph construction. In this work, we propose a novel CAD framework for classification of breast histopathological images, which integrates both convolutional neural network (CNN) and GCN (named CNN-GCN) into a unified framework, where CNN learns high-level features from histopathological images for further adaptive graph construction, and the generated graph is then fed to GCN to learn the spatial features of histopathological images for the classification task. In particular, a novel clique GCN (cGCN) is proposed to learn more effective graph representation, which can arrange both forward and backward connections between any two graph convolution layers. Moreover, a new group graph convolution is further developed to replace the classical graph convolution of each layer in cGCN, so as to reduce redundant information and implicitly select superior fused feature representation. The proposed clique group GCN (cgGCN) is then embedded in the CNN-GCN framework (named CNN-cgGCN) to promote the learned spatial representation for diagnosis of breast cancers. The experimental results on two public breast histopathological image datasets indicate the effectiveness of the proposed CNN-cgGCN with superior performance to all the compared algorithms.
- 23 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 26 (7) , 3163-3173
A Convolutional Neural Network and Graph Convolutional Network Based Framework for Classification of Breast Histopathological Images
The spatial correlation among different tissue components is an essential characteristic for diagnosis of breast cancers based on histopathological images. Graph convolutional network (GCN) can effectively capture this spatial feature representation, and has been successfully applied to the histopathological image based computer-aided diagnosis (CAD). However, the current GCN-based approaches need complicated image preprocessing for graph construction. In this work, we propose a novel CAD framework for classification of breast histopathological images, which integrates both convolutional neural network (CNN) and GCN (named CNN-GCN) into a unified framework, where CNN learns high-level features from histopathological images for further adaptive graph construction, and the generated graph is then fed to GCN to learn the spatial features of histopathological images for the classification task. In particular, a novel clique GCN (cGCN) is proposed to learn more effective graph representation, which can arrange both forward and backward connections between any two graph convolution layers. Moreover, a new group graph convolution is further developed to replace the classical graph convolution of each layer in cGCN, so as to reduce redundant information and implicitly select superior fused feature representation. The proposed clique group GCN (cgGCN) is then embedded in the CNN-GCN framework (named CNN-cgGCN) to promote the learned spatial representation for diagnosis of breast cancers. The experimental results on two public breast histopathological image datasets indicate the effectiveness of the proposed CNN-cgGCN with superior performance to all the compared algorithms.
- 13 December 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Imaging
- Vol. 7 (25730436) , 1385-1399
Meta-Learning Based Interactively Connected Clique U-Net for Quantitative Susceptibility Mapping
Quantitative susceptibility mapping (QSM) is a phase-based magnetic resonance imaging (MRI) technique that quantitatively estimates magnetic susceptibility values of tissues and has shown great potential in clinical practice. However, the ill-posed dipole inversion greatly affects the estimation accuracy of the susceptibility values. In this work, an interactively connected clique U-Net (named ICCU-Net) is proposed to perform the nonlinear mapping from single-echo phase maps to QSM maps. The interactive connection provides hierarchical feature fusions and multi-scale representations for the recovery of detailed tissue and edges, while the embedded clique block further promotes the gradients and information flow. Besides, the time-consuming data acquisition results in small amounts of in-vivo data, which degrades the performance of the deep Learning (DL) based QSM reconstruction algorithm. A novel two-stage meta-learning strategy is further proposed for the ICCU-Net to promote the reconstruction quality with limited in-vivo data. Benefiting from large quantities of self-generated synthetic data, the ICCU-Net effectively learns the nonlinear mapping through multiple meta-tasks as the prior knowledge in the first-stage meta-learning. The learned model is then further improved on the in-vivo data through the second-stage meta-learning instead of being directly applied on them to reduce the distribution differences between the in-vivo and synthetic data. This novel two-stage procedure alleviates the issue of insufficient in-vivo data and provides more accurate reconstructed QSM maps. The experimental results demonstrate that the proposed algorithm outperforms other conventional and DL-based QSM reconstruction algorithms.
- 13 December 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Imaging
- Vol. 7 (25730436) , 1385-1399
Meta-Learning Based Interactively Connected Clique U-Net for Quantitative Susceptibility Mapping
Quantitative susceptibility mapping (QSM) is a phase-based magnetic resonance imaging (MRI) technique that quantitatively estimates magnetic susceptibility values of tissues and has shown great potential in clinical practice. However, the ill-posed dipole inversion greatly affects the estimation accuracy of the susceptibility values. In this work, an interactively connected clique U-Net (named ICCU-Net) is proposed to perform the nonlinear mapping from single-echo phase maps to QSM maps. The interactive connection provides hierarchical feature fusions and multi-scale representations for the recovery of detailed tissue and edges, while the embedded clique block further promotes the gradients and information flow. Besides, the time-consuming data acquisition results in small amounts of in-vivo data, which degrades the performance of the deep Learning (DL) based QSM reconstruction algorithm. A novel two-stage meta-learning strategy is further proposed for the ICCU-Net to promote the reconstruction quality with limited in-vivo data. Benefiting from large quantities of self-generated synthetic data, the ICCU-Net effectively learns the nonlinear mapping through multiple meta-tasks as the prior knowledge in the first-stage meta-learning. The learned model is then further improved on the in-vivo data through the second-stage meta-learning instead of being directly applied on them to reduce the distribution differences between the in-vivo and synthetic data. This novel two-stage procedure alleviates the issue of insufficient in-vivo data and provides more accurate reconstructed QSM maps. The experimental results demonstrate that the proposed algorithm outperforms other conventional and DL-based QSM reconstruction algorithms.