Biomarkers-Aware Asymmetric Bibranch GAN With Adaptive Memory Batch Normalization for Prediction of Anti-VEGF Treatment Response in Neovascular Age-Related Macular Degeneration
- 7 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 28 (1) , 557-568
Abstract
The emergence of anti-vascular endothelial growth factor (anti-VEGF) therapy has revolutionized neovascular age-related macular degeneration (nAMD). Post-therapeutic optical coherence tomography (OCT) imaging facilitates the prediction of therapeutic response to anti-VEGF therapy for nAMD. Although the generative adversarial network (GAN) is a popular generative model for post-therapeutic OCT image generation, it is realistically challenging to gather sufficient pre- and post-therapeutic OCT image pairs, resulting in overfitting. Moreover, the available GAN-based methods ignore local details, such as the biomarkers that are essential for nAMD treatment. To address these issues, a Biomarkers-aware Asymmetric Bibranch GAN (BAABGAN) is proposed to efficiently generate post-therapeutic OCT images. Specifically, one branch is developed to learn prior knowledge with a high degree of transferability from large-scale data, termed the source branch. Then, the source branch transfer knowledge to another branch, which is trained on small-scale paired data, termed the target branch. To boost the transferability, a novel Adaptive Memory Batch Normalization (AMBN) is introduced in the source branch, which learns more effective global knowledge that is impervious to noise via memory mechanism. Also, a novel Adaptive Biomarkers-aware Attention (ABA) module is proposed to encode biomarkers information into latent features of target branches to learn finer local details of biomarkers. The proposed method outperforms traditional GAN models and can produce high-quality post-treatment OCT pictures with limited data sets, as shown by the results of experiments.Keywords
Funding Information
- Science and Technology Innovation Program for Distinguished Young Scholars of Shandong Province Higher Education Institutions (2021KJ036)
- Major Basic Research Project of the Natural Science Foundation of Shandong Province (ZR2021ZD15)
- Natural Science Foundation of Shandong Province (ZR2022MF285)
- Shandong Provincial Natural Science Foundation for Distinguished Young Scholars (ZR2021JQ26)
- Taishan Scholar Project of Shandong Province (tsqn202103088)
- Shandong Jianzhu University
- Natural Science Foundation of ShandongProvince (ZR2020QF029)
- Shandong Jianzhu University
- National Natural Science Foundation of China (62102235, 82001987, 62176141)
This publication has 21 references indexed in Scilit:
- OPTICAL COHERENCE TOMOGRAPHY, FLUORESCEIN ANGIOGRAPHY, AND DIAGNOSIS OF CHOROIDAL NEOVASCULARIZATION IN AGE-RELATED MACULAR DEGENERATIONRetina, 2019
- Characterization of Poor Visual Outcomes of Neovascular Age-related Macular Degeneration Treated with Anti–Vascular Endothelial Growth Factor AgentsOphthalmology, 2019
- Group Normalization2018
- High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs2018
- Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep LearningCell, 2018
- AutoDIAL: Automatic Domain Alignment Layers2017
- Image-to-Image Translation with Conditional Adversarial Networks2017
- Macular Morphology and Visual Acuity in the Second Year of the Comparison of Age-Related Macular Degeneration Treatments TrialsOphthalmology, 2016
- A paradigm shift in imaging biomarkers in neovascular age-related macular degenerationProgress in Retinal and Eye Research, 2016
- A Survey on Transfer LearningIEEE Transactions on Knowledge and Data Engineering, 2009