Multimodal deep learning approaches for precision oncology: a comprehensive review
Top Cited Papers
Open Access
- 22 November 2024
- journal article
- review article
- Published by Oxford University Press (OUP) in Briefings in Bioinformatics
- Vol. 26 (1)
Abstract
The burgeoning accumulation of large-scale biomedical data in oncology, alongside significant strides in deep learning (DL) technologies, has established multimodal DL (MDL) as a cornerstone of precision oncology. This review provides an overview of MDL applications in this field, based on an extensive literature survey. In total, 651 articles published before September 2024 are included. We first outline publicly available multimodal datasets that support cancer research. Then, we discuss key DL training methods, data representation techniques, and fusion strategies for integrating multimodal data. The review also examines MDL applications in tumor segmentation, detection, diagnosis, prognosis, treatment selection, and therapy response monitoring. Finally, we critically assess the limitations of current approaches and propose directions for future research. By synthesizing current progress and identifying challenges, this review aims to guide future efforts in leveraging MDL to advance precision oncology.Keywords
Funding Information
- Municipal Government of Quzhou (2023D036)
- Zhejiang Provincial Natural Science Foundation of China (LD24F020004)
- Guangdong Medical Science and Technology Research Foundation (A2023002)
- National Natural Science Foundation of China (62131004, 62402207)
- National Key R&D Program of China (2022ZD0117700)
This publication has 92 references indexed in Scilit:
- Emerging role of deep learning‐based artificial intelligence in tumor pathologyCancer Communications, 2020
- Integrating genomic features for non-invasive early lung cancer detectionNature, 2020
- Deep learning for prediction of colorectal cancer outcome: a discovery and validation studyThe Lancet, 2020
- PET image denoising using unsupervised deep learningEuropean Journal of Nuclear Medicine and Molecular Imaging, 2019
- Deep learning with multimodal representation for pancancer prognosis predictionBioinformatics, 2019
- Expert-Level Diagnosis of Nonpigmented Skin Cancer by Combined Convolutional Neural NetworksJAMA Dermatology, 2019
- The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesionsScientific Data, 2018
- A deep learning model integrating FCNNs and CRFs for brain tumor segmentationMedical Image Analysis, 2018
- Spectral Multimodal Hashing and Its Application to Multimedia RetrievalIEEE Transactions on Cybernetics, 2015
- Economic Burden of Cancer in the United States: Estimates, Projections, and Future ResearchCancer Epidemiology, Biomarkers & Prevention, 2011