Accurate prediction of disease-risk factors from volumetric medical scans by a deep vision model pre-trained with 2D scans
- 1 October 2024
- journal article
- research article
- Published by Springer Nature in Nature Biomedical Engineering
- Vol. 9 (4) , 507-520
Abstract
The application of machine learning to tasks involving volumetric biomedical imaging is constrained by the limited availability of annotated datasets of three-dimensional (3D) scans for model training. Here we report a deep-learning model pre-trained on 2D scans (for which annotated data are relatively abundant) that accurately predicts disease-risk factors from 3D medical-scan modalities. The model, which we named SLIViT (for ‘slice integration by vision transformer’), preprocesses a given volumetric scan into 2D images, extracts their feature map and integrates it into a single prediction. We evaluated the model in eight different learning tasks, including classification and regression for six datasets involving four volumetric imaging modalities (computed tomography, magnetic resonance imaging, optical coherence tomography and ultrasound). SLIViT consistently outperformed domain-specific state-of-the-art models and was typically as accurate as clinical specialists who had spent considerable time manually annotating the analysed scans. Automating diagnosis tasks involving volumetric scans may save valuable clinician hours, reduce data acquisition costs and duration, and help expedite medical research and clinical applications.Keywords
All Related Versions
This publication has 87 references indexed in Scilit:
- Epidemiology and aetiology of heart failureNature Reviews Cardiology, 2016
- Pancreatic Steatosis Demonstrated at MR Imaging in the General Population: Clinical RelevanceRadiology, 2015
- Global prevalence of age-related macular degeneration and disease burden projection for 2020 and 2040: a systematic review and meta-analysisThe Lancet Global Health, 2014
- Insulin Resistance Increases MRI-Estimated Pancreatic Fat in Nonalcoholic Fatty Liver Disease and Normal ControlsGastroenterology Research and Practice, 2013
- Hepatic Steatosis: Quantification by Proton Density Fat Fraction with MR Imaging versus Liver BiopsyRadiology, 2013
- Clinical Classification of Age-related Macular DegenerationOphthalmology, 2013
- The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): A Completed Reference Database of Lung Nodules on CT ScansMedical Physics, 2011
- Clinical update: new treatments for age-related macular degenerationThe Lancet, 2007
- Hospitalization for heart failure in the presence of a normal left ventricular ejection fractionJACC, 2004
- The Pathogenesis of Acute Pulmonary Edema Associated with HypertensionNew England Journal of Medicine, 2001