SLIViT: a general AI framework for clinical-feature diagnosis from limited 3D biomedical-imaging data
Preprint
- 21 June 2023
- preprint
- Published by Springer Nature in Research Square
Abstract
We present SLIViT, a deep-learning framework that accurately measures disease-related risk factors in volumetric biomedical imaging, such as magnetic resonance imaging (MRI) scans, optical coherence tomography (OCT) scans, and ultrasound videos. To evaluate SLIViT, we applied it to five different datasets of these three different data modalities tackling seven learning tasks (including both classification and regression) and found that it consistently and significantly outperforms domain-specific state-of-the-art models, typically improving performance (ROC AUC or correlation) by 10-40%. Notably, compared to existing approaches, SLIViT can be applied even when only a small number of annotated training samples is available, which is often a constraint in medical applications. When trained on less than 700 annotated volumes, SLIViT obtained accuracy comparable to trained clinical specialists while reducing annotation time by a factor of 5,000 demonstrating its utility to automate and expedite ongoing research and other practical clinical scenarios.Keywords
All Related Versions
This publication has 51 references indexed in Scilit:
- Diagnosis of Parkinson’s disease based on 3D ResNet: The frontal lobe is crucialBiomedical Signal Processing and Control, 2023
- UniMiSS: Universal Medical Self-supervised Learning via Breaking Dimensionality Barrier2022
- Learning Transferable 3D-CNN for MRI-Based Brain Disorder Classification from Scratch: An Empirical Study2021
- Relationship between abdominal fat stores and liver fat, pancreatic fat, and metabolic comorbidities in a pediatric population with non-alcoholic fatty liver diseaseAbdominal Radiology, 2019
- Pilot study on longitudinal change in pancreatic proton density fat fraction during a weight‐loss surgery program in adults with obesityJournal of Magnetic Resonance Imaging, 2019
- Contrast‐enhanced MRI for breast cancer screeningJournal of Magnetic Resonance Imaging, 2019
- Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep LearningCell, 2018
- Proposal of a simple optical coherence tomography-based scoring system for progression of age-related macular degenerationGraefe's Archive for Clinical and Experimental Ophthalmology, 2017
- Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus PhotographsJAMA, 2016
- Hospitalization for heart failure in the presence of a normal left ventricular ejection fraction. Results of the New York Heart Failure RegistryACC Current Journal Review, 2004