Deep Learning Technique for Congenital Heart Disease Detection Using Stacking-Based CNN-LSTM Models From Fetal Echocardiogram: A Pilot Study
Open Access
- 18 September 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 110375-110390
Abstract
Congenital heart defects (CHDs) are a leading cause of death in infants under 1 year of age. Prenatal intervention can reduce the risk of postnatal serious CHD patients, but current diagnosis is based on qualitative criteria, which can lead to variability in diagnosis between clinicians. Objectives: To detect morphological and temporal changes in cardiac ultrasound (US) videos of fetuses with hypoplastic left heart syndrome (HLHS) using deep learning models. A small cohort of 9 healthy and 13 HLHS patients were enrolled, and ultrasound videos at three gestational time points were collected. The videos were preprocessed and segmented to cardiac cycle videos, and five different deep learning CNN-LSTM models were trained (MobileNetv2, ResNet18, ResNet50, DenseNet121, and GoogleNet). The top-performing three models were used to develop a novel stacking CNN-LSTM model, which was trained using five-fold cross-validation to classify HLHS and healthy patients. The stacking CNN-LSTM model outperformed other pre-trained CNN-LSTM models with the accuracy, precision, sensitivity, F1 score, and specificity of 90.5%, 92.5%, 92.5%, 92.5%, and 85%, respectively for video-wise classification, and with the accuracy, precision, sensitivity, F1 score, and specificity of 90.5%, 92.5%, 92.5%, 92.5%, and 85%, respectively for subject-wise classification using ultrasound videos. This study demonstrates the potential of using deep learning models to classify CHD prenatal patients using ultrasound videos, which can aid in the objective assessment of the disease in a clinical setting.Keywords
Funding Information
- Qatar National Research Fund (QNRF), National Priority Research Program (NPRP 10-0123- 170222)
- Open Access funding was provided by the Qatar National Library
This publication has 68 references indexed in Scilit:
- An intelligent classifier for prognosis of cardiac resynchronization therapy based on speckle-tracking echocardiogramsArtificial Intelligence in Medicine, 2012
- Hypoplastic Left Heart SyndromeJACC, 2012
- Predictors of Technical Success and Postnatal Biventricular Outcome After In Utero Aortic Valvuloplasty for Aortic Stenosis With Evolving Hypoplastic Left Heart SyndromeCirculation, 2009
- Changes in left heart hemodynamics after technically successful in‐utero aortic valvuloplastyUltrasound in Obstetrics & Gynecology, 2007
- The nomenclature, definition and classification of hypoplastic left heart syndromeCardiology in the Young, 2006
- Aortic valvuloplasty in the fetus: Technical characteristics of successful balloon dilationThe Journal of Pediatrics, 2005
- Balloon Dilation of Severe Aortic Stenosis in the FetusCirculation, 2004
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Long Short-Term MemoryNeural Computation, 1997
- Hypoplastic left heart syndrome with premature closure of foramen ovale: Report of an unusual type of totally anomalous pulmonary venous returnHeart and Vessels, 1990