Automatic vertebral fracture and three-column injury diagnosis with fracture visualization by a multi-scale attention-guided network
- 27 February 2023
- journal article
- research article
- Published by Springer Nature in Medical & Biological Engineering & Computing
- Vol. 61 (7) , 1661-1674
Abstract
Deep learning methods have the potential to improve the efficiency of diagnosis for vertebral fractures with computed tomography (CT) images. Most existing intelligent vertebral fracture diagnosis methods only provide dichotomized results at a patient level. However, a fine-grained and more nuanced outcome is clinically needed. This study proposed a novel network, a multi-scale attention-guided network (MAGNet), to diagnose vertebral fractures and three-column injuries with fracture visualization at a vertebra level. By imposing attention constraints through a disease attention map (DAM), a fusion of multi-scale spatial attention maps, the MAGNet can get task highly relevant features and localize fractures. A total of 989 vertebrae were studied here. After four-fold cross-validation, the area under the ROC curve (AUC) of our model for vertebral fracture dichotomized diagnosis and three-column injury diagnosis was 0.884 ± 0.015 and 0.920 ± 0.104, respectively. The overall performance of our model outperformed classical classification models, attention models, visual explanation methods, and attention-guided methods based on class activation mapping. Our work can promote the clinical application of deep learning to diagnose vertebral fractures and provide a way to visualize and improve the diagnosis results with attention constraints. Graphical AbstractKeywords
Funding Information
- National Key Research and Development Progra (2016YFC01004608)
- National Natural Science Foundation of China (U1732119)
- Shanghai Jiao Tong University Medical Engineering Cross Research Funds (YG2021ZD05)
- National Key R&D Program of China (2021YFF0703702)
This publication has 33 references indexed in Scilit:
- Integrating spatial configuration into heatmap regression based CNNs for landmark localizationMedical Image Analysis, 2019
- Automated system for the detection of thoracolumbar fractures using a CNN architectureFuture Generation Computer Systems, 2018
- Deep neural networks for automatic detection of osteoporotic vertebral fractures on CT scansComputers in Biology and Medicine, 2018
- Grad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks2018
- Vertebral Body Compression Fractures and Bone Density: Automated Detection and Classification on CT ImagesRadiology, 2017
- ITK-SNAP: An Intractive Medical Image Segmentation Tool to Meet the Need for Expert-Guided Segmentation of Complex Medical ImagesIEEE Pulse, 2017
- Compression fractures detection on CT2017
- A Review on Evaluation Metrics for Data Classification EvaluationsInternational Journal of Data Mining & Knowledge Management Process, 2015
- Automatic detection of osteoporotic vertebral fractures in routine thoracic and abdominal MDCTEuropean Radiology, 2014
- The Three Column Spine and Its Significance in the Classification of Acute Thoracolumbar Spinal InjuriesSpine, 1983