Deep Learning and Multimodal Artificial Intelligence in Orthopaedic Surgery
Open Access
- 17 April 2024
- journal article
- review article
- Published by Wolters Kluwer Health in Journal of the American Academy of Orthopaedic Surgeons
- Vol. 32 (11) , e523-e532
Abstract
This review article focuses on the applications of deep learning with neural networks and multimodal neural networks in the orthopaedic domain. By providing practical examples of how artificial intelligence (AI) is being applied successfully in orthopaedic surgery, particularly in the realm of imaging data sets and the integration of clinical data, this study aims to provide orthopaedic surgeons with the necessary tools to not only evaluate existing literature but also to consider AI's potential in their own clinical or research pursuits. We first review standard deep neural networks which can analyze numerical clinical variables, then describe convolutional neural networks which can analyze image data, and then introduce multimodal AI models which analyze various types of different data. Then, we contrast these deep learning techniques with related but more limited techniques such as radiomics, describe how to interpret deep learning studies, and how to initiate such studies at your institution. Ultimately, by empowering orthopaedic surgeons with the knowledge and know-how of deep learning, this review aspires to facilitate the translation of research into clinical practice, thereby enhancing the efficacy and precision of real-world orthopaedic care for patients.Keywords
This publication has 33 references indexed in Scilit:
- A comparative analysis of classical machine learning and deep learning techniques for predicting lung cancer survivabilityMultimedia Tools and Applications, 2023
- T2-weighted MRI radiomics in high-grade intramedullary osteosarcoma: predictive accuracy in assessing histologic response to chemotherapy, overall survival, and disease-free survivalSkeletal Radiology, 2022
- A Surgeon’s Guide to Understanding Artificial Intelligence and Machine Learning Studies in Orthopaedic SurgeryCurrent Reviews in Musculoskeletal Medicine, 2022
- Machine Learning for Auto-Segmentation in Radiotherapy PlanningClinical Oncology, 2022
- Machine Learning Algorithms Predict Achievement of Clinically Significant Outcomes After Orthopaedic Surgery: A Systematic ReviewArthroscopy, 2021
- Detecting Distal Radial Fractures from Wrist Radiographs Using a Deep Convolutional Neural Network with an Accuracy Comparable to Hand Orthopedic SurgeonsJournal of Digital Imaging, 2021
- Detecting total hip replacement prosthesis design on plain radiographs using deep convolutional neural networkJournal of Orthopaedic Research, 2020
- Addressing Bias in Artificial Intelligence in Health CareJAMA, 2019
- Deep learning for patient‐specific quality assurance: Identifying errors in radiotherapy delivery by radiomic analysis of gamma images with convolutional neural networksMedical Physics, 2018
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015