Synthetic data accelerates the development of generalizable learning-based algorithms for X-ray image analysis
Top Cited Papers
- 20 March 2023
- journal article
- research article
- Published by Springer Nature in Nature Machine Intelligence
- Vol. 5 (3) , 294-308
Abstract
Artificial intelligence (AI) now enables automated interpretation of medical images. However, AI’s potential use for interventional image analysis remains largely untapped. This is because the post hoc analysis of data collected during live procedures has fundamental and practical limitations, including ethical considerations, expense, scalability, data integrity and a lack of ground truth. Here we demonstrate that creating realistic simulated images from human models is a viable alternative and complement to large-scale in situ data collection. We show that training AI image analysis models on realistically synthesized data, combined with contemporary domain generalization techniques, results in machine learning models that on real data perform comparably to models trained on a precisely matched real data training set. We find that our model transfer paradigm for X-ray image analysis, which we refer to as SyntheX, can even outperform real-data-trained models due to the effectiveness of training on a larger dataset. SyntheX provides an opportunity to markedly accelerate the conception, design and evaluation of X-ray-based intelligent systems. In addition, SyntheX provides the opportunity to test novel instrumentation, design complementary surgical approaches, and envision novel techniques that improve outcomes, save time or mitigate human error, free from the ethical and practical considerations of live human data collection.Keywords
This publication has 69 references indexed in Scilit:
- A Curved-Drilling Approach in Core Decompression of the Femoral Head Osteonecrosis Using a Continuum ManipulatorIEEE Robotics and Automation Letters, 2017
- Vision-based and marker-less surgical tool detection and tracking: a review of the literatureMedical Image Analysis, 2017
- V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation2016
- In silico clinical trials: how computer simulation will transform the biomedical industryInternational Journal of Clinical Trials, 2016
- A CNN Regression Approach for Real-Time 2D/3D RegistrationIEEE Transactions on Medical Imaging, 2016
- Image-guided navigation in orthopaedic traumaThe Journal of Bone and Joint Surgery. British volume, 2010
- Development of a colon endoscope robot that adjusts its locomotion through the use of reinforcement learningInternational Journal of Computer Assisted Radiology and Surgery, 2010
- Role of Navigation in Total Hip ArthroplastyJournal of Bone and Joint Surgery, 2009
- A new approach to computer-aided spine surgery: fluoroscopy-based surgical navigationEuropean Spine Journal, 2000
- Description of Anatomic Coordinate Systems and Rationale for Use in an Image-Guided Total Hip Replacement SystemLecture Notes in Computer Science, 2000