DeepFake knee osteoarthritis X-rays from generative adversarial neural networks deceive medical experts and offer augmentation potential to automatic classification
Open Access
- 3 November 2022
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 12 (1) , 1-16
Abstract
Recent developments in deep learning have impacted medical science. However, new privacy issues and regulatory frameworks have hindered medical data sharing and collection. Deep learning is a very data-intensive process for which such regulatory limitations limit the potential for new breakthroughs and collaborations. However, generating medically accurate synthetic data can alleviate privacy issues and potentially augment deep learning pipelines. This study presents generative adversarial neural networks capable of generating realistic images of knee joint X-rays with varying osteoarthritis severity. We offer 320,000 synthetic (DeepFake) X-ray images from training with 5,556 real images. We validated our models regarding medical accuracy with 15 medical experts and for augmentation effects with an osteoarthritis severity classification task. We devised a survey of 30 real and 30 DeepFake images for medical experts. The result showed that on average, more DeepFakes were mistaken for real than the reverse. The result signified sufficient DeepFake realism for deceiving the medical experts. Finally, our DeepFakes improved classification accuracy in an osteoarthritis severity classification task with scarce real data and transfer learning. In addition, in the same classification task, we replaced all real training data with DeepFakes and suffered only a $$3.79\%$$ loss from baseline accuracy in classifying real osteoarthritis X-rays.
Keywords
Funding Information
- European Regional Development Fund (React-EU (2014-2023))
- Council of Tampere Region (A75000)
This publication has 66 references indexed in Scilit:
- Unique in the shopping mall: On the reidentifiability of credit card metadataScience, 2015
- scikit-image: image processing in PythonPeerJ, 2014
- Evaluating the risk of patient re-identification from adverse drug event reportsBMC Medical Informatics and Decision Making, 2013
- Analysis of focus measure operators for shape-from-focusPattern Recognition, 2013
- Impact of unlinked deaths and coding changes on mortality trends in the Swiss National CohortBMC Medical Informatics and Decision Making, 2013
- Productivity costs and medical costs among working patients with knee osteoarthritisArthritis Care & Research, 2012
- A Systematic Review of Re-Identification Attacks on Health DataPLOS ONE, 2011
- Discriminatory Analysis. Nonparametric Discrimination: Consistency PropertiesInternational Statistical Review, 1989
- Radiological Assessment of Osteo-ArthrosisAnnals of the Rheumatic Diseases, 1957
- Equilibrium points in n -person gamesProceedings of the National Academy of Sciences, 1950