RA-XTNet: A Novel CNN Model to Predict Rheumatoid Arthritis from Hand Radiographs and Thermal Images: A Comparison with CNN Transformer and Quantum Computing
Open Access
- 30 August 2024
- journal article
- research article
- Published by MDPI AG in Diagnostics
- Vol. 14 (17) , 1911
Abstract
The aim and objective of the research are to develop an automated diagnosis system for the prediction of rheumatoid arthritis (RA) based on artificial intelligence (AI) and quantum computing for hand radiographs and thermal images. The hand radiographs and thermal images were segmented using a UNet++ model and color-based k-means clustering technique, respectively. The attributes from the segmented regions were generated using the Speeded-Up Robust Features (SURF) feature extractor and classification was performed using k-star and Hoeffding classifiers. For the ground truth and the predicted test image, the study utilizing UNet++ segmentation achieved a pixel-wise accuracy of 98.75%, an intersection over union (IoU) of 0.87, and a dice coefficient of 0.86, indicating a high level of similarity. The custom RA-X-ray thermal imaging (XTNet) surpassed all the models for the detection of RA with a classification accuracy of 90% and 93% for X-ray and thermal imaging modalities, respectively. Furthermore, the study employed quantum support vector machine (QSVM) as a quantum computing approach which yielded an accuracy of 93.75% and 87.5% for the detection of RA from hand X-ray and thermal images. In addition, vision transformer (ViT) was employed to classify RA which obtained an accuracy of 80% for hand X-rays and 90% for thermal images. Thus, depending on the performance measures, the RA-XTNet model can be used as an effective automated diagnostic method to diagnose RA accurately and rapidly in hand radiographs and thermal images.Keywords
This publication has 46 references indexed in Scilit:
- Semantic segmentation using Vision Transformers: A surveyEngineering Applications of Artificial Intelligence, 2023
- Artificial Intelligence in Rheumatoid Arthritis: Current Status and Future Perspectives: A State-of-the-Art ReviewRheumatology and Therapy, 2022
- Automated Classification of Rheumatoid Arthritis, Osteoarthritis, and Normal Hand Radiographs with Deep Learning MethodsJournal of Digital Imaging, 2022
- Quantum Machine Learning Architecture for COVID-19 Classification Based on Synthetic Data Generation Using Conditional Adversarial Neural NetworkCognitive Computation, 2021
- Radiology in Rheumatology2021
- A scoping review of transfer learning research on medical image analysis using ImageNetComputers in Biology and Medicine, 2021
- Thermography in rheumatoid arthritis: a comparison with ultrasonography and clinical joint assessmentClinical Radiology, 2020
- Detection of inflammation from finger temperature profile in rheumatoid arthritisMedical & Biological Engineering & Computing, 2019
- Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support2018
- Speeded-Up Robust Features (SURF)Computer Vision and Image Understanding, 2008