A deep learning system for quantitative assessment of microvascular abnormalities in nailfold capillary images
Open Access
- 18 January 2023
- journal article
- research article
- Published by Oxford University Press (OUP) in Rheumatology
- Vol. 62 (6) , 2325-2329
Abstract
Objectives: Nailfold capillaroscopy is key to timely diagnosis of SSc, but is often not used in rheumatology clinics because the images are difficult to interpret. We aimed to develop and validate a fully automated image analysis system to fill this gap.Methods: We mimicked the image interpretation strategies of SSc experts, using deep learning networks to detect each capillary in the distal row of vessels and make morphological measurements. We combined measurements from multiple fingers to give a subject-level probability of SSc.We trained the system using high-resolution images from 111 subjects (group A) and tested on images from subjects not in the training set: 132 imaged at high-resolution (group B); 66 imaged with a low-cost digital microscope (group C). Roughly half of each group had confirmed SSc, and half were healthy controls or had primary RP (‘normal’). We also estimated the performance of SSc experts.Results: We compared automated SSc probabilities with the known clinical status of patients (SSc versus ‘normal’), generating receiver operating characteristic curves (ROCs). For group B, the area under the ROC (AUC) was 97% (94–99%) [median (90% CI)], with equal sensitivity/specificity 91% (86–95%). For group C, the AUC was 95% (88–99%), with equal sensitivity/specificity 89% (82–95%). SSc expert consensus achieved sensitivity 82% and specificity 73%.Conclusion: Fully automated analysis using deep learning can achieve diagnostic performance at least as good as SSc experts, and is sufficiently robust to work with low-cost digital microscope images.Keywords
Funding Information
- National Institute for Health and Care Research
- Invention for Innovation (II-LB-1117-20006)
This publication has 16 references indexed in Scilit:
- Fast track algorithm: How to differentiate a “scleroderma pattern” from a “non-scleroderma pattern”Autoimmunity Reviews, 2019
- Automated structure and flow measurement — a promising tool in nailfold capillaroscopyMicrovascular Research, 2018
- Automated assessment of absolute nailfold capillary number on videocapillaroscopic images: Proof of principle and validation in systemic sclerosisMicrocirculation, 2018
- Sequential nailfold videocapillaroscopy examinations have responsiveness to detect organ progression in systemic sclerosisSeminars in Arthritis and Rheumatism, 2017
- Intra-and inter-observer reliability of nailfold videocapillaroscopy — A possible outcome measure for systemic sclerosis-related microangiopathyMicrovascular Research, 2017
- An Automated System for Detecting and Measuring Nailfold Capillaries2014
- Nailfold capillary patterns in healthy subjects: A real issue in capillaroscopyMicrovascular Research, 2013
- 2013 classification criteria for systemic sclerosis: an American college of rheumatology/European league against rheumatism collaborative initiativeAnnals of the Rheumatic Diseases, 2013
- Computerized nailfold video capillaroscopy--a new tool for assessment of Raynaud's phenomenon.2005
- Quantitation of microcirculatory abnormalities in patients with primary Raynaud's phenomenon and systemic sclerosis by video capillaroscopyRheumatology, 2000