Management of Dupuytren’s Disease: A Multi-Centric Comparative Analysis Between Experienced Hand Surgeons Versus Artificial Intelligence
Open Access
- 28 February 2025
- journal article
- research article
- Published by MDPI AG in Diagnostics
- Vol. 15 (5) , 587
Abstract
Background: Dupuytren’s fibroproliferative disease affecting the hand’s palmar fascia leads to progressive finger contractures and functional limitations. Management of this condition relies heavily on the expertise of hand surgeons, who tailor interventions based on clinical assessment. With the growing interest in artificial intelligence (AI) in medical decision-making, this study aims to evaluate the feasibility of integrating AI into the clinical management of Dupuytren’s disease by comparing AI-generated recommendations with those of expert hand surgeons. Methods: This multicentric comparative study involved three experienced hand surgeons and five AI systems (ChatGPT, Gemini, Perplexity, DeepSeek, and Copilot). Twenty-two standardized clinical prompts representing various Dupuytren’s disease scenarios were used to assess decision-making. Surgeons and AI systems provided management recommendations, which were analyzed for concordance, rationale, and predicted outcomes. Key metrics included union accuracy, surgeon agreement, precision, recall, and F1 scores. The study also evaluated AI performance in unanimous versus non-unanimous cases and inter-AI agreements. Results: Gemini and ChatGPT demonstrated the highest union accuracy (86.4% and 81.8%, respectively), while Copilot showed the lowest (40.9%). Surgeon agreement was highest for Gemini (45.5%) and ChatGPT (42.4%). AI systems performed better in unanimous cases (accuracy up to 92.0%) than in non-unanimous cases (accuracy as low as 35.0%). Inter-AI agreements ranged from 75.0% (ChatGPT-Gemini) to 48.0% (DeepSeek-Copilot). Precision, recall, and F1 scores were consistently higher for ChatGPT and Gemini than for other systems. Conclusions: AI systems, particularly Gemini and ChatGPT, show promise in aligning with expert surgical recommendations, especially in straightforward cases. However, significant variability exists, particularly in complex scenarios. AI should be viewed as complementary to clinical judgment, requiring further refinement and validation for integration into clinical practice.Keywords
This publication has 25 references indexed in Scilit:
- Letter on: “Artificial Intelligence: Enhancing Scientific Presentations in Aesthetic Surgery”Aesthetic Plastic Surgery, 2024
- Artificial intelligence in commercial fracture detection products: a systematic review and meta-analysis of diagnostic test accuracyScientific Reports, 2024
- The impact and opportunities of large language models like ChatGPT in oral and maxillofacial surgery: a narrative reviewInternational Journal of Oral and Maxillofacial Surgery, 2023
- Leveraging Large Language Models (LLM) for the Plastic Surgery Resident Training: Do They Have a Role?Indian Journal of Plastic Surgery, 2023
- Large Language Models and Artificial Intelligence: A Primer for Plastic Surgeons on the Demonstrated and Potential Applications, Promises, and Limitations of ChatGPTAesthetic Surgery Journal, 2023
- Large Language Models in Academic Plastic Surgery: The Way ForwardPlastic and Reconstructive Surgery - Global Open, 2023
- Expanding Cosmetic Plastic Surgery Research With ChatGPTAesthetic Surgery Journal, 2023
- Comparing the Efficacy of Large Language Models ChatGPT, BARD, and Bing AI in Providing Information on Rhinoplasty: An Observational StudyAesthetic Surgery Journal Open Forum, 2023
- Treatment Options for Dupuytren’s Disease: Tips and TricksPlastic and Reconstructive Surgery - Global Open, 2022
- Scientific understanding and clinical management of Dupuytren diseaseNature Reviews Rheumatology, 2010