Medical expert knowledge meets AI: Can expert knowledge improve symptom assessment apps - a new approach to rare diseases (Preprint)
Authors:
- Anne PankowAPAnne Pankow
- Nico Meißner-BendzkoNMNico Meißner-Bendzko
- Jessica KaufeldJKJessica Kaufeld
- Laura FouquetteLFLaura Fouquette
- Fabienne CotteFCFabienne Cotte
- Stephen GilbertSGStephen Gilbert
- Ewelina TürkETEwelina Türk
- Anibh DasADAnibh Das
- Christoph TerkampCTChristoph Terkamp
- Gerhard-Rüdiger BurmesterGBGerhard-Rüdiger Burmester
- Annette Doris WagnerAWAnnette Doris Wagner
Preprint
- 30 November 2023
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND Although each individual disease in itself is rare, there are approximately 4 million people affected by rare diseases in Germany alone. Due to the limited knowledge, the time to diagnosis is often long and poses many challenges. Artificial intelligence (AI) approaches, like those used in symptom assessment applications (SAAs), can potentially help to detect rare diseases and thus shorten the time to diagnosis. Generally, SAAs use reasoning approaches applied to databases of both structured and unstructured medical knowledge from the medical literature. For rare diseases, however, there is only limited information available in medical literature. In this study we developed a new approach: abstracting medical expert knowledge from guided interviews and transforming them into clinical vignettes of the disease for the SAA knowledge base. OBJECTIVE Our goal was to integrate expert knowledge on the lysosomal storage diseases (LSDs) Fabry, Gaucher and Pompe disease into the Ada SAA, and to investigate whether the novel approach of guided interviews in combination with literature review leads to a better performance in symptom assessment than literature data sourcing alone. METHODS Clinical vignettes were created on the basis of interviews with 4 clinical experts from Hannover Medical School which gathered knowledge about typical symptom constellations. Structured case vignettes can easily be transcribed into the SAA’s knowledge base. Patients diagnosed with Fabry disease carried out an assessment using SAA versions generated from both the original disease modeling approach of data literature data sourcing alone and the novel approach. SAA performance and patient satisfaction were assessed using questionnaires. RESULTS With the help of the guided interviews 11 clinical vignettes were created to optimize the SAA’s LSD disease models. In the Fabry disease model comparison, participants generally favored the optimized SAA. With regard to diagnostic accuracy, there was a small difference between versions, favoring the optimized Fabry model. CONCLUSIONS The proposed novel approach for gaining medical knowledge about rare diseases for SAAs is a promising addition to the existing method of using literature research alone. Especially in case of rare diseases, knowledge is limited and medical literature is often incomplete – which often leads to diagnostic odysseys for the patients affected. Extending the traditional approach of disease modeling by extracting medical expert knowledge through clinical vignettes is a complementary method to fill and improve the knowledge base of SAAs, which may help to shorten the time to diagnosis for patients, including those suffering from rare diseases.Keywords
This publication has 22 references indexed in Scilit:
- Patients’ Utilization and Perception of an Artificial Intelligence–Based Symptom Assessment and Advice Technology in a British Primary Care Waiting Room: Exploratory Pilot StudyJMIR Human Factors, 2020
- The clinical profiles of female patients with Fabry disease in Latin America: A Fabry Registry analysis of natural history data from 169 patients based on enzyme replacement therapy statusJIMD Reports, 2019
- Can a decision support system accelerate rare disease diagnosis? Evaluating the potential impact of Ada DX in a retrospective studyOrphanet Journal of Rare Diseases, 2019
- Lysosomal storage diseasesNature Reviews Disease Primers, 2018
- Challenges in Research and Health Technology Assessment of Rare Disease Technologies: Report of the ISPOR Rare Disease Special Interest GroupValue in Health, 2018
- Diagnostic needs for rare diseases and shared prediagnostic phenomena: Results of a German-wide expert Delphi surveyPLOS ONE, 2017
- Methods of Observing Variations in Physicians’ Decisions: The Opportunities of Clinical VignettesJournal of General Internal Medicine, 2015
- Rare disease diagnosis: A review of web search, social media and large-scale data-mining approachesRare Diseases, 2015
- Early diagnostic suggestions improve accuracy of GPs: a randomised controlled trial using computer-simulated patientsBritish Journal of General Practice, 2014
- Difficulties and barriers in diagnosing Fabry disease: what can be learnt from the literature?Expert Opinion on Medical Diagnostics, 2013