Assessing the accuracy of a digital symptom checker tool for suggestion of reproductive health conditions: a clinical vignettes study
Authors:
Preprint
Abstract
Background Reproductive health conditions such as endometriosis, uterine fibroids and polycystic ovary syndrome affect a large proportion of women and people who menstruate worldwide. Prevalence estimates for these conditions range from 5-40% of women of reproductive age. Long diagnostic delays, up to 12 years, are common and contribute to health complications and increased healthcare costs. Symptom checker apps provide users with information and tools to better understand their symptoms and thus have the potential to reduce the time to diagnosis for reproductive health conditions. Objective This study aims to evaluate the accuracy of three symptom checkers developed by Flo Health assessing symptoms of endometriosis, uterine fibroids and polycystic ovary syndrome (PCOS) against current medical guidelines. Methods Independent general practitioners were recruited to create clinical case vignettes of simulated users with and without the conditions of interest. Vignettes were reviewed, modified and approved by separate general practitioners. A further independent panel of general practitioners reviewed the cases and designated a final classification. Vignettes were entered into the symptom checkers and the outcomes were compared with the final classification from the panel using accuracy metrics including percent agreement, sensitivity and specificity. Results A total of 24 cases were created per condition. Overall, exact matches between the vignette classification and the symptom checker outcome was 83.3% for endometriosis and uterine fibroids, and 87.5% for PCOS. While sensitivity was high for all conditions (>81%) and very high (100%) for PCOS, specificity was >81% for endometriosis and uterine fibroids and 75% for PCOS. Conclusion The single condition symptom checkers have high levels of accuracy for endometriosis, uterine fibroids and PCOS. Given long delays in diagnosis for many reproductive health conditions, which lead to increased medical costs and potential health complications for individuals and healthcare providers, innovative health apps and symptom checkers hold the potential to improve care pathways.Keywords
All Related Versions
- Published version: JMIR mHealth and uHealth, 11 (1), e46718.
This publication has 67 references indexed in Scilit:
- Menstruation: science and societyAmerican Journal of Obstetrics and Gynecology, 2020
- Impact of Endometriosis Diagnostic Delays on Healthcare Resource Utilization and CostsAdvances in Therapy, 2020
- Accuracy of a Popular Online Symptom Checker for Ophthalmic DiagnosesJAMA Ophthalmology, 2019
- Evaluating Digital Health InterventionsAmerican Journal of Preventive Medicine, 2016
- The impact of uterine leiomyomas: a national survey of affected womenAmerican Journal of Obstetrics and Gynecology, 2013
- Endometriosis and infertilityJournal of Assisted Reproduction and Genetics, 2010
- Overview of Long-Term Morbidity and Economic Cost of the Polycystic Ovary Syndrome2007
- Diagnosis, phenotype, and prevalence of polycystic ovary syndromeFertility and Sterility, 2006
- Impact of endometriosis on women's health: comparative historical data show that the earlier the onset, the more severe the diseaseBest Practice & Research Clinical Obstetrics & Gynaecology, 2004
- The prevalence of endometriosis in women with infertile partnersEuropean Journal of Obstetrics & Gynecology and Reproductive Biology, 1993