Triage accuracy of online symptom checkers for Accident and Emergency Department patients
Open Access
- 16 April 2019
- journal article
- research article
- Published by Wiley in Hong Kong Journal of Emergency Medicine
- Vol. 27 (4) , 217-222
Abstract
Background: Overutilisation of the Accident and Emergency Department is an increasingly serious healthcare challenge. Online symptom checkers could help alleviate this challenge by allowing patients to self-triage before visiting the Accident and Emergency Department. Objectives: This study aimed to assess the triage accuracy of online symptom checkers, which would help determine the potential roles of symptom checkers in an Accident and Emergency Department setting. Methods: A total of 100 random Accident and Emergency Department records were sampled from the Queen Mary Hospital in Hong Kong. The inclusion criteria were patients over the age of 18 attending the Queen Mary Hospital Accident and Emergency Department in 2016. Symptom checkers by Drugs.com and FamilyDoctor were selected as representative tools. One triage recommendation was generated by each symptom checker for each case record. Each symptom checker’s triage accuracy was then evaluated using a few outcome measures: overall sensitivity, sensitivity for emergency cases and specificity for non-emergency cases, when compared with the triage categories assigned by the triage nurses. Results: The results showed that Drugs.com had a higher overall triage accuracy than FamilyDoctor (74% and 50%, respectively), but both checkers are inadequately sensitive to emergency cases (70% and 45%, respectively) with low negative predictive values (43% and 24%, respectively). Conclusion: In their current states, symptom checkers are not yet suitable as alternatives to Accident and Emergency Department triage protocols due to their low overall sensitivities and negative predictive values. However, symptom checkers might serve as useful Accident and Emergency Department adjuncts in other ways, such as to provide more information prior to a patient’s arrival to streamline the triage and preparation process at the Accident and Emergency Department.Keywords
This publication has 12 references indexed in Scilit:
- What evidence is there on the effectiveness of different models of delivering urgent care? A rapid reviewHealth Services and Delivery Research, 2015
- Nurses’ accuracy and self-perceived ability using the Emergency Severity Index triage tool: a cross-sectional study in four Swiss hospitalsScandinavian Journal of Trauma, Resuscitation and Emergency Medicine, 2015
- Accuracy and interrater reliability of paediatric emergency department triageEmergency Medicine Australasia, 2015
- Evaluation of symptom checkers for self diagnosis and triage: audit studyBMJ, 2015
- Accuracy of a Computer-Based Diagnostic Program for Ambulatory Patients With Knee PainThe American Journal of Sports Medicine, 2014
- A study of automated self-assessment in a primary care student health centre settingJournal of Telemedicine and Telecare, 2014
- Diagnostic Inaccuracy of Smartphone Applications for Melanoma DetectionJAMA Dermatology, 2013
- Should You Search the Internet for Information About Your Acute Symptom?Telemedicine and e-Health, 2012
- How good is Internet self‐diagnosis of ENT symptoms using Boots WebMD symptom checker?Clinical Otolaryngology, 2011
- Safety of telephone triage in general practitioner cooperatives: do triage nurses correctly estimate urgency?Quality and Safety in Health Care, 2007