Trends in telemedicine assessment indicate neglect of key criteria for predicting success
- 3 August 2012
- journal article
- research article
- Published by Emerald Publishing in Journal of Health Organization and Management
- Vol. 26 (4) , 508-523
Abstract
Purpose: This innovative analysis aims to quantify the use of evaluation criteria in telemedicine and to identify current trends in metric adoption. The focus is to determine the frequency of actual performance metric reporting in telemedicine evaluation, in contrast to systematic reviews where assessment of study quality is the goal.Design/methodology/approach: Automated literature search identified telemedicine studies reporting quantitative performance metrics. Studies were classified by telemedicine class; store‐and‐forward (SAF), real‐time consultation (RTC) and telecare (TC), and study stage. Studies were scanned for evaluation metric reporting, i.e. clinical outcomes, satisfaction, patient quality and cost measures.Findings: Evaluation metric use was compared among telemedicine classes, and between pilot and routine use stages. Diagnostic accuracy was reported significantly more frequently in pilots for RTC and TC. Cost measures were more frequently reported in routine use for TC. Clinical effectiveness and hospital attendance were better reported in routine use for SAF. Comparison also revealed different evaluation strategies. In pilots, SAF favoured diagnostic accuracy, compared to RTC and TC. TC preferred clinical effectiveness evaluations and TC more frequently assessed patient satisfaction. Cost was only reported in less than 20 per cent of studies, but most frequently in RTC. Routine use led to increased reporting of all metrics, except diagnostic accuracy. Clinical effectiveness reporting increased significantly with routine use for RTC and SAF, but declined for TC.Originality/value: Clinical outcomes and patient satisfaction were reported frequently in telemedicine studies, but reporting of other performance metrics was rare. Understanding current trends in metric reporting will facilitate better design of future telemedicine evaluations.Keywords
This publication has 31 references indexed in Scilit:
- Has payment by results affected the way that English hospitals provide care? Difference-in-differences analysisBMJ, 2009
- Evaluating eHealth Interventions: The Need for Continuous Systemic EvaluationPLOS Medicine, 2009
- Medical regulation in the telemedicine eraThe Lancet, 2008
- Smart home technologies for health and social care supportCochrane Database of Systematic Reviews, 2008
- At what age do biomedical scientists do their best work?The FASEB Journal, 2008
- Maturity of teledermatology evaluation research: a systematic literature reviewBritish Journal of Dermatology, 2006
- Randomized Trial of a Nurse-Administered, Telephone-Based Disease Management Program for Patients With Heart FailureJournal of Cardiac Failure, 2005
- Telehealth adoption in hospitals:an organisational perspectiveJournal of Health Organization and Management, 2005
- Outcomes and Methods in Telemedicine EvaluationTelemedicine and e-Health, 2003
- Towards Complete and Accurate Reporting of Studies of Diagnostic Accuracy: The STARD InitiativeClinical Chemistry, 2003