Reliability testing of the HEARTSMAP psychosocial assessment tool for multidisciplinary use and in diverse emergency settings
Authors:
Open Access
- 6 March 2018
- journal article
- research article
- Published by Oxford University Press (OUP) in Paediatrics & Child Health
- Vol. 23 (8) , 503-508
Abstract
HEARTSMAP is a tool developed to facilitate assessment and management of paediatric mental health (MH) patients by emergency department (ED) clinicians. We evaluate the inter-rater reliability of HEARTSMAP when administered by clinicians of various backgrounds. In a cross-sectional study initiated in 2016, collaborating clinician evaluators (n=16) applied the HEARTSMAP tool to evaluate a set of 50 fictional clinical vignettes, digitally in an approach consistent with the anticipated tool’s access and usage in clinical settings. Evaluators came from different types of health centres from across the province of British Columbia (Canada), including remote/rural, regional and urban academic health centres. We report moderate to near excellent agreement, overall among clinicians for all 10 of the tool’s psychosocial sections (κ=0.43 to 0.93) and domain scores (κ=0.75 to 0.90), with acceptable agreement across all tool-triggered service recommendations (κ=0.36 to 0.65). Our findings show that HEARTSMAP may be reliably used by ED clinicians in assessing MH issues among youth. Results from this study will assist in informing the wider clinical implementation of HEARTSMAP as a standard assessment tool, in diverse emergency care settings.Keywords
Funding Information
- Specialist Service Committee
- Doctors of BC
- Ministry of Health, British Columbia
This publication has 24 references indexed in Scilit:
- Screening for Adolescent Anxiety Disorders in a Pediatric Emergency DepartmentPediatric Emergency Care, 2012
- The HEADS-ED: A Rapid Mental Health Screening Tool for Pediatric Patients in the Emergency DepartmentPediatrics, 2012
- Pediatric and Adolescent Mental Health Emergencies in the Emergency Medical Services SystemPediatrics, 2011
- Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics supportJournal of Biomedical Informatics, 2009
- Children's Mental Health Emergencies-Part 1Pediatric Emergency Care, 2008
- Brief Screening for Adolescent Depressive Symptoms in the Emergency DepartmentAcademic Emergency Medicine, 2008
- Cross-National Reliability of Clinician-Rated Outcome Measures in Child and Adolescent Mental Health ServicesAdministration and Policy in Mental Health and Mental Health Services Research, 2007
- Accuracy of assessment of distress, anxiety, and depression by physicians and nurses in adolescents recently diagnosed with cancerPediatric Blood & Cancer, 2005
- Clinical Vignette-Based Surveys: A Tool for Assessing Physician Practice VariationAmerican Journal of Medical Quality, 2005
- Measures of response agreement for qualitative data: Some generalizations and alternatives.Psychological Bulletin, 1971