Developing a Tool to Assess Placement of Central Venous Catheters in Pediatrics Patients
- 1 July 2016
- journal article
- Published by Journal of Graduate Medical Education in Journal of Graduate Medical Education
- Vol. 8 (3) , 346-352
Abstract
Pediatric critical care medicine requires the acquisition of procedural skills, but to date no criteria exist for assessing trainee competence in central venous catheter (CVC) insertion.Background The goal of this study was to create and demonstrate validity evidence for a direct observation tool for assessing CVC insertion.Objective Ten experts used the modified Delphi technique to create a 15-item direct observation tool to assess 5 scripted and filmed simulated scenarios of CVC placement. The scenarios were hosted on a dedicated website from March to May 2013, and respondents recruited by e-mail completed the observation tool in real time while watching the scenarios. The goal was to obtain 50 respondents and a total of 250 scenario ratings.Methods A total of 49 pediatrics intensive care faculty physicians (6.3% of 780 potential subjects) responded and generated 188 scenario observations. Of these, 150 (79.8%) were recorded from participants who scored 4 or more on the 5 scenarios. The tool correctly identified the expected reference standard in 96.8% of assessments with an interrater agreement kappa (standard error) = 0.94 (0.07) and receiver operating characteristic = 0.97 (95% CI 0.94–0.99).Results This direct observation assessment tool for central venous catheterization demonstrates excellent performance in identifying the reference standard with a high degree of interrater reliability. These assessments support a validity construct for a pediatric critical care medicine faculty member to assess a provider placing a CVC in a pediatrics patient.ConclusionsKeywords
This publication has 34 references indexed in Scilit:
- Direct observed procedural skills assessment in the undergraduate settingThe Clinical Teacher, 2012
- A Primer on the Validity of Assessment InstrumentsJournal of Graduate Medical Education, 2011
- Development and pilot testing of an operative competency assessment tool for pediatric direct laryngoscopy and rigid bronchoscopyThe Laryngoscope, 2010
- Development of a test to evaluate residents' knowledge of medical proceduresJournal of Hospital Medicine, 2009
- Improving internal medicine residents' performance, knowledge, and confidence in central venous catheterization using simulatorsJournal of Hospital Medicine, 2009
- Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics supportJournal of Biomedical Informatics, 2009
- Checklists for assessment and certification of clinical procedural skills omit essential competencies: a systematic reviewMedical Education, 2008
- Reliability of a Core Competency Checklist Assessment in the Emergency Department: The Standardized Direct Observation Assessment ToolAcademic Emergency Medicine, 2006
- NIHSS Training and Certification Using a New Digital Video Disk Is ReliableStroke, 2005
- Objective assessment of technical skills in surgeryBMJ, 2004