The University of Texas Houston Stroke Registry (UTHSR): implementation of enhanced data quality assurance procedures improves data quality
Authors:
- Mohammad H RahbarMRMohammad H Rahbar
- Nicole R GonzalesNGNicole R Gonzales
- Manouchehr Ardjomand-HessabiMAManouchehr Ardjomand-Hessabi
- Amirali TahananATAmirali Tahanan
- Melvin R SlineMSMelvin R Sline
- Hui PengHPHui Peng
- Renganayaki PandurenganRPRenganayaki Pandurengan
- Farhaan S VahidyFVFarhaan S Vahidy
- Jessica D TanksleyJTJessica D Tanksley
- Ayodeji A DelanoADAyodeji A Delano
- Rene M MalazarteRMRene M Malazarte
- Ellie E ChoiECEllie E Choi
Open Access
- 15 June 2013
- journal article
- research article
- Published by Springer Nature in BMC Neurology
- Vol. 13 (1) , 1-17
Abstract
Limited information has been published regarding standard quality assurance (QA) procedures for stroke registries. We share our experience regarding the establishment of enhanced QA procedures for the University of Texas Houston Stroke Registry (UTHSR) and evaluate whether these QA procedures have improved data quality in UTHSR. All 5093 patient records that were abstracted and entered in UTHSR, between January 1, 2008 and December 31, 2011, were considered in this study. We conducted reliability and validity studies. For reliability and validity of data captured by abstractors, a random subset of 30 records was used for re-abstraction of select key variables by two abstractors. These 30 records were re-abstracted by a team of experts that included a vascular neurologist clinician as the “gold standard”. We assessed inter-rater reliability (IRR) between the two abstractors as well as validity of each abstractor with the “gold standard”. Depending on the scale of variables, IRR was assessed with Kappa or intra-class correlations (ICC) using a 2-way, random effects ANOVA. For assessment of validity of data in UTHSR we re-abstracted another set of 85 patient records for which all discrepant entries were adjudicated by a vascular neurology fellow clinician and added to the set of our “gold standard”. We assessed level of agreement between the registry data and the “gold standard” as well as sensitivity and specificity. We used logistic regression to compare error rates for different years to assess whether a significant improvement in data quality has been achieved during 2008–2011. The error rate dropped significantly, from 4.8% in 2008 to 2.2% in 2011 (P < 0.001). The two abstractors had an excellent IRR (Kappa or ICC ≥ 0.75) on almost all key variables checked. Agreement between data in UTHSR and the “gold standard” was excellent for almost all categorical and continuous variables. Establishment of a rigorous data quality assurance for our UTHSR has helped to improve the validity of data. We observed an excellent IRR between the two abstractors. We recommend training of chart abstractors and systematic assessment of IRR between abstractors and validity of the abstracted data in stroke registries.Keywords
This publication has 51 references indexed in Scilit:
- Representativeness of the Get With The Guidelines–Stroke RegistryStroke, 2012
- Coordination and management of multisite complementary and alternative medicine (CAM) therapies: Experience from a multisite reflexology intervention trialContemporary Clinical Trials, 2011
- The China National Stroke Registry for Patients with Acute Cerebrovascular Events: Design, Rationale, and Baseline Patient CharacteristicsInternational Journal of Stroke, 2011
- Stroke ClassificationStroke, 2011
- Das österreichische Stroke-Unit-RegisterWiener Medizinische Wochenschrift, 2008
- Inter-rater reliability of data elements from a prototype of the Paul Coverdell National Acute Stroke RegistryBMC Neurology, 2008
- Data Cleaning: Detecting, Diagnosing, and Editing Data AbnormalitiesPLOS Medicine, 2005
- Frequency of Thrombolytic Therapy in Patients With Acute Ischemic Stroke and the Risk of In-Hospital MortalityStroke, 2003
- Stable Stroke Occurrence Despite Incidence Reduction in an Aging PopulationStroke, 1999
- Stroke Trends in the WHO MONICA ProjectStroke, 1997