What Counts? An Ethnographic Study of Infection Data Reported to a Patient Safety Program
- 18 September 2012
- journal article
- Published by Wiley in The Milbank Quarterly
- Vol. 90 (3) , 548-591
Abstract
Context:Performance measures are increasingly widely used in health care and have an important role in quality. However, field studies of what organizations are doing when they collect and report performance measures are rare. An opportunity for such a study was presented by a patient safety program requiring intensive care units (ICUs) in England to submit monthly data on central venous catheter bloodstream infections (CVC‐BSIs).Methods:We conducted an ethnographic study involving ∼855 hours of observational fieldwork and 93 interviews in 17 ICUs plus 29 telephone interviews.Findings:Variability was evident within and between ICUs in how they applied inclusion and exclusion criteria for the program, the data collection systems they established, practices in sending blood samples for analysis, microbiological support and laboratory techniques, and procedures for collecting and compiling data on possible infections. Those making decisions about what to report were not making decisions about the same things, nor were they making decisions in the same way. Rather than providing objective and clear criteria, the definitions for classifying infections used were seen as subjective, messy, and admitting the possibility of unfairness. Reported infection rates reflected localized interpretations rather than a standardized dataset across all ICUs. Variability arose not because of wily workers deliberately concealing, obscuring, or deceiving but because counting was as much a social practice as a technical practice.Conclusions:Rather than objective measures of incidence, differences in reported infection rates may reflect, at least to some extent, underlying social practices in data collection and reporting and variations in clinical practice. The variability we identified was largely artless rather than artful: currently dominant assumptions of gaming as responses to performance measures do not properly account for how categories and classifications operate in the pragmatic conduct of health care. These findings have important implications for assumptions about what can be achieved in infection reduction and quality improvement strategies.Keywords
This publication has 49 references indexed in Scilit:
- Explaining Michigan: Developing an Ex Post Theory of a Quality Improvement ProgramThe Milbank Quarterly, 2011
- Prevention of central venous catheter-related infection in the intensive care unitCritical Care, 2010
- Clinical Practice Guidelines for the Diagnosis and Management of Intravascular Catheter-Related Infection: 2009 Update by the Infectious Diseases Society of AmericaClinical Infectious Diseases, 2009
- Lymphovascular Invasion in Colorectal CancerAmerican Journal of Surgical Pathology, 2008
- Hitting and Missing Targets by Ambulance Services for Emergency Calls: Effects of Different Systems of Performance Measurement within the UKJournal of the Royal Statistical Society Series A: Statistics in Society, 2008
- Exclusion of Patients from Pay-for-Performance Targets by English PhysiciansNew England Journal of Medicine, 2008
- An ethnostatistical analysis of performance measurementPerformance Improvement Quarterly, 2008
- Suicide Determination and the Professional Authority of Medical ExaminersAmerican Sociological Review, 2005
- Counting, Control and Calculation: Reflections on Measuring and ManagementHuman Relations, 2004
- Ultrasonic Absorption at Microwave Frequencies and at Low Temperatures in MgO andPhysical Review B, 1964