Michael Finkelstein

Background: Evaluating the features and performance of health information systems can serve to strengthen the systems themselves as well as to guide other organizations in the process of designing and implementing surveillance tools. We adapted an evaluation framework in order to assess electronic immunization data collection systems, and applied it in two Ontario public health units. Methods: The Centers for Disease Control and Prevention’s Guidelines for Evaluating Public Health Surveillance Systems are broad in nature and serve as an organizational tool to guide the development of comprehensive evaluation materials. Based on these Guidelines, and informed by other evaluation resources and input from stakeholders in the public health community, we applied an evaluation framework to two examples of immunization data collection and examined several system attributes: simplicity, flexibility, data quality, timeliness, and acceptability. Data collection approaches included key informant interviews, logic and completeness assessments, client surveys, and on-site observations. Results: Both evaluated systems allow high-quality immunization data to be collected, analyzed, and applied in a rapid fashion. However, neither system is currently able to link to other providers’ immunization data or provincial data sources, limiting the comprehensiveness of coverage assessments. We recommended that both organizations explore possibilities for external data linkage and collaborate with other jurisdictions to promote a provincial immunization repository or data sharing platform. Conclusions: Electronic systems such as the ones described in this paper allow immunization data to be collected, analyzed, and applied in a rapid fashion, and represent the infostructure required to establish a population-based immunization registry, critical for comprehensively assessing vaccine coverage.

Although many studies have demonstrated the benefits of reminder/recall (RR) measures to address patient under-immunization and improve immunization coverage, they are not widely implemented by healthcare providers. We identified providers’ perceived barriers to their use from existing literature.

Immunization information systems (IISs) are electronic registries used to monitor individual vaccination status and assess vaccine coverage. IISs are currently not widely used across Canada, where health jurisdictions employ a range of approaches to capture influenza immunization information. Conducted in advance of the 2009 H1N1 vaccination campaign, the objectives of this study were to understand the perceived value of individual-level data and IISs for influenza control, identify ideal system functions, and explore barriers to implementation.

The collection of individual-level pandemic (H1N1) 2009 influenza immunization data was considered important to facilitate optimal vaccine delivery and accurate assessment of vaccine coverage. These data are also critical for research aimed at evaluating the new vaccine's safety and effectiveness. Systems used to collect immunization data include manual approaches in which data are collected and retained on paper, electronic systems in which data are captured on computer at the point of vaccination and hybrid systems which are comprised of both computerized and manual data collection components. This study's objective was to compare the efficiencies and perceptions of data collection methods employed during Canada's pandemic (H1N1) 2009 influenza vaccination campaign.