Christine P. Kowalski
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Christine P. Kowalski has a total of 34 co-authors. Here are the top co-authors by number of shared publications:
- Michele Heisler
Department of Health Behavior and Health Equity, University of Michigan School of Public Health, Ann Arbor, Michigan
2 shared publications - Alison B. Hamilton
Department of Psychiatry and Biobehavioral Sciences University of California Los Angeles Los Angeles California USA
1 shared publication - Allison A. Lewinski
Durham Center of Innovation to Accelerate Discovery and Practice Transformation, Durham Veterans Affairs Medical Center, and School of Nursing, Duke University, Durham, North Carolina (A.A.L.)
1 shared publication Amanda M. Midboe
Center for Innovation to Implementation (Ci2i), Palo Alto Health Care System, Menlo Park, USA
1 shared publication- Amy M. Kilbourne
Department of Learning Health Sciences, University of Michigan Medical School
1 shared publication - Andrea Altschuler
Research Project Manager for the Division of Research in Oakland, CA.
1 shared publication
Latest Publications
- Top Cited PapersOpen Access
- 11 October 2024
- Published by Springer Nature in Implementation Science
- Vol. 19 (1) , 1-14
Planning for and Assessing Rigor in Rapid Qualitative Analysis (PARRQA): a consensus-based framework for designing, conducting, and reporting
Background: The use of rapid qualitative methods has increased substantially over the past decade in quality improvement and health services research. These methods have gained traction in implementation research and practice, wherein real-time adjustments are often made to optimize processes and outcomes. This brisk increase begs the questions: what does rigor entail in projects that use rapid qualitative analysis (RQA)? How do we define a pragmatic framework to help research teams design and conduct rigorous and valid rapid qualitative projects? How can authors articulate rigor in their methods descriptions? Lastly, how can reviewers evaluate the rigor of rapid qualitative projects?. Methods: A team of seven interdisciplinary qualitative methods experts developed a framework for ensuring rigor and validity in RQA and methods suitable for this analytic approach. We conducted a qualitative evidence synthesis to identify gaps in the literature and then drew upon literature, standard procedures within our teams, and a repository of rapid qualitative training materials to create a planning and reporting framework. We iteratively refined this framework through 11 group working meetings (60-90 minutes each) over the course of one year and invited feedback on items to ensure their completeness, clarity, and comprehensibility. Results: The Planning for and Assessing Rigor in Rapid Qualitative Analysis (PARRQA) framework is organized progressively across phases from design to dissemination, as follows: 1) rigorous design (rationale and staffing), 2) semi-structured data collection (pilot and planning), 3) RQA: summary template development (accuracy and calibration), 4) RQA: matrix analysis (matrices), and 5) rapid qualitative data synthesis. Eighteen recommendations across these sections specify best practices for rigor and validity. Conclusions: Rapid qualitative methods play a central role in implementation evaluations, with the potential to yield prompt information and insights about context, processes, and relationships. However, guidance on how to assess rigor is nascent. The PARRQA framework enhances the literature by offering criteria to ensure appropriate planning for and assessment of rigor in projects that involve RQA. This framework provides a consensus-based resource to support high-level qualitative methodological rigor in implementation science.
- 11 October 2024
- Published by Springer Nature in Implementation Science
- Vol. 19 (1) , 1-14
Top Cited PapersOpen AccessPlanning for and Assessing Rigor in Rapid Qualitative Analysis (PARRQA): a consensus-based framework for designing, conducting, and reporting
Background: The use of rapid qualitative methods has increased substantially over the past decade in quality improvement and health services research. These methods have gained traction in implementation research and practice, wherein real-time adjustments are often made to optimize processes and outcomes. This brisk increase begs the questions: what does rigor entail in projects that use rapid qualitative analysis (RQA)? How do we define a pragmatic framework to help research teams design and conduct rigorous and valid rapid qualitative projects? How can authors articulate rigor in their methods descriptions? Lastly, how can reviewers evaluate the rigor of rapid qualitative projects?. Methods: A team of seven interdisciplinary qualitative methods experts developed a framework for ensuring rigor and validity in RQA and methods suitable for this analytic approach. We conducted a qualitative evidence synthesis to identify gaps in the literature and then drew upon literature, standard procedures within our teams, and a repository of rapid qualitative training materials to create a planning and reporting framework. We iteratively refined this framework through 11 group working meetings (60-90 minutes each) over the course of one year and invited feedback on items to ensure their completeness, clarity, and comprehensibility. Results: The Planning for and Assessing Rigor in Rapid Qualitative Analysis (PARRQA) framework is organized progressively across phases from design to dissemination, as follows: 1) rigorous design (rationale and staffing), 2) semi-structured data collection (pilot and planning), 3) RQA: summary template development (accuracy and calibration), 4) RQA: matrix analysis (matrices), and 5) rapid qualitative data synthesis. Eighteen recommendations across these sections specify best practices for rigor and validity. Conclusions: Rapid qualitative methods play a central role in implementation evaluations, with the potential to yield prompt information and insights about context, processes, and relationships. However, guidance on how to assess rigor is nascent. The PARRQA framework enhances the literature by offering criteria to ensure appropriate planning for and assessment of rigor in projects that involve RQA. This framework provides a consensus-based resource to support high-level qualitative methodological rigor in implementation science.
- Open Access
- 6 October 2022
- Published by Cambridge University Press (CUP) in Journal of Clinical and Translational Science
- Vol. 6 (1) , 1-61
Facilitating future implementation and translation to clinical practice: The Implementation Planning Assessment Tool for clinical trials
Implementation assessment plans are crucial for clinical trials to achieve their full potential. Without a proactive plan to implement trial results, it can take decades for one-fifth of effective interventions to be adopted into routine care settings. The Veterans Health Administration Office of Research and Development is undergoing a systematic transformation to embed implementation planning in research protocols through the Cooperative Studies Program, its flagship clinical research program. This manuscript has two objectives: 1) to introduce an Implementation Planning Assessment (IPA) Tool that any clinical trialist may use to facilitate post-trial implementation of interventions found to be effective and 2) to provide a case study demonstrating the IPA Tool’s use. The IPA Tool encourages study designers to initially consider rigorous data collection to maximize acceptability of the intervention by end-users. It also helps identify and prepare potential interested parties at local and national leadership levels to ensure, upon trial completion, interventions can be integrated into programs, technologies, and policies in a sustainable way. The IPA Tool can alleviate some of the overwhelming nature of implementation science by providing a practical guide based on implementation science principles for researchers desiring to scale up and spread effective, clinical trial-tested interventions to benefit patients.
- 6 October 2022
- Published by Cambridge University Press (CUP) in Journal of Clinical and Translational Science
- Vol. 6 (1) , 1-61
Open AccessFacilitating future implementation and translation to clinical practice: The Implementation Planning Assessment Tool for clinical trials
Implementation assessment plans are crucial for clinical trials to achieve their full potential. Without a proactive plan to implement trial results, it can take decades for one-fifth of effective interventions to be adopted into routine care settings. The Veterans Health Administration Office of Research and Development is undergoing a systematic transformation to embed implementation planning in research protocols through the Cooperative Studies Program, its flagship clinical research program. This manuscript has two objectives: 1) to introduce an Implementation Planning Assessment (IPA) Tool that any clinical trialist may use to facilitate post-trial implementation of interventions found to be effective and 2) to provide a case study demonstrating the IPA Tool’s use. The IPA Tool encourages study designers to initially consider rigorous data collection to maximize acceptability of the intervention by end-users. It also helps identify and prepare potential interested parties at local and national leadership levels to ensure, upon trial completion, interventions can be integrated into programs, technologies, and policies in a sustainable way. The IPA Tool can alleviate some of the overwhelming nature of implementation science by providing a practical guide based on implementation science principles for researchers desiring to scale up and spread effective, clinical trial-tested interventions to benefit patients.
- Open Access
- 7 July 2018
- Published by Springer Nature in BMC Family Practice
- Vol. 19 (1) , 1-23
Formative evaluation and adaptation of pre-and early implementation of diabetes shared medical appointments to maximize sustainability and adoption
Understanding the many factors that influence implementation of new programs, in addition to their success or failure, is extraordinarily complex. This qualitative study examines the implementation and adaptation process of two linked clinical programs within Primary Care, diabetes shared medical appointments (SMAs) and a reciprocal Peer-to-Peer (P2P) support program for patients with poorly controlled diabetes, through the lens of the Consolidated Framework for Implementation Research (CFIR). We illustrate the role and importance of pre-implementation interviews for guiding ongoing adaptations to improve implementation of a clinical program, achieve optimal change, and avoid type III errors. We conducted 28 semi-structured phone interviews between September of 2013 and May of 2016, four to seven interviewees at each site. The interviewees were physician champions, chiefs of primary care, pharmacists, dieticians, nurses, health psychologists, peer facilitators, and research coordinators. Modifiable barriers and facilitators to implementation were identified and adaptations documented. Data analysis started with immersion in the data to obtain a sense of the whole and then by cataloging principal themes per CFIR constructs. An iterative consensus-building process was used to code. CFIR constructs were then ranked and compared by the researchers. We identified a subset of CFIR constructs that are most likely to play a role in the effectiveness of the diabetes SMAs and P2P program based on our work with the participating sites to date. Through the identification of barriers and facilitators, a subset of CFIR constructs arose, including evidence strength and quality, relative advantage, adaptability, complexity, patient needs and resources, compatibility, leadership engagement, available resources, knowledge and beliefs, and champions. We described our method for identification of contextual factors that influenced implementation of complex diabetes clinical programs - SMAs and P2P. The qualitative phone interviews aided implementation through the identification of modifiable barriers or conversely, actionable findings. Implementation projects, and certainly clinical programs, do not have unlimited resources and these interviews allowed us to determine which facets to target and act on for each site. As the study progresses, these findings will be compared and correlated to outcome measures. This comprehensive adaptation data collection will also facilitate and enhance understanding of the future success or lack of success of implementation and inform potential for translation and public health impact. The approach of using the CFIR to guide us to actionable findings and help us better understand barriers and facilitators has broad applicability and can be used by other projects to guide, adapt, and improve implementation of research into practice. ClinicalTrials.gov ID: NCT02132676 .
- 7 July 2018
- Published by Springer Nature in BMC Family Practice
- Vol. 19 (1) , 1-23
Open AccessFormative evaluation and adaptation of pre-and early implementation of diabetes shared medical appointments to maximize sustainability and adoption
Understanding the many factors that influence implementation of new programs, in addition to their success or failure, is extraordinarily complex. This qualitative study examines the implementation and adaptation process of two linked clinical programs within Primary Care, diabetes shared medical appointments (SMAs) and a reciprocal Peer-to-Peer (P2P) support program for patients with poorly controlled diabetes, through the lens of the Consolidated Framework for Implementation Research (CFIR). We illustrate the role and importance of pre-implementation interviews for guiding ongoing adaptations to improve implementation of a clinical program, achieve optimal change, and avoid type III errors. We conducted 28 semi-structured phone interviews between September of 2013 and May of 2016, four to seven interviewees at each site. The interviewees were physician champions, chiefs of primary care, pharmacists, dieticians, nurses, health psychologists, peer facilitators, and research coordinators. Modifiable barriers and facilitators to implementation were identified and adaptations documented. Data analysis started with immersion in the data to obtain a sense of the whole and then by cataloging principal themes per CFIR constructs. An iterative consensus-building process was used to code. CFIR constructs were then ranked and compared by the researchers. We identified a subset of CFIR constructs that are most likely to play a role in the effectiveness of the diabetes SMAs and P2P program based on our work with the participating sites to date. Through the identification of barriers and facilitators, a subset of CFIR constructs arose, including evidence strength and quality, relative advantage, adaptability, complexity, patient needs and resources, compatibility, leadership engagement, available resources, knowledge and beliefs, and champions. We described our method for identification of contextual factors that influenced implementation of complex diabetes clinical programs - SMAs and P2P. The qualitative phone interviews aided implementation through the identification of modifiable barriers or conversely, actionable findings. Implementation projects, and certainly clinical programs, do not have unlimited resources and these interviews allowed us to determine which facets to target and act on for each site. As the study progresses, these findings will be compared and correlated to outcome measures. This comprehensive adaptation data collection will also facilitate and enhance understanding of the future success or lack of success of implementation and inform potential for translation and public health impact. The approach of using the CFIR to guide us to actionable findings and help us better understand barriers and facilitators has broad applicability and can be used by other projects to guide, adapt, and improve implementation of research into practice. ClinicalTrials.gov ID: NCT02132676 .
- 3 July 2017
- Published by Emerald Publishing in Journal of Integrated Care
- Vol. 25 (3) , 208-221
Care coordination agreements in the Veterans Healthcare Administration
Purpose: The Veterans Healthcare Administration (VHA) has promoted Specialty Care Neighborhoods (SCN) to enhance the coordination of services between primary and specialty care. Care coordination agreements (CCAs) were included as a critical element in the SCN program. The purpose of this paper is to examine the role of these documents in the successful implementation of SCNs. Design/methodology/approach: Content, quality, and perceived usefulness of CCAs from 19 SCN sites were evaluated. CCA content was defined as the presence or absence of eight key components: contact information, process for urgent consults, process for e-consults, content of consults, primary and specialty care responsibilities, expected response time, discharge criteria, and review criteria. CCA quality was based on a qualitative assessment of CCA content; and perceived usefulness was based on a qualitative assessment of interview responses from CCA users. CCA characteristics were compared to SCN implementation levels using descriptive statistics. SCN implementation level was defined and measured by VHA Specialty Care Services. Findings: Participating sites with medium-high or high SCN implementation levels had CCAs with more key components and of higher quality than sites with medium-low to medium SCN implementation levels. Perceived usefulness of CCAs was not associated with implementation level. Research limitations/implications: Since this study built on a quality improvement effort to facilitate care coordination, a rigorous research approach was not used. Specific CCA components could not be examined nor could specific hypotheses be tested due to the small and diverse sample. Findings presented are only preliminary. Practical implications: The examination of CCAs suggests that these documents may be helpful to improve communication among primary and specialty care providers by explicitly stating agreed upon processes, mechanisms and criteria for referrals, roles and responsibilities for the co-management of patients, and timelines for review of CCAs. Originality/value: This small study suggests that high-quality CCAs, which include a number of key components, can facilitate the implementation of coordinated care. Key characteristics of CCAs are identified in this study, including measures of CCA content, quality, and usefulness, which can be used in future efforts to develop and evaluate efforts to improve care coordination.
- 3 July 2017
- Published by Emerald Publishing in Journal of Integrated Care
- Vol. 25 (3) , 208-221
Care coordination agreements in the Veterans Healthcare Administration
Purpose: The Veterans Healthcare Administration (VHA) has promoted Specialty Care Neighborhoods (SCN) to enhance the coordination of services between primary and specialty care. Care coordination agreements (CCAs) were included as a critical element in the SCN program. The purpose of this paper is to examine the role of these documents in the successful implementation of SCNs. Design/methodology/approach: Content, quality, and perceived usefulness of CCAs from 19 SCN sites were evaluated. CCA content was defined as the presence or absence of eight key components: contact information, process for urgent consults, process for e-consults, content of consults, primary and specialty care responsibilities, expected response time, discharge criteria, and review criteria. CCA quality was based on a qualitative assessment of CCA content; and perceived usefulness was based on a qualitative assessment of interview responses from CCA users. CCA characteristics were compared to SCN implementation levels using descriptive statistics. SCN implementation level was defined and measured by VHA Specialty Care Services. Findings: Participating sites with medium-high or high SCN implementation levels had CCAs with more key components and of higher quality than sites with medium-low to medium SCN implementation levels. Perceived usefulness of CCAs was not associated with implementation level. Research limitations/implications: Since this study built on a quality improvement effort to facilitate care coordination, a rigorous research approach was not used. Specific CCA components could not be examined nor could specific hypotheses be tested due to the small and diverse sample. Findings presented are only preliminary. Practical implications: The examination of CCAs suggests that these documents may be helpful to improve communication among primary and specialty care providers by explicitly stating agreed upon processes, mechanisms and criteria for referrals, roles and responsibilities for the co-management of patients, and timelines for review of CCAs. Originality/value: This small study suggests that high-quality CCAs, which include a number of key components, can facilitate the implementation of coordinated care. Key characteristics of CCAs are identified in this study, including measures of CCA content, quality, and usefulness, which can be used in future efforts to develop and evaluate efforts to improve care coordination.
- Open Access
- 14 September 2016
- Published by JMIR Publications Inc. in JMIR mHealth and uHealth
- Vol. 4 (3) , e108
User-Centered Design of a Tablet Waiting Room Tool for Complex Patients to Prioritize Discussion Topics for Primary Care Visits
Mobile and tablet apps, ubiquitous and pervasive computing, wearable computing and domotics for health.
- 14 September 2016
- Published by JMIR Publications Inc. in JMIR mHealth and uHealth
- Vol. 4 (3) , e108
Open AccessUser-Centered Design of a Tablet Waiting Room Tool for Complex Patients to Prioritize Discussion Topics for Primary Care Visits
Mobile and tablet apps, ubiquitous and pervasive computing, wearable computing and domotics for health.
- Open Access
- 26 April 2013
- Published by Springer Nature in BMC Health Services Research
- Vol. 13 (1) , 151
Variations in risk perceptions: a qualitative study of why unnecessary urinary catheter use continues to be problematic
Catheter associated urinary tract infection (CAUTI) is one of the most commonly acquired health care associated infections within the United States. We examined the implementation of an initiative to prevent CAUTI, to better understand how health care providers’ perceptions of risk influenced their use of prevention practices and the potential impact these risk perceptions have on patient care decisions. Understanding such perceptions are critical for developing more effective approaches to ensure the successful uptake of key patient safety practices and thus safer care for hospitalized patients.
- 26 April 2013
- Published by Springer Nature in BMC Health Services Research
- Vol. 13 (1) , 151
Open AccessVariations in risk perceptions: a qualitative study of why unnecessary urinary catheter use continues to be problematic
Catheter associated urinary tract infection (CAUTI) is one of the most commonly acquired health care associated infections within the United States. We examined the implementation of an initiative to prevent CAUTI, to better understand how health care providers’ perceptions of risk influenced their use of prevention practices and the potential impact these risk perceptions have on patient care decisions. Understanding such perceptions are critical for developing more effective approaches to ensure the successful uptake of key patient safety practices and thus safer care for hospitalized patients.
- 1 April 2007
- Published by Wolters Kluwer Health in Quality Management in Health Care
- Vol. 16 (2) , 174-181
Does Implementation of Evidence-based Guidelines Follow the Available Evidence? Implementation of Hypertension Guidelines at Veterans Affairs Medical Centers
Background We sought to determine whether the proportion of strategies adopted in the implementation of evidence-based clinical guidelines by Department of Veterans Affairs medical centers (VAMCs) reflects an evidence-based assessment of the implementation strategies' relative effectiveness that was widely disseminated among VAMCs. Methods We used data from a multisite observational study we conducted to test a model of changing clinical behaviors. For that study, we had compiled information from key informants at 43 VAMCs about strategies for implementing the VA's new hypertension management guidelines. We had subsequently classified the reported strategies into 41 categories. For this study, we matched these 41 categories to the 8 broad categories of implementation strategies in terms of which effectiveness of strategies had been reported to VAMCs. We compared the 8 categories' rank order on effectiveness with their ranking by number of VAMCs adopting the strategies. Results The effectiveness-based rank ordering does not correspond with rank order based on percentage of VAMCs adopting (Spearman correlation coefficient = −0.4). Discussion Results suggest that institutions, like practitioners, face barriers related to knowledge, attitudes, and behavior—including, in particular, insufficient resources—that impede their following the evidence when choosing guideline implementation strategies.
- 1 April 2007
- Published by Wolters Kluwer Health in Quality Management in Health Care
- Vol. 16 (2) , 174-181
Does Implementation of Evidence-based Guidelines Follow the Available Evidence? Implementation of Hypertension Guidelines at Veterans Affairs Medical Centers
Background We sought to determine whether the proportion of strategies adopted in the implementation of evidence-based clinical guidelines by Department of Veterans Affairs medical centers (VAMCs) reflects an evidence-based assessment of the implementation strategies' relative effectiveness that was widely disseminated among VAMCs. Methods We used data from a multisite observational study we conducted to test a model of changing clinical behaviors. For that study, we had compiled information from key informants at 43 VAMCs about strategies for implementing the VA's new hypertension management guidelines. We had subsequently classified the reported strategies into 41 categories. For this study, we matched these 41 categories to the 8 broad categories of implementation strategies in terms of which effectiveness of strategies had been reported to VAMCs. We compared the 8 categories' rank order on effectiveness with their ranking by number of VAMCs adopting the strategies. Results The effectiveness-based rank ordering does not correspond with rank order based on percentage of VAMCs adopting (Spearman correlation coefficient = −0.4). Discussion Results suggest that institutions, like practitioners, face barriers related to knowledge, attitudes, and behavior—including, in particular, insufficient resources—that impede their following the evidence when choosing guideline implementation strategies.