Measuring Implementation of Health Promoting School (HPS) Programs: Development and Psychometric Evaluation of the HPS Implementation Questionnaire
Open Access
- 28 December 2022
- journal article
- research article
- Published by Wiley in Journal of School Health
- Vol. 93 (6) , 450-463
Abstract
BACKGROUND: Implementation of Health Promoting School (HPS) programs can be challenging due to the dynamic school context. Navigating between program fidelity and adaptation, as well as integrating the program, is essential for successful implementation, and consequently, for program effects. As part of an evaluation study in the Netherlands, this study aimed to develop a measurement instrument that differentiates schools according to fidelity, adaptation, and integration of HPS implementation.METHODS: This study presents the development and psychometric evaluation of the 28‐item HPS Implementation Questionnaire, covering 7 dimensions: adherence, dose, participant responsiveness, quality of delivery, program differentiation, adaptation, and integration. The questionnaire, to be filled out by school employees, was developed for primary, secondary, secondary vocational, and special needs education, in close collaboration with experts (n = 54) in school health promotion.RESULTS: Semi‐structured interviews aimed at dimension clarification resulted in a list of 58 items. Items were revised, combined, and/or removed based on quantitative and qualitative feedback by the evaluation study's Community of Practice, 2‐round expert consultation, and pre‐tests. Psychometric evaluation (n = 535 schools), consisting of calculating Cronbach's α and confirmatory factor analysis (CFA), confirmed internal consistency (α > .72) and the 7‐dimension framework.CONCLUSION: The brief yet comprehensive HPS Implementation Questionnaire offers possibilities for research into HPS implementation in various educational sectors and contexts, as well as self‐monitoring by individual schools. This study provides first evidence for internal consistency and validity of the questionnaire.Keywords
Funding Information
- ZonMw (Grant/Award Number: 531001113)
This publication has 54 references indexed in Scilit:
- Phases of school health promotion implementation through the lens of complexity theory: lessons learnt from an Austrian case studyHealth Promotion International, 2010
- Elaborating on systems thinking in health promotion practiceGlobal Health Promotion, 2009
- An Empirical Evaluation of the Use of Fixed Cutoff Points in RMSEA Test Statistic in Structural Equation ModelsSociological Methods & Research, 2008
- Implementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting ImplementationAmerican Journal of Community Psychology, 2008
- Becoming a health promoting school: evaluating the process of effective implementation in ScotlandHealth Promotion International, 2006
- Using thematic analysis in psychologyQualitative Research in Psychology, 2006
- Building Consensus Using the Policy Delphi MethodPolicy, Politics, & Nursing Practice, 2000
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesStructural Equation Modeling: A Multidisciplinary Journal, 1999
- Evaluating text quality: the continuum from text-focused to reader-focused methodsIEEE Transactions on Professional Communication, 1989
- Coefficient Alpha and the Internal Structure of TestsPsychometrika, 1951