Development of a survey to support assessment of safety learning systems
Open Access
- 26 June 2024
- journal article
- research article
- Published by BMJ in BMJ Open Quality
- Vol. 13 (2) , e002738
Abstract
Background Patient safety learning systems play a critical role in supporting safety culture in healthcare organisations. A lack of explicit standards leads to inconsistent implementation across organisations, causing uncertainty about their roles and impact. Organisations can address inconsistent implementation by using a self-assessment tool based on agreed-on best practices. Therefore, we aimed to create a survey instrument to assess an organisation’s approach to learning from safety events. Methods The foundation for this work was a recent systematic review that defined features associated with the performance of a safety learning system. We organised features into themes and rephrased them into questions (items). Face validity was checked, which included independent pre-testing to ensure comprehensibility and parsimony. It also included clinical sensibility testing in which a representative sample of leaders in quality at a large teaching hospital (The Ottawa Hospital) answered two questions to judge each item for clarity and necessity. If more than 20% of respondents judged a question unclear or unnecessary, we modified or removed that question accordingly. Finally, we checked the internal consistency of the questionnaire using Cronbach’s alpha. Results We initially developed a 47-item questionnaire based on a prior systematic review. Pre-testing resulted in the modification of 15 of the questions, 2 were removed and 2 questions were added to ensure comprehensiveness and relevance. Face validity was assessed through yes/no responses, with over 80% of respondents confirming the clarity and 85% the necessity of each question, leading to the retention of all 47 questions. Data collected from the five-point responses (strongly disagree to strongly agree) for each question were used to assess the questionnaire’s internal consistency. The Cronbach’s alpha was 0.94, indicating a high internal consistency. Conclusion This self-assessment questionnaire is evidence-based and on preliminary testing is deemed valid, comprehensible and reliable. Future work should assess the range of survey responses in a large sample of respondents from different hospitals.Keywords
This publication has 17 references indexed in Scilit:
- Barriers and facilitators to improving patient safety learning systems: a systematic review of qualitative studies and meta-synthesisBMJ Open Quality, 2023
- Controlling and Preventing Errors and Pitfalls in Neonatal Care Delivery2023
- How incident reporting systems can stimulate social and participative learning: A mixed-methods studyHealth Policy, 2020
- Development of a theoretical framework of factors affecting patient safety incident reporting: a theoretical review of the literatureBMJ Open, 2017
- The problem with incident reportingBMJ Quality & Safety, 2015
- Patient safety incident reporting: a qualitative study of thoughts and perceptions of experts 15 years after ‘To Err is Human’BMJ Quality & Safety, 2015
- The reliability of a two-item scale: Pearson, Cronbach, or Spearman-Brown?International Journal of Public Health, 2012
- The challenge of collective learning from event analysisSafety Science, 2011
- Reporting and Learning Systems2010
- Beyond blame: cultural barriers to medical incident reportingSocial Science & Medicine, 2005