Does higher performance in a national licensing examination predict better quality of care? A longitudinal observational study of Ethiopian anesthetists
Open Access
- 27 May 2024
- journal article
- research article
- Published by Springer Nature in BMC Anesthesiology
- Vol. 24 (1) , 188
Abstract
Background: Ethiopia made a national licensing examination (NLE) for associate clinician anesthetists a requirement for entry into the practice workforce. However, there is limited empirical evidence on whether the NLE scores of associate clinicians predict the quality of health care they provide in low-income countries. This study aimed to assess the association between anesthetists’ NLE scores and three selected quality of patient care indicators. Methods: A multicenter longitudinal observational study was conducted between January 8 and February 7, 2023, to collect quality of care (QoC) data on surgical patients attended by anesthetists (n = 56) who had taken the Ethiopian anesthetist NLE since 2019. The three QoC indicators were standards for safe anesthesia practice, critical incidents, and patient satisfaction. The medical records of 991 patients were reviewed to determine the standards for safe anesthesia practice and critical incidents. A total of 400 patients responded to the patient satisfaction survey. Multivariable regressions were employed to determine whether the anesthetist NLE score predicted QoC indicators. Results: The mean percentage of safe anesthesia practice standards met was 69.14%, and the mean satisfaction score was 85.22%. There were 1,120 critical incidents among 911 patients, with three out of five experiencing at least one. After controlling for patient, anesthetist, facility, and clinical care-related confounding variables, the NLE score predicted the occurrence of critical incidents. For every 1% point increase in the total NLE score, the odds of developing one or more critical incidents decreased by 18% (aOR = 0.82; 95% CI = 0.70 = 0.96; p = 0.016). No statistically significant associations existed between the other two QoC indicators and NLE scores. Conclusion: The NLE score had an inverse relationship with the occurrence of critical incidents, supporting the validity of the examination in assessing graduates’ ability to provide safe and effective care. The lack of an association with the other two QoC indicators requires further investigation. Our findings may help improve education quality and the impact of NLEs in Ethiopia and beyond.Keywords
Funding Information
- Ethiopia USAID (72066320CA00008)
This publication has 33 references indexed in Scilit:
- Safe Surgery for All: Early Lessons from Implementing a National Government‐Driven Surgical Plan in EthiopiaWorld Journal of Surgery, 2017
- Preparing the health workforce in Ethiopia: A Cross-sectional study of competence of anesthesia graduating studentsEducation for Health, 2016
- Global Surgery 2030: evidence and solutions for achieving health, welfare, and economic developmentThe Lancet, 2015
- Proposed Minimum Rates of Surgery to Support Desirable Health Outcomes: An Observational Study Based on Three StrategiesWorld Journal of Surgery, 2015
- The Relationship Between Licensing Examination Performance and the Outcomes of Care by International Medical School GraduatesAcademic Medicine, 2014
- Statistics corner: A guide to appropriate use of correlation coefficient in medical research.2012
- Doctor scores on national qualifying examinations predict quality of care in future practiceMedical Education, 2009
- Physician Scores on a National Clinical Skills Examination as Predictors of Complaints to Medical Regulatory AuthoritiesJAMA, 2007
- Nontechnical Skills in Anesthesia Crisis Management with Repeated Exposure to Simulation-based EducationAnesthesiology, 2005
- Association Between Licensure Examination Scores and Practice in Primary CareJAMA, 2002