Net Promoter Score (NPS): What Does Net Promoter Score Offer in the Evaluation of Continuing Medical Education?
Open Access
- 29 November 2022
- journal article
- research article
- Published by Taylor & Francis in Journal of European CME
- Vol. 11 (1) , 2152941
Abstract
Net promoter Score (NPS) has been used in many fields, such as software, clinical care, and websites, as a measure of customer satisfaction since 2003. With a single question, NPS methodology is thought to determine brand loyalty and intent to act based on experiences with the brand or product. In the current study, accredited continuing medical education or continuing education (CME/CE) was the product. Providers of CME have utilised NPS rating (the individual score on a scale of 0 to 10) to collect data about the value of the experience a clinician has with CME activities, but there has been no research to examine what it actually is associated with. This study looked to understand – relative to other self-reported and assessment outcomes in CME, what does NPS at the activity level indicate? From 155 online CME programmes (29,696 target audience learners with complete data), potential outcomes of CME, including whether knowledge or competence improved via assessment score, mean post-confidence rating, and whether one intended practices changes and was committed to those changes, were examined as predictors of NPS. NPS is unique in that it cannot be calculated at the individual level; individual scores must be aggregated, and then the percentage who selected ratings of 0 to 5 is subtracted from the percentage who selected 9 or 10. Results showed that percentage of learners who are committed to change predicts 70% of the variance in NPS, which suggests NPS is a valid indicator of intention to act. These results have implications for how we might, as a field, incorporate the utilisation of a single standardised question to examine the potential impact of online CME and call for additional research on whether NPS predicts change in clinical practice.Keywords
This publication has 10 references indexed in Scilit:
- What Do Reinforcement and Confidence Have to Do with It? A Systematic Pathway Analysis of Knowledge, Competence, Confidence, and Intention to ChangeJournal of European CME, 2020
- Good and bad market research: A critical review of Net Promoter ScoreApplied Stochastic Models in Business and Industry, 2018
- A contemporary approach to validity arguments: a practical guide to K ane's frameworkMedical Education, 2015
- The Net Promoter Score – an asset to patient experience surveys?Health Expectations, 2014
- Relationship Among Practice Change, Motivation, and Self-EfficacyJournal of Continuing Education in the Health Professions, 2014
- Educational Testing Validity and Reliability in Pharmacy and Medical Education LiteratureAmerican Journal of Pharmaceutical Education, 2013
- Achieving desired results and improved outcomes: Integrating planning and assessment throughout learning activitiesJournal of Continuing Education in the Health Professions, 2009
- The Reported Validity and Reliability of Methods for Evaluating Continuing Medical Education: A Systematic ReviewAcademic Medicine, 2008
- The one number you need to grow.2003
- Commitment to change statements can predict actual change in practiceJournal of Continuing Education in the Health Professions, 2003