Psychometric characteristics of Korean Medical Licensing Examination items from 2012 to 2022 analyzed using the Rasch model and 2-parameter logistic model
- 4 August 2026
- journal article
- Published by Korea Health Personnel Licensing Examination Institute in Journal of Educational Evaluation for Health Professions
- Vol. 23, 23
Abstract
Purpose: This study characterized the psychometric properties of Korean Medical Licensing Examination items administered from 2012 to 2022 using the Rasch and 2-parameter logistic models and descriptively examined items classified as highly difficult.Methods: Item parameters were estimated separately for each examination year using the Rasch and 2-parameter logistic models implemented in the irtQ package in R. Descriptive statistics and correlations between model-based difficulty estimates were calculated. Items with a 2-parameter logistic difficulty estimate of b ≥2.0 were subjected to content analysis.Results: Correlations between Rasch and 2-parameter logistic item-difficulty estimates ranged from 0.70 to 0.80 across examination years. Under the 2-parameter logistic model, the proportion of items with b ≥2.0 ranged from 4.7% to 8.9% and showed no monotonic temporal trend; the proportions were 5.0% in 2021 and 5.6% in 2022. The Rasch model generally produced smaller estimated standard errors than the 2-parameter logistic model.Conclusion: Rasch and 2-parameter logistic difficulty estimates showed strongly correlated rankings, although correlation alone did not establish agreement between their absolute estimates. The Rasch model demonstrated greater numerical stability under the present calibration conditions, but model selection should also consider model fit, test information, and the intended use of scores. Because examination years were calibrated separately and no pre-disclosure or control condition was available, the observed annual differences cannot be interpreted as evidence that item disclosure caused changes in item difficulty or discrimination.Keywords
Funding Information
- Korea Health Personnel Licensing Examination Institute (RE02-2438-01)
- National Research Foundation of Korea (2024S1A5A2A01023893)
This publication has 5 references indexed in Scilit:
- The irtQ R package: a user-friendly tool for item response theory-based test data analysis and calibrationJournal of Educational Evaluation for Health Professions, 2024
- Item exposure and utilization control methods for optimal test assemblyBehaviormetrika, 2023
- Item difficulty index, discrimination index, and reliability of the 26 health professions licensing examinations in 2022, Korea: a psychometric studyJournal of Educational Evaluation for Health Professions, 2023
- Accuracy and Efficiency of Web-based Assessment Platform (LIVECAT) for Computerized Adaptive TestingThe Journal of Korean Institute of Information Technology, 2020
- Can computerized tests be introduced to the Korean Medical Licensing Examination?Journal of the Korean Medical Association, 2012