Do-Gyeong Kim
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Do-Gyeong Kim has a total of 2 co-authors. Here are the top co-authors by number of shared publications:
- Dong Gi Seo
Department of Psychology, College of Social Science, Hallym University, Chuncheon, Korea
2 shared publications - Jeongwook Choi
Department of Psychology, College of Social Science, Hallym University, Chuncheon, Korea
1 shared publication
Latest Publications
- Open Access
- 10 October 2025
- Published by Korea Health Personnel Licensing Examination Institute in Journal of Educational Evaluation for Health Professions
- Vol. 22, 31
The impact of differential item functioning on ability estimation using the Korean Medical License Examination with computerized adaptive testing: a post-hoc simulation study
Purpose: This study examined the impact of differential item functioning (DIF) on ability estimation in a computerized adaptive testing (CAT) environment using real response data from the 2017 Korean Medical Licensing Examination (KMLE). We hypothesized that excluding gender-based DIF items would improve estimation accuracy, particularly for examinees at the extremes of the ability scale.Methods: The study was conducted in 2 steps: (1) DIF detection and (2) post-hoc simulation. The analysis used data from 3,259 examinees who completed all 360 dichotomous items. Gender-based DIF was detected with the residual-based DIF method (reference group: males; focal group: females). Two CAT conditions (all items vs. DIF-excluded) were compared against a “true θ” estimated from a fixed-form test of 264 non-DIF items. Accuracy was evaluated using bias, root mean square error (RMSE), and correlation with true θ.Results: In the CAT condition excluding DIF items, accuracy improved, with RMSE reduced and correlation with true θ increased. However, bias was slightly larger in magnitude. Gender-specific analyses showed that DIF removal reduced the underestimation of female ability but increased the underestimation of male ability, yielding estimates that were fairer across genders. When DIF items were included, estimation errors were more pronounced at both low and high ability levels.Conclusion: Managing DIF in CAT-based high-stakes examinations can enhance fairness and precision. Using real examinee data, this study provides practical evidence of the implications of DIF for CAT-based measurement and supports fairness-oriented test design.
- 10 October 2025
- Published by Korea Health Personnel Licensing Examination Institute in Journal of Educational Evaluation for Health Professions
- Vol. 22, 31
Open AccessThe impact of differential item functioning on ability estimation using the Korean Medical License Examination with computerized adaptive testing: a post-hoc simulation study
Purpose: This study examined the impact of differential item functioning (DIF) on ability estimation in a computerized adaptive testing (CAT) environment using real response data from the 2017 Korean Medical Licensing Examination (KMLE). We hypothesized that excluding gender-based DIF items would improve estimation accuracy, particularly for examinees at the extremes of the ability scale.Methods: The study was conducted in 2 steps: (1) DIF detection and (2) post-hoc simulation. The analysis used data from 3,259 examinees who completed all 360 dichotomous items. Gender-based DIF was detected with the residual-based DIF method (reference group: males; focal group: females). Two CAT conditions (all items vs. DIF-excluded) were compared against a “true θ” estimated from a fixed-form test of 264 non-DIF items. Accuracy was evaluated using bias, root mean square error (RMSE), and correlation with true θ.Results: In the CAT condition excluding DIF items, accuracy improved, with RMSE reduced and correlation with true θ increased. However, bias was slightly larger in magnitude. Gender-specific analyses showed that DIF removal reduced the underestimation of female ability but increased the underestimation of male ability, yielding estimates that were fairer across genders. When DIF items were included, estimation errors were more pronounced at both low and high ability levels.Conclusion: Managing DIF in CAT-based high-stakes examinations can enhance fairness and precision. Using real examinee data, this study provides practical evidence of the implications of DIF for CAT-based measurement and supports fairness-oriented test design.
- 30 April 2020
- Published by Korean Institute of Information Technology in The Journal of Korean Institute of Information Technology
- Vol. 18 (4) , 77-87
Accuracy and Efficiency of Web-based Assessment Platform (LIVECAT) for Computerized Adaptive Testing
최근 컴퓨터 기반 맞춤형 검사에 대한 필요성이 증가하는 데 반해 현장적용 수준은 미미한 편이다. 이에 본 연구는 컴퓨터 기반 맞춤형 검사를 실질적으로 구현할 수 있는 웹 기반 플랫폼, LIVECAT을 개발하고, 개발한 플랫폼의 정확성과 효율성을 검증하였다. 해당 플랫폼은 문항반응이론을 적용한 컴퓨터 기반 맞춤형 검사를 활용하여 문항은행의 제작 및 관리부터 검사의 제작, 검사 시행, 결과 제공까지 가능하도록 개발되었다. H 대학교 전공강의 수업 수강생 141명을 대상으로 해당 플랫폼의 정확성 및 효율성 검증을 위한 연구를 진행하였다. 그 결과, LIVECAT을 통해 추정된 능력모수와 지필검사를 통해 추정한 능력모수의 상관계수가 .779(p<.001)로 산출되었다. 또한 LIVECAT을 활용한 검사의 길이가 지필검사의 길이보다 약 33% 짧았다. 즉, LIVECAT을 활용할 경우 지필검사보다 더 적은 수의 문항을 통해 지필검사의 결과와 비슷한 수준의 결과를 제공할 수 있음을 검증하였다.
- 30 April 2020
- Published by Korean Institute of Information Technology in The Journal of Korean Institute of Information Technology
- Vol. 18 (4) , 77-87
Accuracy and Efficiency of Web-based Assessment Platform (LIVECAT) for Computerized Adaptive Testing
최근 컴퓨터 기반 맞춤형 검사에 대한 필요성이 증가하는 데 반해 현장적용 수준은 미미한 편이다. 이에 본 연구는 컴퓨터 기반 맞춤형 검사를 실질적으로 구현할 수 있는 웹 기반 플랫폼, LIVECAT을 개발하고, 개발한 플랫폼의 정확성과 효율성을 검증하였다. 해당 플랫폼은 문항반응이론을 적용한 컴퓨터 기반 맞춤형 검사를 활용하여 문항은행의 제작 및 관리부터 검사의 제작, 검사 시행, 결과 제공까지 가능하도록 개발되었다. H 대학교 전공강의 수업 수강생 141명을 대상으로 해당 플랫폼의 정확성 및 효율성 검증을 위한 연구를 진행하였다. 그 결과, LIVECAT을 통해 추정된 능력모수와 지필검사를 통해 추정한 능력모수의 상관계수가 .779(p<.001)로 산출되었다. 또한 LIVECAT을 활용한 검사의 길이가 지필검사의 길이보다 약 33% 짧았다. 즉, LIVECAT을 활용할 경우 지필검사보다 더 적은 수의 문항을 통해 지필검사의 결과와 비슷한 수준의 결과를 제공할 수 있음을 검증하였다.