JCJeongwook Choi

Jeongwook Choi

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Jeongwook Choi has a total of 16 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • A practical guide to automated test assembly for educational evaluation in health professions: a demonstration using the R package ROI

    by Hwanggyu Lim, Kyung Sik Kim, Jeongwook Choi

    Automated test assembly (ATA) using mixed-integer programming (MIP) is standard practice in international testing organizations, but detailed and accessible practical guidelines remain scarce for health professions assessment. This study introduces the mathematical foundations of MIP-based ATA and provides a step-by-step tutorial demonstrating its implementation with the open-source R package ROI and the HiGHS solver. We constructed a modified 928-item pool with empirical item parameters from the Clinical Medical Science Comprehensive Examination, establishing 31 content categories and 18 enemy-item groups. Using the ROI package and the HiGHS solver, we modeled and solved 3 assembly scenarios: a single 80-item form under a relative target, 2 parallel 80-item forms under a relative target, and 2 parallel 80-item forms under an absolute target combined with additional mean item difficulty constraints. All 3 optimization scenarios satisfied the test-length, content-blueprint, and enemy-item constraints. The relative-target forms attained observed-to-target information ratios within rounding error of the targets, producing closely equivalent parallel forms. The absolute-target forms closely approximated the specified information curve, with a maximum deviation of 0.27 information units, and their mean difficulties fell within the targeted range of 0.2 to 0.4. All formulated MIP models converged to optimal solutions within a few minutes. The practical combination of the ROI package and the HiGHS solver offers an efficient, reproducible, and cost-effective method for test assembly. This approach may enable Korean health professions examination programs to construct psychometrically equivalent and content-balanced test forms, facilitating the transition toward item-bank-based testing systems.

  • Psychometric characteristics of Korean Medical Licensing Examination items from 2012 to 2022 analyzed using the Rasch model and 2-parameter logistic model

    by Dong Gi Seo, Jeongwook Choi, Mee Young Kim, Sun Huh

    Purpose: This study characterized the psychometric properties of Korean Medical Licensing Examination items administered from 2012 to 2022 using the Rasch and 2-parameter logistic models and descriptively examined items classified as highly difficult.Methods: Item parameters were estimated separately for each examination year using the Rasch and 2-parameter logistic models implemented in the irtQ package in R. Descriptive statistics and correlations between model-based difficulty estimates were calculated. Items with a 2-parameter logistic difficulty estimate of b ≥2.0 were subjected to content analysis.Results: Correlations between Rasch and 2-parameter logistic item-difficulty estimates ranged from 0.70 to 0.80 across examination years. Under the 2-parameter logistic model, the proportion of items with b ≥2.0 ranged from 4.7% to 8.9% and showed no monotonic temporal trend; the proportions were 5.0% in 2021 and 5.6% in 2022. The Rasch model generally produced smaller estimated standard errors than the 2-parameter logistic model.Conclusion: Rasch and 2-parameter logistic difficulty estimates showed strongly correlated rankings, although correlation alone did not establish agreement between their absolute estimates. The Rasch model demonstrated greater numerical stability under the present calibration conditions, but model selection should also consider model fit, test information, and the intended use of scores. Because examination years were calibrated separately and no pre-disclosure or control condition was available, the observed annual differences cannot be interpreted as evidence that item disclosure caused changes in item difficulty or discrimination.

  • Open Access

    The impact of differential item functioning on ability estimation using the Korean Medical License Examination with computerized adaptive testing: a post-hoc simulation study

    by Dogyeong Kim, Jeongwook Choi, Dong Gi Seo

    Purpose: This study examined the impact of differential item functioning (DIF) on ability estimation in a computerized adaptive testing (CAT) environment using real response data from the 2017 Korean Medical Licensing Examination (KMLE). We hypothesized that excluding gender-based DIF items would improve estimation accuracy, particularly for examinees at the extremes of the ability scale.Methods: The study was conducted in 2 steps: (1) DIF detection and (2) post-hoc simulation. The analysis used data from 3,259 examinees who completed all 360 dichotomous items. Gender-based DIF was detected with the residual-based DIF method (reference group: males; focal group: females). Two CAT conditions (all items vs. DIF-excluded) were compared against a “true θ” estimated from a fixed-form test of 264 non-DIF items. Accuracy was evaluated using bias, root mean square error (RMSE), and correlation with true θ.Results: In the CAT condition excluding DIF items, accuracy improved, with RMSE reduced and correlation with true θ increased. However, bias was slightly larger in magnitude. Gender-specific analyses showed that DIF removal reduced the underestimation of female ability but increased the underestimation of male ability, yielding estimates that were fairer across genders. When DIF items were included, estimation errors were more pronounced at both low and high ability levels.Conclusion: Managing DIF in CAT-based high-stakes examinations can enhance fairness and precision. Using real examinee data, this study provides practical evidence of the implications of DIF for CAT-based measurement and supports fairness-oriented test design.

  • Open Access

    Feasibility of applying computerized adaptive testing to the Clinical Medical Science Comprehensive Examination in Korea: a psychometric study

    by Jeongwook Choi, Sung-Soo Jung, Eun Kwang Choi, Kyung Sik Kim, Dong Gi Seo

    Purpose: This study aimed to investigate the feasibility of transitioning the Clinical Medical Science Comprehensive Examination (CMSCE) to computerized adaptive testing (CAT) in Korea, thereby providing greater opportunities for medical students to accurately compare their clinical competencies with peers nationwide and to monitor their own progress.Methods: A medical self-assessment using CAT was conducted from March to June 2023, involving 1,541 medical students who volunteered from 40 medical colleges in Korea. An item bank consisting of 1,145 items from previously administered CMSCE examinations (2019–2021) hosted by the Medical Education Assessment Corporation was established. Items were selected through 2-stage filtering, based on classical test theory (discrimination index above 0.15) and item response theory (discrimination parameter estimates above 0.6 and difficulty parameter estimates between –5 and +5). Maximum Fisher information was employed as the item selection method, and maximum likelihood estimation was used for ability estimation.Results: The CAT was successfully administered without significant issues. The stopping rule was set at a standard error of measurement of 0.25, with a maximum of 50 items for ability estimation. The mean ability score was 0.55, with an average of 28 items administered per student. Students at extreme ability levels reached the maximum of 50 items due to the limited availability of items at appropriate difficulty levels.Conclusion: The medical self-assessment CAT, the first of its kind in Korea, was successfully implemented nationwide without significant problems. These results indicate strong potential for expanding the use of CAT in medical education assessments.

  • Open Access

    Development of Preliminary Seismic Performance Evaluation Method for Water Supply Pipes considering Hydraulic Characteristics

    by Jeongwook Choi, Doosun Kang, Donghwi Jung, Chanwook Lee, Do Guen Yoo, Seong-Bae Jo

    The seismic performance evaluation of water supply systems is generally conducted in two stages: a preliminary and a detailed evaluation process. In the case of water pipelines, the priority pipes are selected through preliminary evaluation for a detailed evaluation. However, as the preliminary seismic performance evaluation method for existing water pipes solely focuses on their installation year and structural evaluation, it does not reflect the hydraulic characteristics of the water supply, which is the main purpose of water pipes. Therefore, this study proposed an evaluation method for the existing preliminary evaluation judgment index, by considering the calculation method for the probability of spatial failure, as well as the index obtained through hydraulic analysis results. The proposed methodology was applied to a domestic regional water supply system to be verified, and the results were analyzed. The proposed method is expected to serve as a result of basic research to enhance the seismic performance evaluation method in the future.

  • Open Access

    Introduction to the LIVECAT web-based computerized adaptive testing platform

    by Dong Gi Seo, Jeongwook Choi

    This study introduces LIVECAT, a web-based computerized adaptive testing platform. This platform provides many functions, including writing item content, managing an item bank, creating and administering a test, reporting test results, and providing information about a test and examinees. The LIVECAT provides examination administrators with an easy and flexible environment for composing and managing examinations. It is available at http://www.thecatkorea.com/. Several tools were used to program LIVECAT, as follows: operating system, Amazon Linux; web server, nginx 1.18; WAS, Apache Tomcat 8.5; database, Amazon RDMS—Maria DB; and languages, JAVA8, HTML5/CSS, Javascript, and jQuery. The LIVECAT platform can be used to implement several item response theory (IRT) models such as the Rasch and 1-, 2-, 3-parameter logistic models. The administrator can choose a specific model of test construction in LIVECAT. Multimedia data such as images, audio files, and movies can be uploaded to items in LIVECAT. Two scoring methods (maximum likelihood estimation and expected a posteriori) are available in LIVECAT and the maximum Fisher information item selection method is applied to every IRT model in LIVECAT. The LIVECAT platform showed equal or better performance compared with a conventional test platform. The LIVECAT platform enables users without psychometric expertise to easily implement and perform computerized adaptive testing at their institutions. The most recent LIVECAT version only provides a dichotomous item response model and the basic components of CAT. Shortly, LIVECAT will include advanced functions, such as polytomous item response models, weighted likelihood estimation method, and content balancing method.


  • The influence of behavioral and emotional characteristics on academic achievement of middle school students: A growth modeling approach

    by Yujeong Park, Dong Gi Seo, Jaekook Park, Byungkeon Kim, Jeongwook Choi

    The purpose of this study was to examine the associations between behavioral and emotional characteristics and middle school student achievement across different grades based on a growth modeling approach. Using a total of 1,874 students, target predictor variables (i.e., attention, aggressiveness, behavioral control, social withdrawal, depression, self-esteem) and dependent variables (i.e., Korean language arts, mathematics) were extracted from a national and longitudinal data set, and four predictor models were formulated to examine the influence of behavioral/emotional characteristics on student growth trajectories. Results showed that (a) students' initial performance at seventh grade did not predict their over-time growth; and (b) self-esteem and behavioral control variables impacted on the seventh graders' achievement as well as their growth from the seventh to ninth grade. Based on the findings, practical implications and future research are discussed.


  • Open Access

    Post-hoc simulation study of computerized adaptive testing for the Korean Medical Licensing Examination

    by Dong Gi Seo, Jeongwook Choi

    Purpose: Computerized adaptive testing (CAT) has been adopted in licensing examinations because it improves the efficiency and accuracy of the tests, as shown in many studies. This simulation study investigated CAT scoring and item selection methods for the Korean Medical Licensing Examination (KMLE). Methods: This study used a post-hoc (real data) simulation design. The item bank used in this study included all items from the January 2017 KMLE. All CAT algorithms for this study were implemented using the ‘catR’ package in the R program. Results: In terms of accuracy, the Rasch and 2-parametric logistic (PL) models performed better than the 3PL model. The ‘modal a posteriori’ and ‘expected a posterior’ methods provided more accurate estimates than maximum likelihood estimation or weighted likelihood estimation. Furthermore, maximum posterior weighted information and minimum expected posterior variance performed better than other item selection methods. In terms of efficiency, the Rasch model is recommended to reduce test length. Conclusion: Before implementing live CAT, a simulation study should be performed under varied test conditions. Based on a simulation study, and based on the results, specific scoring and item selection methods should be predetermined.