JPJaime Campos Pavón

Jaime Campos Pavón

*This is an algorithmically generated author record based on publicly available information.

Jaime Campos Pavón has a total of 6 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Construct Validity of Frontier Large Language Models on 4 Spanish Health Professions Specialty-Access Examinations (MIR, EIR, PIR, and FIR): Cross-Sectional Benchmarking and Psychometric Study

    by Clemente García-Hidalgo, Manuel Carpio-Salmerón, Pau Benito, Carlos Carazo-Casas, Beatriz Carratalá, Jaime Campos Pavón

    Background: Large language models (LLMs) achieve high scores on health-professions examinations. Whether these scores support the same interpretations as human scores remains uncertain. Spain uses parallel multiple-choice examinations for entry to specialty training in medicine (Médico Interno Residente [MIR]), nursing (Enfermero Interno Residente [EIR]), psychology (Psicólogo Interno Residente [PIR]), and pharmacy (Farmacéutico Interno Residente [FIR]). Objective: Using the January 2026 MIR, EIR, PIR, and FIR examinations, this study aimed to quantify the correspondence between human and LLM item facility and to describe model accuracy, distractor selection, and performance associated with measured surface features. Methods: We evaluated 839 valid items using 12 configurations: GPT-5.2 at 3 reasoning efforts and Claude Opus, Sonnet, and Haiku 4.5 (Anthropic), each under neutral and expert prompts, with one run per configuration. The primary measure was the Spearman correlation (ρ) between human and machine facility on 828 complete paired items. We examined sensitivity to panel composition, scoring, pooling, and assumed reliability; compared distractor choices with a post hoc plausibility-weighted baseline; and evaluated a surface-feature classifier. Image analyses distinguished supplied from withheld images. An exploratory LLM-judge audit assessed generated explanations. Bootstrap CIs resample items or, for distractor concordance, error events; they exclude run-to-run uncertainty. Results: The highest pooled accuracy was 94.8% (795/839); all 12 configurations answered 668 of 828 paired items correctly (80.7%). Scores clustered near the ceiling among the strongest configurations. Human and machine facility correlated at 0.40 (95% CI 0.34-0.45), with estimates of 0.31 to 0.40 across panel definitions and 0.39 (95% CI 0.33-0.45) after exam-stratified pooling. The observed correlation was lower than predicted by a specified one-axis simulation with a uniform model advantage (0.63; predictive interval 0.59 to 0.66; P <.001). Among 672 model errors, dominant human-distractor selection differed from the plausibility-weighted baseline by –1.25 percentage points (95% CI –4.53 to 2.19), compatible with no difference. Surface-feature accuracy was 34.4% (289/839), similar to selecting the longest option (34.6%, 290/839). The adjusted association with model correctness was uncertain (odds ratio [OR] 0.87, 95% CI 0.72-1.04). Image-associated accuracy was lower both when images were supplied (OR 0.33, 95% CI 0.21-0.53) and when withheld (OR 0.11, 95% CI 0.08-0.16). Conclusions: In this single 2026 cohort, high LLM scores coexisted with limited separation among the strongest configurations and moderate correspondence with human item difficulty. These findings caution against interpreting model scores as equivalent evidence of human competence. They do not establish clinical performance or invalidate the examinations for human candidates.

  • Open Access

    Predictive validity of academy mock tests against MIR exam: a retrospective multicohort observational concordance study

    by Pablo González Castro, Jaime Campos Pavón, Carlos Carazo Casas

    Introduction: MIR examination is a requirement to access Spain’s public specialist training system. This study evaluates, across five years, the concordance between mock exams administered by a MIR preparatory academy and the official MIR results. Methods: Candidate records were linked; on the matched intersection we computed Pearson’s R and Spearman’s ρ (percentiles, net scores), bias (simulation−official), and RMSE. Annual key performance indicators (KPIs) were pair-weighted and analyses stratified by percentile cohorts (≤27, 28–73, >73); heatmap summarize percentile correlations. Results: Across years, weighted percentile correlations typically fell in the 0.71–0.76 range, with small average bias and moderate RMSE. Cohort analyses indicated larger errors at extreme percentiles in some years. Net‑score bias weighted by pairs was near zero overall, with year‑to‑year variability. Conclusions: Academy mock tests provide a broadly consistent ranking signal relative to official MIR outcomes. Residual bias and dispersion suggest potential gains from calibration—particularly at cohort extremes—and motivate routine monitoring of concordance KPIs in future cohorts.