Gabriel Wallin
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Gabriel Wallin has a total of 16 co-authors. Here are the top co-authors by number of shared publications:
- Marie Wiberg
Department of Statistics, Umeå School of Business, Economics and Statistics, Umeå University, Umeå, Sweden
6 shared publications - Yunxiao Chen
Department of Statistics, London School of Economics and Political Science
3 shared publications - Irini Moustaki
London School of Economics
2 shared publications - Jenny Häggström
Department of Statistics, USBE, Umeå University, Umeå, Sweden
2 shared publications - Yawen Ma
Centre for Health Informatics, Computing, and Statistics, Lancaster Medical School, Lancaster University , Lancaster LA1 4YW
2 shared publications Anastasia Ushakova
Centre for Health Informatics, Computing, and Statistics, Lancaster Medical School, Lancaster University , Lancaster LA1 4YW
1 shared publication
Latest Publications
- Open Access
- 30 September 2026
- Published by Wiley in British Journal of Mathematical and Statistical Psychology
A regularised latent‐class item response model for detecting measurement non‐invariance in ordinal response scales
Measurement non‐invariance arises when the psychometric properties of a scale differ across subgroups, undermining the validity of group comparisons. At the item level, this manifests as differential item functioning (DIF), where item responses differ across groups after controlling for the latent trait. This paper develops a framework for detecting DIF in ordinal scales without requiring known group labels or anchor items. We formulate a proportional‐odds latent‐class item response model in which individuals are assigned probabilistically to latent classes. DIF is captured through class‐specific intercept and slope shifts, allowing both uniform and non‐uniform DIF. Identification is achieved through an ‐penalised marginal likelihood under a sparsity assumption, with estimation implemented using a tailored EM algorithm. Because class‐specific slopes leave both the location and scale of each latent class unidentified, sparsity anchors the latent metric while selecting DIF effects. Simulation studies demonstrate accurate recovery of item parameters and both types of DIF. An empirical application to a personality test reveals latent subgroups with distinct response patterns and identifies items displaying potential class‐specific measurement non‐invariance. The framework provides a flexible approach for assessing measurement invariance in ordinal scales when comparison groups are unobserved or poorly defined.
- 30 September 2026
- Published by Wiley in British Journal of Mathematical and Statistical Psychology
Open AccessA regularised latent‐class item response model for detecting measurement non‐invariance in ordinal response scales
Measurement non‐invariance arises when the psychometric properties of a scale differ across subgroups, undermining the validity of group comparisons. At the item level, this manifests as differential item functioning (DIF), where item responses differ across groups after controlling for the latent trait. This paper develops a framework for detecting DIF in ordinal scales without requiring known group labels or anchor items. We formulate a proportional‐odds latent‐class item response model in which individuals are assigned probabilistically to latent classes. DIF is captured through class‐specific intercept and slope shifts, allowing both uniform and non‐uniform DIF. Identification is achieved through an ‐penalised marginal likelihood under a sparsity assumption, with estimation implemented using a tailored EM algorithm. Because class‐specific slopes leave both the location and scale of each latent class unidentified, sparsity anchors the latent metric while selecting DIF effects. Simulation studies demonstrate accurate recovery of item parameters and both types of DIF. An empirical application to a personality test reveals latent subgroups with distinct response patterns and identifies items displaying potential class‐specific measurement non‐invariance. The framework provides a flexible approach for assessing measurement invariance in ordinal scales when comparison groups are unobserved or poorly defined.
- Open Access
- 9 September 2026
- Published by Oxford University Press (OUP) in Journal of the Royal Statistical Society Series A: Statistics in Society
A statistical framework for dynamic cognitive diagnosis in digital learning environments
Reading is foundational for educational, employment, and economic outcomes, but a persistent proportion of students globally struggle to develop adequate reading skills. Some countries promote digital tools to support reading development, alongside regular classroom instruction. Such tools generate rich log data capturing students’ behaviour and performance. This study proposes a dynamic cognitive diagnostic modelling (CDM) framework based on restricted latent class models to trace students’ time-varying skill mastery using log files from digital tools. Unlike traditional CDMs that require expert-defined skill-item mappings (Q-matrix), our approach jointly estimates the Q-matrix and latent skill profiles, integrates log-derived covariates (e.g. reattempts, response times, counts of mastered items) and individual characteristics, and models transitions in mastery using a Bayesian estimation approach. Applied to real-world data, the model demonstrates practical value in educational settings by effectively uncovering individual skill profiles and the skill-item mappings. Simulation studies confirm robust recovery of Q-matrix structures and latent profiles with high accuracy under varied sample sizes, item counts, and different sparsity of Q-matrices. The framework offers a data-driven, time-dependent restricted latent class modelling approach to understanding early reading development.
- 9 September 2026
- Published by Oxford University Press (OUP) in Journal of the Royal Statistical Society Series A: Statistics in Society
Open AccessA statistical framework for dynamic cognitive diagnosis in digital learning environments
Reading is foundational for educational, employment, and economic outcomes, but a persistent proportion of students globally struggle to develop adequate reading skills. Some countries promote digital tools to support reading development, alongside regular classroom instruction. Such tools generate rich log data capturing students’ behaviour and performance. This study proposes a dynamic cognitive diagnostic modelling (CDM) framework based on restricted latent class models to trace students’ time-varying skill mastery using log files from digital tools. Unlike traditional CDMs that require expert-defined skill-item mappings (Q-matrix), our approach jointly estimates the Q-matrix and latent skill profiles, integrates log-derived covariates (e.g. reattempts, response times, counts of mastered items) and individual characteristics, and models transitions in mastery using a Bayesian estimation approach. Applied to real-world data, the model demonstrates practical value in educational settings by effectively uncovering individual skill profiles and the skill-item mappings. Simulation studies confirm robust recovery of Q-matrix structures and latent profiles with high accuracy under varied sample sizes, item counts, and different sparsity of Q-matrices. The framework offers a data-driven, time-dependent restricted latent class modelling approach to understanding early reading development.
- Open Access
- 6 January 2026
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 51 (6) , 1275-1309
Propensity Score Methods for Local Test Score Equating: Stratification and Inverse Probability Weighting
In test equating, ensuring score comparability across different test forms is crucial but particularly challenging when test groups are non-equivalent and no anchor test is available. Local test equating aims to satisfy Lord’s equity requirement by conditioning equating transformations on individual-level information, typically using anchor test scores as proxies for latent ability. However, anchor tests are not always available in practice. This paper introduces two novel propensity score-based methods for local equating: stratification and inverse probability weighting (IPW). These methods use covariates to account for group differences, with propensity scores serving as proxies for latent ability differences between test groups. The stratification method partitions examinees into comparable groups based on similar propensity scores, while IPW assigns weights inversely proportional to the probability of group membership. We evaluate these methods through empirical analysis and simulation studies. Results indicate both methods can effectively adjust for group differences, with their relative performance depending on the strength of covariate-ability correlations. The study extends local equating methodology to cases where only covariate information is available, providing testing programs with new tools for ensuring fair score comparability.
- 6 January 2026
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 51 (6) , 1275-1309
Open AccessPropensity Score Methods for Local Test Score Equating: Stratification and Inverse Probability Weighting
In test equating, ensuring score comparability across different test forms is crucial but particularly challenging when test groups are non-equivalent and no anchor test is available. Local test equating aims to satisfy Lord’s equity requirement by conditioning equating transformations on individual-level information, typically using anchor test scores as proxies for latent ability. However, anchor tests are not always available in practice. This paper introduces two novel propensity score-based methods for local equating: stratification and inverse probability weighting (IPW). These methods use covariates to account for group differences, with propensity scores serving as proxies for latent ability differences between test groups. The stratification method partitions examinees into comparable groups based on similar propensity scores, while IPW assigns weights inversely proportional to the probability of group membership. We evaluate these methods through empirical analysis and simulation studies. Results indicate both methods can effectively adjust for group differences, with their relative performance depending on the strength of covariate-ability correlations. The study extends local equating methodology to cases where only covariate information is available, providing testing programs with new tools for ensuring fair score comparability.
- 1 January 2026
- Published by Psychometric Society
A Comparison of Joint and Stepwise Dynamic Cognitive Diagnostic Models
To extend cognitive diagnostic models (CDMs) to longitudinal settings, stepwise approaches that integrate a CDM model with a latent transition model and covariates are widely used due to their flexibility. Previous research has shown that stepwise estimation can yield biased results, motivating the use of classification error correction to improve inference compared to uncorrected stepwise procedures. In this study, we evaluate a unified Bayesian dynamic cognitive diagnostic model introduced by Y. Ma et al. (2025) that jointly estimates measurement (item parameters, latent attribute profiles) and transition components (transition parameters) in longitudinal settings with covariates. We compare this joint approach with the bias-corrected stepwise latent transition CDM proposed by Liang et al. (2023) through Monte Carlo simulation studies. Results demonstrate that joint modeling provides more accurate recovery of transition parameters, particularly under limited test length and sample size, underscoring its advantages for longitudinal diagnostic analysis and offering practical guidance for applied researchers.
- 1 January 2026
- Published by Psychometric Society
A Comparison of Joint and Stepwise Dynamic Cognitive Diagnostic Models
To extend cognitive diagnostic models (CDMs) to longitudinal settings, stepwise approaches that integrate a CDM model with a latent transition model and covariates are widely used due to their flexibility. Previous research has shown that stepwise estimation can yield biased results, motivating the use of classification error correction to improve inference compared to uncorrected stepwise procedures. In this study, we evaluate a unified Bayesian dynamic cognitive diagnostic model introduced by Y. Ma et al. (2025) that jointly estimates measurement (item parameters, latent attribute profiles) and transition components (transition parameters) in longitudinal settings with covariates. We compare this joint approach with the bias-corrected stepwise latent transition CDM proposed by Liang et al. (2023) through Monte Carlo simulation studies. Results demonstrate that joint modeling provides more accurate recovery of transition parameters, particularly under limited test length and sample size, underscoring its advantages for longitudinal diagnostic analysis and offering practical guidance for applied researchers.
- 26 December 2025
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 51 (6) , 1459-1463
It’s Up for Debate: A Review of Seminal Ideas and Controversies in Statistics by Roderick J. A. Little LittleR. J. A.Seminal Ideas and Controversies in Statistics. Boca Raton, FL: CRC Press, 2025. 243 pp., £42.74. ISBN: 9781032493565 (paperback).
- 26 December 2025
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 51 (6) , 1459-1463
It’s Up for Debate: A Review of Seminal Ideas and Controversies in Statistics by Roderick J. A. Little LittleR. J. A.Seminal Ideas and Controversies in Statistics. Boca Raton, FL: CRC Press, 2025. 243 pp., £42.74. ISBN: 9781032493565 (paperback).
- 1 September 2025
- Published by Institute of Mathematical Statistics in The Annals of Applied Statistics
- Vol. 19 (3) , 2490-2516
A latent variable model with change-points and its application to time pressure effects in educational assessment
Educational assessments are valuable tools for measuring student knowledge and skills, but their validity can be compromised when test takers exhibit changes in response behavior due to factors such as time pressure. To address this issue, we introduce a novel latent factor model with change-points for item response data, designed to detect and account for individual-level shifts in response patterns during testing. This model extends traditional item response theory (IRT) by incorporating person-specific change-points, which enables simultaneous estimation of item parameters, person latent traits, and the location of behavioral changes. We evaluate the proposed model through extensive simulation studies, which demonstrate its ability to accurately recover item parameters, change-point locations, and individual ability estimates under various conditions. Our findings show that accounting for change-points significantly reduces bias in ability estimates, particularly for respondents affected by time pressure. Application of the model to two real-world educational testing datasets reveals distinct patterns of change-point occurrence between high-stakes and lower-stakes tests, providing insights into how test-taking behavior evolves during the tests. This approach offers a more nuanced understanding of test-taking dynamics, with important implications for test design, scoring, and interpretation.
- 1 September 2025
- Published by Institute of Mathematical Statistics in The Annals of Applied Statistics
- Vol. 19 (3) , 2490-2516
A latent variable model with change-points and its application to time pressure effects in educational assessment
Educational assessments are valuable tools for measuring student knowledge and skills, but their validity can be compromised when test takers exhibit changes in response behavior due to factors such as time pressure. To address this issue, we introduce a novel latent factor model with change-points for item response data, designed to detect and account for individual-level shifts in response patterns during testing. This model extends traditional item response theory (IRT) by incorporating person-specific change-points, which enables simultaneous estimation of item parameters, person latent traits, and the location of behavioral changes. We evaluate the proposed model through extensive simulation studies, which demonstrate its ability to accurately recover item parameters, change-point locations, and individual ability estimates under various conditions. Our findings show that accounting for change-points significantly reduces bias in ability estimates, particularly for respondents affected by time pressure. Application of the model to two real-world educational testing datasets reveals distinct patterns of change-point occurrence between high-stakes and lower-stakes tests, providing insights into how test-taking behavior evolves during the tests. This approach offers a more nuanced understanding of test-taking dynamics, with important implications for test design, scoring, and interpretation.
- Open Access
- 30 July 2025
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 50 (3) , 115-144
Combining Propensity Scores and Common Items for Test Score Equating
Ensuring that test scores are fair and comparable across different test forms and different test groups is a significant statistical challenge in educational testing. Methods to achieve score comparability, a process known as test score equating, often rely on including common test items or assuming that test taker groups are similar in key characteristics. This study explores a novel approach that combines propensity scores, based on test takers’ background covariates, with information from common items using kernel smoothing techniques for binary-scored test items. An empirical analysis using data from a high-stakes college admissions test evaluates the standard errors and differences in adjusted test scores. A simulation study examines the impact of factors such as the number of test takers, the number of common items, and the correlation between covariates and test scores on the method’s performance. The findings demonstrate that integrating propensity scores with common item information reduces standard errors and bias more effectively than using either source alone. This suggests that balancing the groups on the test-takers’ covariates enhance the fairness and accuracy of test score comparisons across different groups. The proposed method highlights the benefits of considering all the collected data to improve score comparability.
- 30 July 2025
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 50 (3) , 115-144
Open AccessCombining Propensity Scores and Common Items for Test Score Equating
Ensuring that test scores are fair and comparable across different test forms and different test groups is a significant statistical challenge in educational testing. Methods to achieve score comparability, a process known as test score equating, often rely on including common test items or assuming that test taker groups are similar in key characteristics. This study explores a novel approach that combines propensity scores, based on test takers’ background covariates, with information from common items using kernel smoothing techniques for binary-scored test items. An empirical analysis using data from a high-stakes college admissions test evaluates the standard errors and differences in adjusted test scores. A simulation study examines the impact of factors such as the number of test takers, the number of common items, and the correlation between covariates and test scores on the method’s performance. The findings demonstrate that integrating propensity scores with common item information reduces standard errors and bias more effectively than using either source alone. This suggests that balancing the groups on the test-takers’ covariates enhance the fairness and accuracy of test score comparisons across different groups. The proposed method highlights the benefits of considering all the collected data to improve score comparability.
- Open Access
- 3 January 2025
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 51 (1) , 3-37
Smoothing of Bivariate Test Score Distributions: Model Selection Targeting Test Score Equating
Observed-score test equating is a vital part of every testing program, aiming to make test scores across test administrations comparable. Central to this process is the equating function, typically estimated by composing distribution functions of the scores to be equated. An integral part of this estimation is presmoothing, where statistical models are fit to observed score frequencies to mitigate sampling variability. This study evaluates the impact of commonly used model fit indices on bivariate presmoothing model-selection accuracy in both item response theory (IRT) and non-IRT settings. It also introduces a new model-selection criterion that directly targets the equating function in contrast to existing methods. The study focuses on the framework of non-equivalent groups with anchor test design, estimating bivariate score distributions based on real and simulated data. Results show that the choice of presmoothing model and model fit criterion influences the equated scores. In non-IRT contexts, a combination of the proposed model-selection criterion and the Bayesian information criterion exhibited superior performance, balancing bias, and variance of the equated scores. For IRT models, high selection accuracy and minimal equating error were achieved across all scenarios.
- 3 January 2025
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 51 (1) , 3-37
Open AccessSmoothing of Bivariate Test Score Distributions: Model Selection Targeting Test Score Equating
Observed-score test equating is a vital part of every testing program, aiming to make test scores across test administrations comparable. Central to this process is the equating function, typically estimated by composing distribution functions of the scores to be equated. An integral part of this estimation is presmoothing, where statistical models are fit to observed score frequencies to mitigate sampling variability. This study evaluates the impact of commonly used model fit indices on bivariate presmoothing model-selection accuracy in both item response theory (IRT) and non-IRT settings. It also introduces a new model-selection criterion that directly targets the equating function in contrast to existing methods. The study focuses on the framework of non-equivalent groups with anchor test design, estimating bivariate score distributions based on real and simulated data. Results show that the choice of presmoothing model and model fit criterion influences the equated scores. In non-IRT contexts, a combination of the proposed model-selection criterion and the Bayesian information criterion exhibited superior performance, balancing bias, and variance of the equated scores. For IRT models, high selection accuracy and minimal equating error were achieved across all scenarios.
- 2 April 2024
- Published by Taylor & Francis in The American Statistician
- Vol. 78 (2) , 265
An Introduction to R and Python for Data Analysis: A Side-by-Side Approach.An Introduction to R and Python for Data Analysis: A Side-by-Side Approach. Taylor R. Brown. Boca Raton, FL: Chapman & Hall/CRC Press, 2023, xix + 246 pp., $99.95(H), ISBN: 978-1-032-20325-6.
- 2 April 2024
- Published by Taylor & Francis in The American Statistician
- Vol. 78 (2) , 265
An Introduction to R and Python for Data Analysis: A Side-by-Side Approach.An Introduction to R and Python for Data Analysis: A Side-by-Side Approach. Taylor R. Brown. Boca Raton, FL: Chapman & Hall/CRC Press, 2023, xix + 246 pp., $99.95(H), ISBN: 978-1-032-20325-6.
- Open Access
- 1 March 2024
- Published by Cambridge University Press (CUP) in Psychometrika
- Vol. 89 (1) , 267-295
DIF Analysis with Unknown Groups and Anchor Items
Ensuring fairness in instruments like survey questionnaires or educational tests is crucial. One way to address this is by a Differential Item Functioning (DIF) analysis, which examines if different subgroups respond differently to a particular item, controlling for their overall latent construct level. DIF analysis is typically conducted to assess measurement invariance at the item level. Traditional DIF analysis methods require knowing the comparison groups (reference and focal groups) and anchor items (a subset of DIF-free items). Such prior knowledge may not always be available, and psychometric methods have been proposed for DIF analysis when one piece of information is unknown. More specifically, when the comparison groups are unknown while anchor items are known, latent DIF analysis methods have been proposed that estimate the unknown groups by latent classes. When anchor items are unknown while comparison groups are known, methods have also been proposed, typically under a sparsity assumption – the number of DIF items is not too large. However, DIF analysis when both pieces of information are unknown has not received much attention. This paper proposes a general statistical framework under this setting. In the proposed framework, we model the unknown groups by latent classes and introduce item-specific DIF parameters to capture the DIF effects. Assuming the number of DIF items is relatively small, an \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} $$L_1$$ -regularised estimator is proposed to simultaneously identify the latent classes and the DIF items. A computationally efficient Expectation-Maximisation (EM) algorithm is developed to solve the non-smooth optimisation problem for the regularised estimator. The performance of the proposed method is evaluated by simulation studies and an application to item response data from a real-world educational test.- 1 March 2024
- Published by Cambridge University Press (CUP) in Psychometrika
- Vol. 89 (1) , 267-295
Open AccessDIF Analysis with Unknown Groups and Anchor Items
Ensuring fairness in instruments like survey questionnaires or educational tests is crucial. One way to address this is by a Differential Item Functioning (DIF) analysis, which examines if different subgroups respond differently to a particular item, controlling for their overall latent construct level. DIF analysis is typically conducted to assess measurement invariance at the item level. Traditional DIF analysis methods require knowing the comparison groups (reference and focal groups) and anchor items (a subset of DIF-free items). Such prior knowledge may not always be available, and psychometric methods have been proposed for DIF analysis when one piece of information is unknown. More specifically, when the comparison groups are unknown while anchor items are known, latent DIF analysis methods have been proposed that estimate the unknown groups by latent classes. When anchor items are unknown while comparison groups are known, methods have also been proposed, typically under a sparsity assumption – the number of DIF items is not too large. However, DIF analysis when both pieces of information are unknown has not received much attention. This paper proposes a general statistical framework under this setting. In the proposed framework, we model the unknown groups by latent classes and introduce item-specific DIF parameters to capture the DIF effects. Assuming the number of DIF items is relatively small, an \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} $$L_1$$ -regularised estimator is proposed to simultaneously identify the latent classes and the DIF items. A computationally efficient Expectation-Maximisation (EM) algorithm is developed to solve the non-smooth optimisation problem for the regularised estimator. The performance of the proposed method is evaluated by simulation studies and an application to item response data from a real-world educational test.