Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Xin Qiao has a total of 31 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • bspam: Speed-Accuracy Psychometric Modeling for Binomial Count Outcome Data

    by Kuo Wang, Akihito Kamata, Cornelis J. Potgieter, Joseph F. T. Nese, Yusuf Kara, Sarunya Somsong, Xin Qiao

    Provides functions to fit speed-accuracy psychometric models for binomial count outcome data. The models jointly represent accuracy and response time and can be used for model-based calibration and scoring of oral reading fluency (ORF) assessment data. The methods are based on Potgieter, Kamata and Kara (2017) and Kara, Kamata, Potgieter and Nese (2020) .

  • The Two-Parameter Quasi-Poisson Item Response Theory Model for Handling Heterogeneous Dispersion in Count Data

    by Xin Qiao, Cornelis Potgieter

    To correctly model heterogeneous dispersion in count data, several psychometric methods have been proposed. In this paper, we introduce a semiparametric two-parameter Quasi-Poisson model that extends a recently proposed one-parameter Quasi-Poisson model and relaxes its equal-discrimination assumption. The proposed model is computationally efficient for small to moderately sized instruments and yields dispersion parameters that are comparable to those of the Poisson and negative binomial models while also accommodating underdispersion. We adopt a generalized method of moments framework for fast model parameter estimation with accessible standard errors (SEs), together with an adaptive information-weighted scoring procedure for latent ability estimation. We conduct extensive simulation studies to examine the recovery of model parameters, their associated SEs, and latent abilities, and we present an empirical data analysis to illustrate the application of the proposed model in a real-world setting.

  • Open Access

    Investigating the impacts of missing data mechanims and treatments with latent space models

    by Tracy M. Sweet, Xin Qiao, Ashani Jayasekera, Yishan Ding

  • Modeling Process Data Using Latent Space Models

    by Xin Qiao, Tracy Sweet

    While there have been a number of studies on process data analysis, few studies have investigated the longitudinal changes in students’ problem-solving behavior using network models. We propose a longitudinal, multilevel network model to model longitudinal process data of multiple test-takers. We treat actions as nodes and action sequences as directed ties. Using a Program for International Student Assessment (PISA) 2012 problem-solving item, we demonstrate the application of the proposed model and present results on model fit and model parameter interpretations. We find that under most metrics, our proposed model has satisfactory performance except that the link prediction did not work well given the sparse network data.

  • Open Access

    Joint analysis of dispersed count‐time data using a bivariate latent factor model

    by Cornelis J. Potgieter, Akihito Kamata, Yusuf Kara, Xin Qiao

    In this study, we explore parameter estimation for a joint count‐time data model with a two‐factor latent trait structure, representing accuracy and speed. Each count‐time variable pair corresponds to a specific item on a measurement instrument, where each item consists of a fixed number of tasks. The count variable represents the number of successfully completed tasks and is modeled using a Beta‐binomial distribution to account for potential over‐dispersion. The time variable, representing the duration needed to complete the tasks, is modeled using a normal distribution on a logarithmic scale. To characterize the model structure, we derive marginal moments that inform a set of method‐of‐moments (MOM) estimators, which serve as initial values for maximum likelihood estimation (MLE) via the Monte Carlo Expectation‐Maximization (MCEM) algorithm. Standard errors are estimated using both the observed information matrix and bootstrap resampling, with simulation results indicating superior performance of the bootstrap, especially near boundary values of the dispersion parameter. A comprehensive simulation study investigates estimator accuracy and computational efficiency. To demonstrate the methodology, we analyze oral reading fluency (ORF) data, showing substantial variation in item‐level dispersion and providing evidence for the improved model fit of the Beta‐binomial specification, assessed using standardized root mean square residuals (SRMSR).


  • Beta-Binomial Model for Count Data: An Application in Estimating Model-Based Oral Reading Fluency

    by Xin Qiao, Akihito Kamata, Yusuf Kara, Cornelis Potgieter, Joseph F. T. Nese

    In this article, the beta-binomial model for count data is proposed and demonstrated in terms of its application in the context of oral reading fluency (ORF) assessment, where the number of words read correctly (WRC) is of interest. Existing studies adopted the binomial model for count data in similar assessment scenarios. The beta-binomial model, however, takes into account extra variability in count data that have been neglected by the binomial model. Therefore, it accommodates potential overdispersion in count data compared to the binomial model. To estimate model-based ORF scores, WRC and response times were jointly modeled. The full Bayesian Markov chain Monte Carlo method was adopted for model parameter estimation. A simulation study showed adequate parameter recovery of the beta-binomial model and evaluated the performance of model fit indices in selecting the true data-generating models. Further, an empirical analysis illustrated the application of the proposed model using a dataset from a computerized ORF assessment. The obtained findings were consistent with the simulation study and demonstrated the utility of adopting the beta-binomial model for count-type item responses from assessment data.


  • A Quasi-Poisson Item Response Theory Model for Heterogeneous Dispersion in Count Data

    by Xin Qiao, Cornelis Potgieter

    Item-level count data frequently arise in cognitive, educational, and psychological assessments. Correctly handling different dispersion levels in count data is crucial for accurate statistical inference. This research proposes a Quasi-Poisson item response theory model that accommodates overdispersion, underdispersion, and equidispersion in count data, aiming to explicitly model the connection between the mean and variance parameters, providing a method that is both computationally efficient and statistically robust. This semiparametric model specifies the first two conditional moments for the count variables and derives marginal moments to estimate model parameters. Simulation studies demonstrate the Quasi-Poisson model’s efficacy in parameter recovery across different dispersion scenarios and its negligible computation time. Empirical data analysis further underscores the model’s superior fit and computational efficiency in a real-world setting.


  • Likelihood‐Based Estimation of Model‐Derived Oral Reading Fluency

    by Cornelis Potgieter, Xin Qiao, Akihito Kamata, Yusuf Kara

    As part of the effort to develop an improved oral reading fluency (ORF) assessment system, Kara et al. estimated the ORF scores based on a latent variable psychometric model of accuracy and speed for ORF data via a fully Bayesian approach. This study further investigates likelihood‐based estimators for the model‐derived ORF scores, including maximum likelihood estimator (MLE), maximum a posteriori (MAP), and expected a posteriori (EAP), as well as their standard errors. The proposed estimators were demonstrated with a real ORF assessment dataset. Also, the estimation of model‐derived ORF scores and their standard errors by the proposed estimators were evaluated through a simulation study. The fully Bayesian approach was included as a comparison in the real data analysis and the simulation study. Results demonstrated that the three likelihood‐based approaches for the model‐derived ORF scores and their standard error estimation performed satisfactorily.


  • Incorporating calibration errors in oral reading fluency scoring

    by Xin Qiao, Akihito Kamata, Cornelis Potgieter

    Oral reading fluency (ORF) assessments are commonly used to screen at‐risk readers and evaluate interventions' effectiveness as curriculum‐based measurements. Similar to the standard practice in item response theory (IRT), calibrated passage parameter estimates are currently used as if they were population values in model‐based ORF scoring. However, calibration errors that are unaccounted for may bias ORF score estimates and, in particular, lead to underestimated standard errors (SEs) of ORF scores. Therefore, we consider an approach that incorporates the calibration errors in latent variable scores. We further derive the SEs of ORF scores based on the delta method to incorporate the calibration uncertainty. We conduct a simulation study to evaluate the recovery of point estimates and SEs of latent variable scores and ORF scores in various simulated conditions. Results suggest that ignoring calibration errors leads to underestimated latent variable score SEs and ORF score SEs, especially when the calibration sample is small.