Christine E. DeMars
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Christine E. DeMars has a total of 22 co-authors. Here are the top co-authors by number of shared publications:
Steven L. Wise
Northwest Evaluation Association
5 shared publicationsT. Dary Erwin
James Madison University
3 shared publications- Sarah Alahmadi
James Madison University
2 shared publications Abigail Lau
James Madison University, Harrisonburg, VA, USA
1 shared publication- Alan Socha
James Madison University, Harrisonburg, VA, USA
1 shared publication - Bozhidar M. Bashkov
American Board of Internal Medicine, Philadelphia, PA, USA
1 shared publication
Latest Publications
- 20 September 2026
- Published by Taylor & Francis in Applied Measurement in Education
- p. 1-16
The Engagement Dip: Examining Effort and Achievement in Low-Stakes Testing
- 20 September 2026
- Published by Taylor & Francis in Applied Measurement in Education
- p. 1-16
The Engagement Dip: Examining Effort and Achievement in Low-Stakes Testing
- Open Access
- 28 September 2025
- Published by Wiley in Journal of Educational Measurement
- Vol. 62 (4) , 740-762
From Item Estimates to Test Operations: The Cascading Effect of Rapid Guessing
Inadequate test‐taking effort poses a significant challenge, particularly when low‐stakes test results inform high‐stakes policy and psychometric decisions. We examined how rapid guessing (RG), a common form of low test‐taking effort, biases item parameter estimates, particularly the discrimination and difficulty parameters. Previous research reported conflicting findings on the direction of bias and what contributes to it. Using simulated data that replicate real‐world, low‐stakes testing conditions, this study reconciles the inconsistencies by identifying the conditions under which item parameters are over‐ or underestimated. Bias is influenced by item‐related factors (true parameter values and the number of RG responses the items receive) and examinee‐related factors (proficiency differences between rapid guessers and non‐rapid guessers, the variability in RG behavior among rapid guessers, and the pattern of RG responses throughout the test). The findings highlight that ignoring RG not only distorts proficiency estimates but may also impact broader test operations, including adaptive testing, equating, and standard setting. By demonstrating the potential far‐reaching effects of RG, we underline the need for testing professionals to implement methods that mitigate RG's impact (such as motivation filtering) to protect the integrity of their psychometric work.
- 28 September 2025
- Published by Wiley in Journal of Educational Measurement
- Vol. 62 (4) , 740-762
Open AccessFrom Item Estimates to Test Operations: The Cascading Effect of Rapid Guessing
Inadequate test‐taking effort poses a significant challenge, particularly when low‐stakes test results inform high‐stakes policy and psychometric decisions. We examined how rapid guessing (RG), a common form of low test‐taking effort, biases item parameter estimates, particularly the discrimination and difficulty parameters. Previous research reported conflicting findings on the direction of bias and what contributes to it. Using simulated data that replicate real‐world, low‐stakes testing conditions, this study reconciles the inconsistencies by identifying the conditions under which item parameters are over‐ or underestimated. Bias is influenced by item‐related factors (true parameter values and the number of RG responses the items receive) and examinee‐related factors (proficiency differences between rapid guessers and non‐rapid guessers, the variability in RG behavior among rapid guessers, and the pattern of RG responses throughout the test). The findings highlight that ignoring RG not only distorts proficiency estimates but may also impact broader test operations, including adaptive testing, equating, and standard setting. By demonstrating the potential far‐reaching effects of RG, we underline the need for testing professionals to implement methods that mitigate RG's impact (such as motivation filtering) to protect the integrity of their psychometric work.
- Open Access
- 4 April 2025
- Published by Wiley in Journal of Educational Measurement
- Vol. 62 (2) , 345-359
Another Look at Yen's Q3: Is .2 an Appropriate Cut‐Off?
This study examined the widely used threshold of .2 for Yen's Q3, an index for violations of local independence. Specifically, a simulation was conducted to investigate whether Q3 values were related to the magnitude of bias in estimates of reliability, item parameters, and examinee ability. Results showed that Q3 values below the typical cut‐off yielded meaningful bias in estimates. Practical implications and limitations are discussed.
- 4 April 2025
- Published by Wiley in Journal of Educational Measurement
- Vol. 62 (2) , 345-359
Open AccessAnother Look at Yen's Q3: Is .2 an Appropriate Cut‐Off?
This study examined the widely used threshold of .2 for Yen's Q3, an index for violations of local independence. Specifically, a simulation was conducted to investigate whether Q3 values were related to the magnitude of bias in estimates of reliability, item parameters, and examinee ability. Results showed that Q3 values below the typical cut‐off yielded meaningful bias in estimates. Practical implications and limitations are discussed.
- 29 November 2024
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 85 (3) , 589-616
Treating Noneffortful Responses as Missing
This study investigates the treatment of rapid-guess (RG) responses as missing data within the context of the effort-moderated model. Through a series of illustrations, this study demonstrates that the effort-moderated model assumes missing at random (MAR) rather than missing completely at random (MCAR), explaining the conditions necessary for MAR. These examples show that RG responses, when treated as missing under the effort-moderated model, do not introduce bias into ability estimates if the missingness mechanism is properly accounted for. Conversely, using a standard item response theory (IRT) model (scoring RG responses as if they were valid) instead of the effort-moderated model leads to considerable biases, underestimating group means and overestimating standard deviations when the item parameters are known, or overestimating item difficulty if the item parameters are estimated.
- 29 November 2024
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 85 (3) , 589-616
Treating Noneffortful Responses as Missing
This study investigates the treatment of rapid-guess (RG) responses as missing data within the context of the effort-moderated model. Through a series of illustrations, this study demonstrates that the effort-moderated model assumes missing at random (MAR) rather than missing completely at random (MCAR), explaining the conditions necessary for MAR. These examples show that RG responses, when treated as missing under the effort-moderated model, do not introduce bias into ability estimates if the missingness mechanism is properly accounted for. Conversely, using a standard item response theory (IRT) model (scoring RG responses as if they were valid) instead of the effort-moderated model leads to considerable biases, underestimating group means and overestimating standard deviations when the item parameters are known, or overestimating item difficulty if the item parameters are estimated.
- 2 January 2024
- Published by Taylor & Francis in Applied Measurement in Education
- Vol. 37 (1) , 43-56
Comparing Examinee-Based and Response-Based Motivation Filtering Methods in Remote Low-Stakes Testing
- 2 January 2024
- Published by Taylor & Francis in Applied Measurement in Education
- Vol. 37 (1) , 43-56
Comparing Examinee-Based and Response-Based Motivation Filtering Methods in Remote Low-Stakes Testing
- 30 October 2023
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 84 (4) , 691-715
Item Parameter Recovery: Sensitivity to Prior Distribution
Marginal maximum likelihood, a common estimation method for item response theory models, is not inherently a Bayesian procedure. However, due to estimation difficulties, Bayesian priors are often applied to the likelihood when estimating 3PL models, especially with small samples. Little focus has been placed on choosing the priors for marginal maximum estimation. In this study, using sample sizes of 1,000 or smaller, not using priors often led to extreme, implausible parameter estimates. Applying prior distributions to the c-parameters alleviated the estimation problems with samples of 500 or more; for the samples of 100, priors on both the a-parameters and c-parameters were needed. Estimates were biased when the center of the prior did not match the true parameter value, but the degree of the bias did not depend on the strength of the prior unless it was extremely informative. The root mean squared error (RMSE) of the a-parameters and b-parameters did not depend greatly on either the center or the strength of the prior unless it was extremely informative. The RMSE of the c-parameters, like the bias, depended on the mode of the prior for c.
- 30 October 2023
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 84 (4) , 691-715
Item Parameter Recovery: Sensitivity to Prior Distribution
Marginal maximum likelihood, a common estimation method for item response theory models, is not inherently a Bayesian procedure. However, due to estimation difficulties, Bayesian priors are often applied to the likelihood when estimating 3PL models, especially with small samples. Little focus has been placed on choosing the priors for marginal maximum estimation. In this study, using sample sizes of 1,000 or smaller, not using priors often led to extreme, implausible parameter estimates. Applying prior distributions to the c-parameters alleviated the estimation problems with samples of 500 or more; for the samples of 100, priors on both the a-parameters and c-parameters were needed. Estimates were biased when the center of the prior did not match the true parameter value, but the degree of the bias did not depend on the strength of the prior unless it was extremely informative. The root mean squared error (RMSE) of the a-parameters and b-parameters did not depend greatly on either the center or the strength of the prior unless it was extremely informative. The RMSE of the c-parameters, like the bias, depended on the mode of the prior for c.
- 3 April 2021
- Published by Taylor & Francis in Applied Measurement in Education
- Vol. 34 (2) , 122-138
Violation of Conditional Independence in the Many-Facets Rasch Model
Estimation of parameters for the many-facets Rasch model requires that conditional on the values of the facets, such as person ability, item difficulty, and rater severity, the observed responses within each facet are independent. This requirement has often been discussed for the Rasch models and 2PL and 3PL models, but it becomes more complex with more facets. To show how violation of conditional independence may be exhibited, three scenarios with different types of dependency are developed: (a) raters rating the same work, (b) a residual ability shared by two tasks, and (c) score on one task dependent on observed score on a previous task.
- 3 April 2021
- Published by Taylor & Francis in Applied Measurement in Education
- Vol. 34 (2) , 122-138
Violation of Conditional Independence in the Many-Facets Rasch Model
Estimation of parameters for the many-facets Rasch model requires that conditional on the values of the facets, such as person ability, item difficulty, and rater severity, the observed responses within each facet are independent. This requirement has often been discussed for the Rasch models and 2PL and 3PL models, but it becomes more complex with more facets. To show how violation of conditional independence may be exhibited, three scenarios with different types of dependency are developed: (a) raters rating the same work, (b) a residual ability shared by two tasks, and (c) score on one task dependent on observed score on a previous task.
- 26 October 2020
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 45 (2) , 130-133
A Note on the Relation Between the Angle of the Reference Composite and Liu, Li, and Liu’s Method 4 for Domain Scores
- 26 October 2020
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 45 (2) , 130-133
A Note on the Relation Between the Angle of the Reference Composite and Liu, Li, and Liu’s Method 4 for Domain Scores
- Open Access
- 14 August 2020
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 45 (1) , 71-73
A Note on the Odds Ratio DIF Index
- 14 August 2020
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 45 (1) , 71-73
Open AccessA Note on the Odds Ratio DIF Index
- 1 January 2020
- Vol. 21 (4) , 400-419
Comparing Causes of Dependency: Shared Latent Trait or Dependence on Observed Response.
Accurate parameter estimation in the Rasch model involves the assumption of conditional independence, also termed local independence. Conditional on ability, the responses to items A and B should be independent. Two types of conditional dependence are detailed in this pedagogical piece: trait dependency and response dependency. The bias in difficulty and reliability and the estimates of fit and correlated residuals resulting from these dependencies are compared and contrasted to results from using models that account for the dependency. Contrasts with results from a 2-parameter item response theory model are also briefly noted.
- 1 January 2020
- Vol. 21 (4) , 400-419
Comparing Causes of Dependency: Shared Latent Trait or Dependence on Observed Response.
Accurate parameter estimation in the Rasch model involves the assumption of conditional independence, also termed local independence. Conditional on ability, the responses to items A and B should be independent. Two types of conditional dependence are detailed in this pedagogical piece: trait dependency and response dependency. The bias in difficulty and reliability and the estimates of fit and correlated residuals resulting from these dependencies are compared and contrasted to results from using models that account for the dependency. Contrasts with results from a 2-parameter item response theory model are also briefly noted.