David Thissen
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
David Thissen has a total of 93 co-authors. Here are the top co-authors by number of shared publications:
- Darren A. DeWalt
University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
8 shared publications - Brooke E. Magnus
Boston College, Chestnut Hill, MA, USA
6 shared publications - Heather E. Gross
Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill, Chapel Hill, USA
6 shared publications - Hally Quinn
Department of Psychology, University of North Carolina at Chapel Hill, 358 Davie Hall, CB #3270, Chapel Hill, NC, 27599, USA.
4 shared publications - Yang Liu
Department of Psychology, University of North Carolina at Chapel Hill, 358 Davie Hall, CB #3270, Chapel Hill, NC, 27599, USA.
4 shared publications - Bryce B. Reeve
Department of Population Health Sciences, Duke University, Durham, North Carolina, USA
3 shared publications
Latest Publications
- 12 September 2024
- Published by Taylor & Francis in Multivariate Behavioral Research
- Vol. 60 (2) , 211-235
A Review of Some of the History of Factorial Invariance and Differential Item Functioning
The concept of factorial invariance has evolved since it originated in the 1930s as a criterion for the usefulness of the multiple factor model; it has become a form of analysis supporting the validity of inferences about group differences on underlying latent variables. The analysis of differential item functioning (DIF) arose in the literature of item response theory (IRT), where its original purpose was the detection and removal of test items that are differentially difficult for, or biased against, one subpopulation or another. The two traditions merge at the level of the underlying latent variable model, but their separate origins and different purposes have led them to differ in details of terminology and procedure. This review traces some aspects of the histories of the two traditions, ultimately drawing some conclusions about how analysts may draw on elements of both, and how the nature of the research question determines the procedures used. Whether statistical tests are grouped by parameter (as in studies of factorial invariance) or across parameters by variable (as in DIF analysis) depends on the context and is independent of the model, as are subtle aspects of the order of the tests. In any case in which DIF or partial invariance is a possibility, the invariant parameters, or anchor items in DIF analysis, are best selected in an interplay between the statistics and judgment about what is being measured.
- 12 September 2024
- Published by Taylor & Francis in Multivariate Behavioral Research
- Vol. 60 (2) , 211-235
A Review of Some of the History of Factorial Invariance and Differential Item Functioning
The concept of factorial invariance has evolved since it originated in the 1930s as a criterion for the usefulness of the multiple factor model; it has become a form of analysis supporting the validity of inferences about group differences on underlying latent variables. The analysis of differential item functioning (DIF) arose in the literature of item response theory (IRT), where its original purpose was the detection and removal of test items that are differentially difficult for, or biased against, one subpopulation or another. The two traditions merge at the level of the underlying latent variable model, but their separate origins and different purposes have led them to differ in details of terminology and procedure. This review traces some aspects of the histories of the two traditions, ultimately drawing some conclusions about how analysts may draw on elements of both, and how the nature of the research question determines the procedures used. Whether statistical tests are grouped by parameter (as in studies of factorial invariance) or across parameters by variable (as in DIF analysis) depends on the context and is independent of the model, as are subtle aspects of the order of the tests. In any case in which DIF or partial invariance is a possibility, the invariant parameters, or anchor items in DIF analysis, are best selected in an interplay between the statistics and judgment about what is being measured.
- Open Access
- 20 October 2023
- Published by University of Arizona in Journal of Methods and Measurement in the Social Sciences
- Vol. 14 (1)
Large Field Surveys and Short Items Sets: Estimating Reasoning Skills among Distinct Samples in Malawi and Zambia
Raven's Progressive Matrices measure logical reasoning and are often included in large multi-topic surveys in low and middle-income countries. The matrices are image-based items that do not require formal knowledge of language or math to complete. As such, they are attractive items to measure logical reasoning in international development contexts. Many of these large field surveys include short item Raven's sets because space is too limited to fit a full suite. However, short sets can result in restricted variation in terms of test scores. In this paper, we use a nominal response model (NRM) form of item response theory (IRT) to uncover hidden variation in right and wrong answers using short-item Raven's tests from two large field surveys in Malawi and Zambia. We also analyze relationships between a set of other variables, comparing performance of different versions of the logical reasoning scores as both independent and dependent variables, checking the validity of the new scores. The new NRM-estimated logical reasoning scores follow a more normal distribution in both samples. Validity checks suggest that when relationships are less strong, NRM-estimated scores can capture more nuance than summed scores or even 2 parameter logistic IRT-estimated scores. NRM can uncover differences that are not apparent when using simple summed scores.
- 20 October 2023
- Published by University of Arizona in Journal of Methods and Measurement in the Social Sciences
- Vol. 14 (1)
Open AccessLarge Field Surveys and Short Items Sets: Estimating Reasoning Skills among Distinct Samples in Malawi and Zambia
Raven's Progressive Matrices measure logical reasoning and are often included in large multi-topic surveys in low and middle-income countries. The matrices are image-based items that do not require formal knowledge of language or math to complete. As such, they are attractive items to measure logical reasoning in international development contexts. Many of these large field surveys include short item Raven's sets because space is too limited to fit a full suite. However, short sets can result in restricted variation in terms of test scores. In this paper, we use a nominal response model (NRM) form of item response theory (IRT) to uncover hidden variation in right and wrong answers using short-item Raven's tests from two large field surveys in Malawi and Zambia. We also analyze relationships between a set of other variables, comparing performance of different versions of the logical reasoning scores as both independent and dependent variables, checking the validity of the new scores. The new NRM-estimated logical reasoning scores follow a more normal distribution in both samples. Validity checks suggest that when relationships are less strong, NRM-estimated scores can capture more nuance than summed scores or even 2 parameter logistic IRT-estimated scores. NRM can uncover differences that are not apparent when using simple summed scores.
- Open Access
- 1 December 2022
- Published by National Council on Measurement in Education (NCME) in Chinese/english Journal of Educational Measurement and Evaluation
- Vol. 3 (3) , 2
因子分析和项目反应理论的潜变量估计
本文对项目反应理论 (item response theory; IRT) 和因子分析 (factor analysis) 模型潜变量 (latent variable) 得分估计方法的历史发展进行综述,指出两种理论中常用的因子得分估计本质上是相同的,只是计算方法不同而已。不同的程序已经被用于推导因子得分和IRT潜变量的估计,并且产生了不同的计算过程。由于潜变量得分的使用情况不同,IRT和因子分析解决挑战的方案不同。对偏差纠正的需求不同,两种理论体系提出了不同的纠正方法。尽管IRT模型不具有因子分析模型的高斯似然,但采用正态近似方法使得IRT与因子分析模型的得分计算在很多情况下是非常相似的。最后,尽管两种理论因子得分估计问题上是相同的,但因子分析多年一直处于因子得分不确定性 (factor score indeterminacy) 的争议之中,而IRT却没有。这是历史的产物,也是IRT和因子分析文章中模型表达方式不同的结果。此外,IRT不存在不确定性问题的争议,有利于阐明以下立场,即不确定性并不是一个问题。
- 1 December 2022
- Published by National Council on Measurement in Education (NCME) in Chinese/english Journal of Educational Measurement and Evaluation
- Vol. 3 (3) , 2
Open Access因子分析和项目反应理论的潜变量估计
本文对项目反应理论 (item response theory; IRT) 和因子分析 (factor analysis) 模型潜变量 (latent variable) 得分估计方法的历史发展进行综述,指出两种理论中常用的因子得分估计本质上是相同的,只是计算方法不同而已。不同的程序已经被用于推导因子得分和IRT潜变量的估计,并且产生了不同的计算过程。由于潜变量得分的使用情况不同,IRT和因子分析解决挑战的方案不同。对偏差纠正的需求不同,两种理论体系提出了不同的纠正方法。尽管IRT模型不具有因子分析模型的高斯似然,但采用正态近似方法使得IRT与因子分析模型的得分计算在很多情况下是非常相似的。最后,尽管两种理论因子得分估计问题上是相同的,但因子分析多年一直处于因子得分不确定性 (factor score indeterminacy) 的争议之中,而IRT却没有。这是历史的产物,也是IRT和因子分析文章中模型表达方式不同的结果。此外,IRT不存在不确定性问题的争议,有利于阐明以下立场,即不确定性并不是一个问题。
- 1 December 2022
- Published by National Council on Measurement in Education (NCME) in Chinese/english Journal of Educational Measurement and Evaluation
- Vol. 3 (3) , 1
Latent Variable Estimation in Factor Analysis and Item Response Theory
This essay sketches the historical development of latent variable scoring procedures in the item response theory (IRT) and factor analysis literatures, observing that the most commonly used score estimates in both traditions are fundamentally the same; only methods of calculation differ. Different procedures have been used to derive factor score estimates and latent variable estimates in IRT, and different computational procedures have been the result. Due to differences in the context of score usage, challenges have led to different solutions in the IRT and factor analytic traditions. The needs for bias corrections differ, as do the corrections that have been proposed. While the standard factor analysis model has naturally Gaussian likelihoods, IRT does not, but in IRT normal approximations have been used in various contexts to make the IRT computations more like those of factor analysis. Finally, factor analysis alone has been the home of decades of controversy over factor score indeterminacy, while IRT has not, even though the scores in question are the same. That is an artifact of history and the ways the models have been written in the IRT and factor analytic literatures. IRT has never been plagued with questions of indeterminacy, which helps to clarify the position that what is referred to as indeterminacy is not a problem.
- 1 December 2022
- Published by National Council on Measurement in Education (NCME) in Chinese/english Journal of Educational Measurement and Evaluation
- Vol. 3 (3) , 1
Latent Variable Estimation in Factor Analysis and Item Response Theory
This essay sketches the historical development of latent variable scoring procedures in the item response theory (IRT) and factor analysis literatures, observing that the most commonly used score estimates in both traditions are fundamentally the same; only methods of calculation differ. Different procedures have been used to derive factor score estimates and latent variable estimates in IRT, and different computational procedures have been the result. Due to differences in the context of score usage, challenges have led to different solutions in the IRT and factor analytic traditions. The needs for bias corrections differ, as do the corrections that have been proposed. While the standard factor analysis model has naturally Gaussian likelihoods, IRT does not, but in IRT normal approximations have been used in various contexts to make the IRT computations more like those of factor analysis. Finally, factor analysis alone has been the home of decades of controversy over factor score indeterminacy, while IRT has not, even though the scores in question are the same. That is an artifact of history and the ways the models have been written in the IRT and factor analytic literatures. IRT has never been plagued with questions of indeterminacy, which helps to clarify the position that what is referred to as indeterminacy is not a problem.
- 1 September 2021
- Published by American Psychological Association (APA) in Psychological Assessment
- Vol. 33 (9) , 803-815
Validation of the Multidimensional Assessment of Parenting: An application of item response theory.
Parenting is a critical mechanism contributing to child and adolescent development and outcomes. The Multidimensional Assessment of Parenting Scale (MAPS) is a new measure that aims to address gaps in the literature on existing self-report parenting measures. Research to date on the MAPS includes essential steps of scale development and validation; however, replicating scale dimensionality and examining differential item functioning (DIF) based on child age and a parent or child gender is a critical next step. The current study included 1,790 mothers and fathers of sons and daughters, spanning childhood to adolescence in the United States. Item response theory (IRT) confirmed initial factor-analytic work revealing positive and negative dimensions; however, the best-fitting multidimensional model included six nested dimensions from the original seven. A few notable items displayed DIF based on child age and parent gender; however, DIF based on child gender had minimal impact on the overall score. Future directions, clinical implications, and recommendations are discussed. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
- 1 September 2021
- Published by American Psychological Association (APA) in Psychological Assessment
- Vol. 33 (9) , 803-815
Validation of the Multidimensional Assessment of Parenting: An application of item response theory.
Parenting is a critical mechanism contributing to child and adolescent development and outcomes. The Multidimensional Assessment of Parenting Scale (MAPS) is a new measure that aims to address gaps in the literature on existing self-report parenting measures. Research to date on the MAPS includes essential steps of scale development and validation; however, replicating scale dimensionality and examining differential item functioning (DIF) based on child age and a parent or child gender is a critical next step. The current study included 1,790 mothers and fathers of sons and daughters, spanning childhood to adolescence in the United States. Item response theory (IRT) confirmed initial factor-analytic work revealing positive and negative dimensions; however, the best-fitting multidimensional model included six nested dimensions from the original seven. A few notable items displayed DIF based on child age and parent gender; however, DIF based on child gender had minimal impact on the overall score. Future directions, clinical implications, and recommendations are discussed. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
- Open Access
- 1 December 2020
- Published by National Council on Measurement in Education (NCME) in Chinese/english Journal of Educational Measurement and Evaluation
- Vol. 1 (1) , 6
二十世纪参数项目反应理论模型思想史
参数项目反应理论 (IRT) 模型的思想史可以追溯到20世纪初 E.L. Thorndike,L.L. Thurstone 和 Percival Symonds 的想法。伴随着一系列潜变量模型的出现,参数项目反应理论模型逐渐形成,并在 Paul Lazarsfeld 和 Federic Lord 1950年左右的文章发表后正式创立。然而在很长的一段时间里,IRT 的发展一直停留在理论层面,直至 20 世纪 70 年代,随着计算机技术的进步,应用 IRT 模型进行数据分析成为可能。大约在同一时期,原始的正态肩形模型 (normal ogive model) 和简单 logistic 模型 (simple logistic model) 拓展到了更丰富的测验情景,出现可以适用于多项选择题和多级评分题 (polytomous items) 的复杂模型。从20 世纪 90 年代一直到 21 世纪初,IRT 已经成为大规模教育评估的主要基础。
- 1 December 2020
- Published by National Council on Measurement in Education (NCME) in Chinese/english Journal of Educational Measurement and Evaluation
- Vol. 1 (1) , 6
Open Access二十世纪参数项目反应理论模型思想史
参数项目反应理论 (IRT) 模型的思想史可以追溯到20世纪初 E.L. Thorndike,L.L. Thurstone 和 Percival Symonds 的想法。伴随着一系列潜变量模型的出现,参数项目反应理论模型逐渐形成,并在 Paul Lazarsfeld 和 Federic Lord 1950年左右的文章发表后正式创立。然而在很长的一段时间里,IRT 的发展一直停留在理论层面,直至 20 世纪 70 年代,随着计算机技术的进步,应用 IRT 模型进行数据分析成为可能。大约在同一时期,原始的正态肩形模型 (normal ogive model) 和简单 logistic 模型 (simple logistic model) 拓展到了更丰富的测验情景,出现可以适用于多项选择题和多级评分题 (polytomous items) 的复杂模型。从20 世纪 90 年代一直到 21 世纪初,IRT 已经成为大规模教育评估的主要基础。
- 1 December 2020
- Published by National Council on Measurement in Education (NCME) in Chinese/english Journal of Educational Measurement and Evaluation
- Vol. 1 (1) , 5
An Intellectual History of Parametric Item Response Theory Models in the Twentieth Century
The intellectual history of parametric item response theory (IRT) models is traced from ideas that originated with E.L. Thorndike, L.L. Thurstone, and Percival Symonds in the early twentieth century. Gradual formulation as a set of latent vari- able models occurred, culminating in publications by Paul Lazarsfeld and Federic Lord around 1950. IRT remained the province of theoreticians without practical ap- plication until the 1970s, when advances in computational technology made possible data analysis using the models. About the same time, the original normal ogive and simple logistic models were augmented with more complex models for multiple- choice and polytomous items. During the final decades of the twentieth century, and continuing into the twenty-first, IRT has become the dominant basis for large-scale educational assessment.
- 1 December 2020
- Published by National Council on Measurement in Education (NCME) in Chinese/english Journal of Educational Measurement and Evaluation
- Vol. 1 (1) , 5
An Intellectual History of Parametric Item Response Theory Models in the Twentieth Century
The intellectual history of parametric item response theory (IRT) models is traced from ideas that originated with E.L. Thorndike, L.L. Thurstone, and Percival Symonds in the early twentieth century. Gradual formulation as a set of latent vari- able models occurred, culminating in publications by Paul Lazarsfeld and Federic Lord around 1950. IRT remained the province of theoreticians without practical ap- plication until the 1970s, when advances in computational technology made possible data analysis using the models. About the same time, the original normal ogive and simple logistic models were augmented with more complex models for multiple- choice and polytomous items. During the final decades of the twentieth century, and continuing into the twenty-first, IRT has become the dominant basis for large-scale educational assessment.
- 21 August 2020
- Published by Wiley in Journal of Educational Measurement
- Vol. 57 (3) , 397-402
Comments on Shelby Haberman's NCME Career Award Address: Statistical Theory and Assessment Practice
- 21 August 2020
- Published by Wiley in Journal of Educational Measurement
- Vol. 57 (3) , 397-402
Comments on Shelby Haberman's NCME Career Award Address: Statistical Theory and Assessment Practice
- 24 July 2020
- Published by Springer Nature
- p. 171-184
Factor Score Estimation from the Perspective of Item Response Theory
- 24 July 2020
- Published by Springer Nature
- p. 171-184
Factor Score Estimation from the Perspective of Item Response Theory
- Open Access
- 1 July 2017
- Published by Elsevier in Patient Education and Counseling
- Vol. 100 (7) , 1322-1328
Psychometric evaluation and design of patient-centered communication measures for cancer care settings
- 1 July 2017
- Published by Elsevier in Patient Education and Counseling
- Vol. 100 (7) , 1322-1328
Open AccessPsychometric evaluation and design of patient-centered communication measures for cancer care settings