Devin Caughey
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Devin Caughey has a total of 21 co-authors. Here are the top co-authors by number of shared publications:
- Allan Dafoe
Department of Political Science, Yale University, New Haven, CT 06520, USA
3 shared publications Christopher Warshaw
George Washington University
3 shared publications- Christopher Warshaw
Department of Political Science, George Washington University, Washington, USA
3 shared publications Allan Dafoe
Yale University
2 shared publications- Eric Schickler
Department of Political Science, University of California, Berkeley, CA, USA
2 shared publications - Luke W. Miratrix
Harvard Graduate School of Education
2 shared publications
Latest Publications
- Open Access
- 17 January 2025
- Published by Cambridge University Press (CUP) in Political Analysis
- Vol. 33 (2) , 91-106
MODGIRT: Multidimensional Dynamic Scaling of Aggregate Survey Data
Dynamic models of aggregate public opinion are increasingly popular, but to date they have been restricted to unidimensional latent traits. This is problematic because in many domains the structure of mass preferences is multidimensional. We address this limitation by deriving a multidimensional ordinal dynamic group-level item response theory (MODGIRT) model. We describe the Bayesian estimation of the model and present a novel workflow for dealing with the difficult problem of identification. With simulations, we show that MODGIRT recovers aggregate parameters without estimating subject-level ideal points and is robust to moderate violations of assumptions. We further validate the model by reproducing at the group level an existing individual-level analysis of British attitudes towards redistribution. We then reanalyze a recent cross-national application of a group-level item response theory model, replacing its domain-specific confirmatory approach with an exploratory MODGIRT model. We describe extensions to allow for overdispersion, differential item functioning, and group-level predictors. A publicly available R package implements these methods.
- 17 January 2025
- Published by Cambridge University Press (CUP) in Political Analysis
- Vol. 33 (2) , 91-106
Open AccessMODGIRT: Multidimensional Dynamic Scaling of Aggregate Survey Data
Dynamic models of aggregate public opinion are increasingly popular, but to date they have been restricted to unidimensional latent traits. This is problematic because in many domains the structure of mass preferences is multidimensional. We address this limitation by deriving a multidimensional ordinal dynamic group-level item response theory (MODGIRT) model. We describe the Bayesian estimation of the model and present a novel workflow for dealing with the difficult problem of identification. With simulations, we show that MODGIRT recovers aggregate parameters without estimating subject-level ideal points and is robust to moderate violations of assumptions. We further validate the model by reproducing at the group level an existing individual-level analysis of British attitudes towards redistribution. We then reanalyze a recent cross-national application of a group-level item response theory model, replacing its domain-specific confirmatory approach with an exploratory MODGIRT model. We describe extensions to allow for overdispersion, differential item functioning, and group-level predictors. A publicly available R package implements these methods.
- 3 December 2024
- Published by Springer Nature
- p. 125-144
Causal Inference and American Political Development: Contrasts and Complementarities
- 3 December 2024
- Published by Springer Nature
- p. 125-144
Causal Inference and American Political Development: Contrasts and Complementarities
- Open Access
Randomization Inference beyond the Sharp Null: Bounded Null Hypotheses and Quantiles of Individual Treatment Effects
Randomization inference (RI) is typically interpreted as testing Fisher's "sharp" null hypothesis that all unit-level effects are exactly zero. This hypothesis is often criticized as restrictive and implausible, making its rejection scientifically uninteresting. We show, however, that many randomization tests are also valid for a "bounded" null hypothesis under which the unit-level effects are all non-positive (or all non-negative) but are otherwise heterogeneous. In addition to being more plausible a priori, bounded nulls are closely related to substantively important concepts such as monotonicity and Pareto efficiency. Reinterpreting RI in this way also dramatically expands the range of inferences possible in this framework. We show that exact confidence intervals for the maximum (or minimum) unit-level effect can be obtained by inverting tests for a sequence of bounded nulls. We also generalize RI to cover inference for quantiles of the individual effect distribution as well as for the proportion of individual effects larger (or smaller) than a given threshold. The proposed confidence intervals for all effect quantiles are simultaneously valid, in the sense that no correction for multiple analyses is required, and are thus a "free lunch" added to conventional RI. In sum, our reinterpretation and generalization provide a broader justification for randomization tests and a basis for exact nonparametric inference for effect quantiles. We illustrate our methods with simulations and applications, finding that Stephenson rank statistics can provide more informative results than the more common Wilcoxon rank or difference-in-means statistics. We also provide an R package RIQITE implementing the proposed approach.
Open AccessRandomization Inference beyond the Sharp Null: Bounded Null Hypotheses and Quantiles of Individual Treatment Effects
Randomization inference (RI) is typically interpreted as testing Fisher's "sharp" null hypothesis that all unit-level effects are exactly zero. This hypothesis is often criticized as restrictive and implausible, making its rejection scientifically uninteresting. We show, however, that many randomization tests are also valid for a "bounded" null hypothesis under which the unit-level effects are all non-positive (or all non-negative) but are otherwise heterogeneous. In addition to being more plausible a priori, bounded nulls are closely related to substantively important concepts such as monotonicity and Pareto efficiency. Reinterpreting RI in this way also dramatically expands the range of inferences possible in this framework. We show that exact confidence intervals for the maximum (or minimum) unit-level effect can be obtained by inverting tests for a sequence of bounded nulls. We also generalize RI to cover inference for quantiles of the individual effect distribution as well as for the proportion of individual effects larger (or smaller) than a given threshold. The proposed confidence intervals for all effect quantiles are simultaneously valid, in the sense that no correction for multiple analyses is required, and are thus a "free lunch" added to conventional RI. In sum, our reinterpretation and generalization provide a broader justification for randomization tests and a basis for exact nonparametric inference for effect quantiles. We illustrate our methods with simulations and applications, finding that Stephenson rank statistics can provide more informative results than the more common Wilcoxon rank or difference-in-means statistics. We also provide an R package RIQITE implementing the proposed approach.
- 31 August 2022
- Published by Cambridge University Press (CUP) in Perspectives on Politics
- Vol. 20 (3) , 1102-1104
A Troubled Birth: The 1930s and American Public Opinion. By Susan Herbst. Chicago: The University of Chicago Press. 2021. 296p. $105.00 cloth. $35.00 paper.
- 31 August 2022
- Published by Cambridge University Press (CUP) in Perspectives on Politics
- Vol. 20 (3) , 1102-1104
A Troubled Birth: The 1930s and American Public Opinion. By Susan Herbst. Chicago: The University of Chicago Press. 2021. 296p. $105.00 cloth. $35.00 paper.
- 1 April 2020
- Published by University of Chicago Press in The Journal of Politics
- Vol. 82 (2) , 494-508
Policy and Performance in the New Deal Realignment: Evidence from Old Data and New Methods
- 1 April 2020
- Published by University of Chicago Press in The Journal of Politics
- Vol. 82 (2) , 494-508
Policy and Performance in the New Deal Realignment: Evidence from Old Data and New Methods
- 23 July 2019
- Published by Springer Nature in Public Choice
- Vol. 185 (3-4) , 359-376
Causal inference and American political development: contrasts and complementarities
- 23 July 2019
- Published by Springer Nature in Public Choice
- Vol. 185 (3-4) , 359-376
Causal inference and American political development: contrasts and complementarities
- Open Access
- 11 April 2019
- Published by Cambridge University Press (CUP) in Political Analysis
- Vol. 27 (3) , 388-396
Dynamic Ecological Inference for Time-Varying Population Distributions Based on Sparse, Irregular, and Noisy Marginal Data
Social scientists are frequently interested in how populations evolve over time. Creating poststratification weights for surveys, for example, requires information on the weighting variables’ joint distribution in the target population. Typically, however, population data are sparsely available across time periods. Even when population data are observed, the content and structure of the data—which variables are observed and whether their marginal or joint distributions are known—differ across time, in ways that preclude straightforward interpolation. As a consequence, survey weights are often based only on the small subset of auxiliary variables whose joint population distribution is observed regularly over time, and thus fail to take full advantage of auxiliary information. To address this problem, we develop a dynamic Bayesian ecological inference model for estimating multivariate categorical distributions from sparse, irregular, and noisy data on their marginal (or partially joint) distributions. Our approach combines (1) a Dirichlet sampling model for the observed margins conditional on the unobserved cell proportions; (2) a set of equations encoding the logical relationships among different population quantities; and (3) a Dirichlet transition model for the period-specific proportions that pools information across time periods. We illustrate this method by estimating annual U.S. phone-ownership rates by race and region based on population data irregularly available between 1930 and 1960. This approach may be useful in a wide variety of contexts where scholars wish to make dynamic ecological inferences about interior cells from marginal data. A new R package estsubpop implements the method.
- 11 April 2019
- Published by Cambridge University Press (CUP) in Political Analysis
- Vol. 27 (3) , 388-396
Open AccessDynamic Ecological Inference for Time-Varying Population Distributions Based on Sparse, Irregular, and Noisy Marginal Data
Social scientists are frequently interested in how populations evolve over time. Creating poststratification weights for surveys, for example, requires information on the weighting variables’ joint distribution in the target population. Typically, however, population data are sparsely available across time periods. Even when population data are observed, the content and structure of the data—which variables are observed and whether their marginal or joint distributions are known—differ across time, in ways that preclude straightforward interpolation. As a consequence, survey weights are often based only on the small subset of auxiliary variables whose joint population distribution is observed regularly over time, and thus fail to take full advantage of auxiliary information. To address this problem, we develop a dynamic Bayesian ecological inference model for estimating multivariate categorical distributions from sparse, irregular, and noisy data on their marginal (or partially joint) distributions. Our approach combines (1) a Dirichlet sampling model for the observed margins conditional on the unobserved cell proportions; (2) a set of equations encoding the logical relationships among different population quantities; and (3) a Dirichlet transition model for the period-specific proportions that pools information across time periods. We illustrate this method by estimating annual U.S. phone-ownership rates by race and region based on population data irregularly available between 1930 and 1960. This approach may be useful in a wide variety of contexts where scholars wish to make dynamic ecological inferences about interior cells from marginal data. A new R package estsubpop implements the method.
- Top Cited Papers
- 1 February 2019
- Published by Cambridge University Press (CUP) in American Political Science Review
- Vol. 113 (3) , 674-693
Policy Ideology in European Mass Publics, 1981–2016
Using new scaling methods and a comprehensive public opinion dataset, we develop the first survey-based time-series–cross-sectional measures of policy ideology in European mass publics. Our dataset covers 27 countries and 36 years and contains nearly 2.7 million survey responses to 109 unique issue questions. Estimating an ordinal group-level IRT model in each of four issue domains, we obtain biennial estimates of the absolute economic conservatism, relative economic conservatism, social conservatism, and immigration conservatism of men and women in three age categories in each country. Aggregating the group-level estimates yields estimates of the average conservatism in national publics in each biennium between 1981–82 and 2015–16. The four measures exhibit contrasting cross-sectional cleavages and distinct temporal dynamics, illustrating the multidimensionality of mass ideology in Europe. Subjecting our measures to a series of validation tests, we show that the constructs they measure are distinct and substantively important and that they perform as well as or better than one-dimensional proxies for mass conservatism (left–right self-placement and median voter scores). We foresee many uses for these scores by scholars of public opinion, electoral behavior, representation, and policy feedback.
- 1 February 2019
- Published by Cambridge University Press (CUP) in American Political Science Review
- Vol. 113 (3) , 674-693
Top Cited PapersPolicy Ideology in European Mass Publics, 1981–2016
Using new scaling methods and a comprehensive public opinion dataset, we develop the first survey-based time-series–cross-sectional measures of policy ideology in European mass publics. Our dataset covers 27 countries and 36 years and contains nearly 2.7 million survey responses to 109 unique issue questions. Estimating an ordinal group-level IRT model in each of four issue domains, we obtain biennial estimates of the absolute economic conservatism, relative economic conservatism, social conservatism, and immigration conservatism of men and women in three age categories in each country. Aggregating the group-level estimates yields estimates of the average conservatism in national publics in each biennium between 1981–82 and 2015–16. The four measures exhibit contrasting cross-sectional cleavages and distinct temporal dynamics, illustrating the multidimensionality of mass ideology in Europe. Subjecting our measures to a series of validation tests, we show that the constructs they measure are distinct and substantively important and that they perform as well as or better than one-dimensional proxies for mass conservatism (left–right self-placement and median voter scores). We foresee many uses for these scores by scholars of public opinion, electoral behavior, representation, and policy feedback.
- 1 January 2019
- Published by University of Chicago Press in The Journal of Politics
- Vol. 81 (1) , 352-363
Public Opinion in Subnational Politics
Until recently, the study of representation at the subnational level was hobbled by the lack of high-quality information about public opinion. The advent of new data sources, however, as well as of new methods such as multilevel regression and poststratification, has greatly enhanced scholars’ capacity to describe public opinion in states, legislative districts, cities, and other subnational units. These advances in measurement have in turn revolutionized the study of subnational representation. In this article, we summarize new approaches to the measurement of subnational opinion. We then review recent developments in the study of the role of subnational public opinion in the political process and discuss potentially fruitful avenues for future research.
- 1 January 2019
- Published by University of Chicago Press in The Journal of Politics
- Vol. 81 (1) , 352-363
Public Opinion in Subnational Politics
Until recently, the study of representation at the subnational level was hobbled by the lack of high-quality information about public opinion. The advent of new data sources, however, as well as of new methods such as multilevel regression and poststratification, has greatly enhanced scholars’ capacity to describe public opinion in states, legislative districts, cities, and other subnational units. These advances in measurement have in turn revolutionized the study of subnational representation. In this article, we summarize new approaches to the measurement of subnational opinion. We then review recent developments in the study of the role of subnational public opinion in the political process and discuss potentially fruitful avenues for future research.
- 23 November 2018
- Published by Cambridge University Press (CUP) in Perspectives on Politics
- Vol. 16 (4) , 1178-1179
Unstable Majorities: Polarization, Party Sorting, and Political Stalemate. By Morris P. Fiorina. Stanford, CA: Hoover Institution Press, 2017. 239p. $24.95 paper.
- 23 November 2018
- Published by Cambridge University Press (CUP) in Perspectives on Politics
- Vol. 16 (4) , 1178-1179
Unstable Majorities: Polarization, Party Sorting, and Political Stalemate. By Morris P. Fiorina. Stanford, CA: Hoover Institution Press, 2017. 239p. $24.95 paper.