An Expert-Sourced Measure of Judicial Ideology
Author:
Open Access
- 15 August 2025
- journal article
- research article
- Published by Cambridge University Press (CUP) in Political Analysis
- Vol. 34 (2) , 258-277
Abstract
This article develops the first dynamic method for systematically estimating the ideologies and other traits of nearly the entire federal judiciary. The Jurist-Derived Judicial Ideology Scores (JuDJIS) method derives from computational text analysis of over 20,000 written evaluations by a representative sample of tens of thousands of jurists as part of an ongoing, systematic survey initiative begun in 1985. The resulting data constitute not only the first such comprehensive federal-court measure that is dynamic, but also the only such measure that is based on judging, and the only such measure that is potentially multi-dimensional. The results of empirical validity tests reflect these advantages. Validation on a set of several-thousand appellate decisions indicates that the ideology estimates predict outcomes significantly more accurately than the existing appellate measures, such as the Judicial Common Space. In addition to informing theoretical debates about the nature of judicial ideology and decision-making, the JuDJIS initiative might lead courts scholars to revisit some of the lower-court research findings of the last two decades, which are generally based on static, non-judicial models. Perhaps most importantly, this method could foster breakthroughs in courts research that, until now, were impossible due to data limitations.Keywords
This publication has 40 references indexed in Scilit:
- Trading Diversity? Judicial Diversity and Case Outcomes in Federal CourtsAmerican Political Science Review, 2024
- Enhancing Lexicon Based Sentiment Analysis Using n-gram Approach2023
- Chapel Hill Expert Survey trend file, 1999–2019Electoral Studies, 2022
- Patterns of disagreement in indicators of state repressionPolitical Science Research and Methods, 2019
- Comparing Random Forest with Logistic Regression for Predicting Class-Imbalanced Civil War Onset Data: A CommentPolitical Analysis, 2018
- Reading Between the Lines: Prediction of Political Violence Using Newspaper TextAmerican Political Science Review, 2017
- A Common-Space Scaling of the American Judiciary and Legal ProfessionPolitical Analysis, 2017
- Crowd-sourced Text Analysis: Reproducible and Agile Production of Political DataAmerican Political Science Review, 2016
- Conceptualizing and Measuring Democracy: A New ApproachPerspectives on Politics, 2011
- The Politics of International Judicial Appointments: Evidence from the European Court of Human RightsInternational Organization, 2007