Scaling Text with the Class Affinity Model
Preprint
Abstract
Probabilistic methods for classifying text form a rich tradition in machine learning and natural language processing. For many important problems, however, class prediction is uninteresting because the class is known, and instead the focus shifts to estimating latent quantities related to the text, such as affect or ideology. We focus on one such problem of interest, estimating the ideological positions of 55 Irish legislators in the 1991 D\'ail confidence vote. To solve the D\'ail scaling problem and others like it, we develop a text modeling framework that allows actors to take latent positions on a "gray" spectrum between "black" and "white" polar opposites. We are able to validate results from this model by measuring the influences exhibited by individual words, and we are able to quantify the uncertainty in the scaling estimates by using a sentence-level block bootstrap. Applying our method to the D\'ail debate, we are able to scale the legislators between extreme pro-government and pro-opposition in a way that reveals nuances in their speeches not captured by their votes or party affiliations.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Multinomial Inverse Regression for Text AnalysisJournal of the American Statistical Association, 2013
- Validating Estimates of Latent Traits from Textual Data Using Human Judgment as a BenchmarkPolitical Analysis, 2013
- Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political TextsPolitical Analysis, 2013
- Affective News: The Automated Coding of Sentiment in Political TextsPolitical Communication, 2012
- A Bayesian Hierarchical Topic Model for Political Texts: Measuring Expressed Agendas in Senate Press ReleasesPolitical Analysis, 2010
- Classifying Party Affiliation from Political SpeechJournal of Information Technology & Politics, 2008
- Understanding WordscoresPolitical Analysis, 2008
- A Robust Transformation Procedure for Interpreting Political TextPolitical Analysis, 2007
- Text categorization with Support Vector Machines: Learning with many relevant features1998
- On the choice of flattening constants for estimating multinomial probabilitiesJournal of Multivariate Analysis, 1972