Collaborating with the Machines: A Hybrid Method for Classifying Policy Documents
Authors:
- Matt W. LoftisMLMatt W. Loftis
- Peter B. MortensenPMPeter B. Mortensen
- 29 January 2018
- journal article
- research article
- Published by Wiley in Policy Studies Journal
- Vol. 48 (1) , 184-206
Abstract
Governments produce vast and growing quantities of freely available text: laws, rules, budgets, press releases, and so forth. This information flood is facilitating important, growing research programs in policy and public administration. However, tightening research budgets and the information's vast scale forces political science and public policy to aspire to do more with less. Meeting this challenge means applied researchers must innovate. This article makes two contributions for practical text coding—the process of sorting government text into researcher‐defined coding schemes. First, we propose a method of combining human coding with automated computer classification for large data sets. Second, we present a well‐known algorithm for automated text classification, the Naïve Bayes classifier, and provide software for working with it. We argue and provide evidence that this method can help applied researchers using human coders to get more from their research budgets, and we demonstrate the method using classical examples from the study of policy agendas.Keywords
This publication has 28 references indexed in Scilit:
- Political Science Funding Black Out in North America? Trends in Funding Should not be IgnoredPS: Political Science & Politics, 2013
- When good news is scarce and bad news is good: Government responsibilities and opposition possibilities in political agenda‐settingEuropean Journal of Political Research, 2012
- Institutional Design and Formal Autonomy: Political versus Historical and Cultural ExplanationsJournal of Public Administration Research and Theory, 2009
- Feature selection for text classification with Naïve BayesExpert Systems with Applications, 2009
- Classifying Party Affiliation from Political SpeechJournal of Information Technology & Politics, 2008
- Computer-Assisted Topic Classification for Mixed-Methods Social Science ResearchJournal of Information Technology & Politics, 2008
- The evolution of higher education rules: evidence for an ecology of lawInternational Review of Administrative Sciences, 2007
- Limits to Bureaucratic Growth: The Density Dependence of Organizational Rule BirthsAdministrative Science Quarterly, 1998
- Naive (Bayes) at forty: The independence assumption in information retrieval1998
- The Dynamics of Organizational RulesAmerican Journal of Sociology, 1993