Visual Polarization Measurement Using Counterfactual Image Generation
Preprint
Abstract
Political polarization is a significant issue in American politics, influencing public discourse, policy, and consumer behavior. While studies on polarization in news media have extensively focused on verbal content, non-verbal elements, particularly visual content, have received less attention due to the complexity and high dimensionality of image data. Traditional descriptive approaches often rely on feature extraction from images, leading to biased polarization estimates due to information loss. In this paper, we introduce the Polarization Measurement using Counterfactual Image Generation (PMCIG) method, which combines economic theory with generative models and multi-modal deep learning to fully utilize the richness of image data and provide a theoretically grounded measure of polarization in visual content. Applying this framework to a decade-long dataset featuring 30 prominent politicians across 20 major news outlets, we identify significant polarization in visual content, with notable variations across outlets and politicians. At the news outlet level, we observe significant heterogeneity in visual slant. Outlets such as Daily Mail, Fox News, and Newsmax tend to favor Republican politicians in their visual content, while The Washington Post, USA Today, and The New York Times exhibit a slant in favor of Democratic politicians. At the politician level, our results reveal substantial variation in polarized coverage, with Donald Trump and Barack Obama among the most polarizing figures, while Joe Manchin and Susan Collins are among the least. Finally, we conduct a series of validation tests demonstrating the consistency of our proposed measures with external measures of media slant that rely on non-image-based sources.Keywords
All Related Versions
This publication has 25 references indexed in Scilit:
- Foundations & Trends in Multimodal Machine Learning: Principles, Challenges, and Open QuestionsACM Computing Surveys, 2024
- Machine Learning as a Tool for Hypothesis GenerationThe Quarterly Journal of Economics, 2024
- Modeling Eye Movements During Decision Making: A ReviewPsychometrika, 2023
- The Upworthy Research Archive, a time series of 32,487 experiments in U.S. mediaScientific Data, 2021
- Automated optimized parameters for T-distributed stochastic neighbor embedding improve visualization and analysis of large datasetsNature Communications, 2019
- Same Candidates, Different Faces: Uncovering Media Bias in Visual Portrayals of Presidential Candidates with Computer VisionJournal of Communication, 2018
- Double/debiased machine learning for treatment and structural parametersThe Econometrics Journal, 2018
- Joint Face Detection and Alignment Using Multitask Cascaded Convolutional NetworksIEEE Signal Processing Letters, 2016
- Filter Bubbles, Echo Chambers, and Online News ConsumptionPublic Opinion Quarterly, 2016
- Media Bias and ReputationJournal of Political Economy, 2006