A Linguistic Strategy to Measure Negative Affective Polarization Through Text Content
- 4 May 2025
- journal article
- Published by SAGE Publications in Journal of Language and Social Psychology
- Vol. 44 (6) , 881-906
Abstract
Three studies developed and validated a linguistic dictionary to measure negative affective polarization in English and Spanish political texts. It captures three dimensions: negative affect, delegitimization, and political context. In the first study, two independent judges evaluated the candidate words, and reliability indicators were calculated, showing acceptable values for short texts (.572 in English, .541 in Spanish) and higher values for larger corpora (.964 in English, .957 in Spanish). The second study tested discriminant validity by comparing negative affective polarization scores in social media comments on politics and entertainment. Results showed significantly higher polarization scores in political content, confirming the dictionary's validity. The third study compared the dictionary to an existing online polarization measure, finding greater coverage and alignment with the construct. Additionally, it was observed that polarization scores were higher in texts containing hate speech compared to those where it was absent. The findings suggest that the dictionary in both languages have strong psychometric properties, making it a valuable tool for analyzing online content, particularly social media comments. It can be used as an independent measure or as input for machine and deep learning models.Keywords
Funding Information
- National Science Foundation (IIS2107524)
- National Institute of Justice (IIS2107524)
This publication has 42 references indexed in Scilit:
- Populist Storytelling and Negative Affective Polarization: Social Media Evidence from MexicoLatin American Politics and Society, 2024
- The Polarizing Impact of Political Disinformation and Hate Speech: A Cross-country Configural NarrativeInformation Systems Frontiers, 2023
- The kernel of truth in text-based personality assessment: A meta-analysis of the relations between the Big Five and the Linguistic Inquiry and Word Count (LIWC).Psychological Bulletin, 2022
- Validating the feeling thermometer as a measure of partisan affect in multi-party systemsElectoral Studies, 2022
- Cognitive–motivational mechanisms of political polarization in social-communicative contextsNature Reviews Psychology, 2022
- How social media shapes polarizationTrends in Cognitive Sciences, 2021
- Internet, social media and online hate speech. Systematic reviewAggression and Violent Behavior, 2021
- A conflict within a conflict: intragroup ideological polarization and intergroup intractable conflictCurrent Opinion in Behavioral Sciences, 2020
- Trolls just want to have funPersonality and Individual Differences, 2014
- What can software tell us about political candidates?Journal of Language and Politics, 2014