Stylistic Variation in Social Media Part-of-Speech Tagging
Preprint
Abstract
Social media features substantial stylistic variation, raising new challenges for syntactic analysis of online writing. However, this variation is often aligned with author attributes such as age, gender, and geography, as well as more readily-available social network metadata. In this paper, we report new evidence on the link between language and social networks in the task of part-of-speech tagging. We find that tagger error rates are correlated with network structure, with high accuracy in some parts of the network, and lower accuracy elsewhere. As a result, tagger accuracy depends on training from a balanced sample of the network, rather than training on texts from a narrow subcommunity. We also describe our attempts to add robustness to stylistic variation, by building a mixture-of-experts model in which each expert is associated with a region of the social network. While prior work found that similar approaches yield performance improvements in sentiment analysis and entity linking, we were unable to obtain performance improvements in part-of-speech tagging, despite strong evidence for the link between part-of-speech error rates and social network structure.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Overcoming Language Variation in Sentiment Analysis with Social AttentionTransactions of the Association for Computational Linguistics, 2017
- Migration and Dialect ContactAnnual Review of Linguistics, 2017
- Social networks that matter: Twitter under the microscopeFirst Monday, 2008
- African American English: A Linguistic IntroductionEnglish World-Wide, 2004
- American English : Dialects and variation. By Walt Wolfram and Natalie Schilling-Estes. (Language in society 24) Oxford: Blackwell, 1998. Pp. xvii, 398.Language, 2000
- Adaptive Mixtures of Local ExpertsNeural Computation, 1991
- Linguistic change and diffusion: description and explanation in sociolinguistic dialect geographyLanguage in Society, 1974