Automatic identification of personal insults on social news sites
- 28 October 2011
- journal article
- research article
- Published by Wiley in Journal of the American Society for Information Science and Technology
- Vol. 63 (2) , 270-285
Abstract
As online communities grow and the volume of user‐generated content increases, the need for community management also rises. Community management has three main purposes: to create a positive experience for existing participants, to promote appropriate, socionormative behaviors, and to encourage potential participants to make contributions. Research indicates that the quality of content a potential participant sees on a site is highly influential; off‐topic, negative comments with malicious intent are a particularly strong boundary to participation or set the tone for encouraging similar contributions. A problem for community managers, therefore, is the detection and elimination of such undesirable content. As a community grows, this undertaking becomes more daunting. Can an automated system aid community managers in this task? In this paper, we address this question through a machine learning approach to automatic detection of inappropriate negative user contributions. Our training corpus is a set of comments from a news commenting site that we tasked Amazon Mechanical Turk workers with labeling. Each comment is labeled for the presence of profanity, insults, and the object of the insults. Support vector machines trained on these data are combined with relevance and valence analysis systems in a multistep approach to the detection of inappropriate negative user contributions. The system shows great potential for semiautomated community management.Keywords
This publication has 23 references indexed in Scilit:
- Normative influences on thoughtful online participation2011
- Griefing in virtual worlds: causes, casualties and coping strategiesInformation Systems Journal, 2009
- Financial incentives and the "performance of crowds"2009
- Opinion Mining and Sentiment AnalysisFoundations and Trends® in Information Retrieval, 2008
- Crowdsourcing user studies with Mechanical Turk2008
- Thumbs up?2002
- Information access in contextKnowledge-Based Systems, 2001
- Text categorization with Support Vector Machines: Learning with many relevant features1998
- Stacked generalizationNeural Networks, 1992
- Term-weighting approaches in automatic text retrievalInformation Processing & Management, 1988