Topic Modeling and Visualization for Big Data in Social Sciences
Authors:
- Nitin SukhijaNSNitin Sukhija
- Mahidhar TatineniMTMahidhar Tatineni
- Nicole BrownNBNicole Brown
- Mark Van MoerMMMark Van Moer
- Paul RodriguezPRPaul Rodriguez
- Spencer CallicottSCSpencer Callicott
- 1 July 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1198-1205
Abstract
Topic modeling is a widely used approach for analyzing large text collections. In particular, Latent Dirichlet Allocation (LDA) is one of the most popular topic modeling approaches to aggregate vocabulary from a document corpus to form latent "topics". However, learning meaningful topic models with massive document collections which contain millions of documents, billions of tokens is challenging, given the complexity of the data involved, the difficulty in distributing the computation across multiple computing nodes. In recent years some data processing frameworks, such as Spark, Mallet, others have been developed to address the issues associated with analyzing large volumes of unlabeled text pertaining to various domains in a scalable, efficient manner. In this paper, we will present a preliminary case study demonstrating the scholarship achieved in the study of political consumerism via XSEDE resources. The experimental study will showcase the use of digitized social sciences data, text analytics toolkits to generate topic models, visualize topics for empowering intersectional research engaging the relationship between consumption, race, class, gender in the area of sociology. Consequently, this comparative big data textual analysis involving use of JSTOR data, LDA modeling toolkit's, visualization techniques, computational components is of paramount importance, especially for researchers from academic domain dealing with social science applications involving big data.Keywords
This publication has 7 references indexed in Scilit:
- Accelerating Spark with RDMA for Big Data Processing: Early Experiences2014
- HOMR2014
- Probabilistic topic modelsCommunications of the ACM, 2012
- Text Analytics in Social Media2012
- RDMA over Ethernet — A preliminary study2009
- Processing: programming for the media artsAI & SOCIETY, 2006
- How to build a WebFountain: An architecture for very large-scale text analyticsIBM Systems Journal, 2004