MapReduce Functions to Analyze Sentiment Information from Social Big Data
Open Access
- 1 June 2015
- journal article
- Published by SAGE Publications in International Journal of Distributed Sensor Networks
- Vol. 11 (6)
Abstract
Opinion mining, which extracts meaningful opinion information from large amounts of social multimedia data, has recently arisen as a research area. In particular, opinion mining has been used to understand the true meaning and intent of social networking site users. It requires efficient techniques to collect a large amount of social multimedia data and extract meaningful information from them. Therefore, in this paper, we propose a method to extract sentiment information from various types of unstructured social media text data from social networks by using a parallel Hadoop Distributed File System (HDFS) to save social multimedia data and using MapReduce functions for sentiment analysis. The proposed method has stably performed data gathering and data loading and maintained stable load balancing of memory and CPU resources during data processing by the HDFS system. The proposed MapReduce functions have effectively performed sentiment analysis in the experiments. Finally, the sentiment analysis results of the proposed system are very close to those of manual processes.Keywords
Funding Information
- Yeungnam University
This publication has 11 references indexed in Scilit:
- A Study on Opinion Mining of Newspaper Texts based on Topic ModelingJournal of the Korean Society for Library and Information Science, 2013
- Amazon dynamoDB2012
- Towards building large-scale distributed systems for twitter sentiment analysis2012
- Survey on NoSQL database2011
- Access2010
- A survey on sentiment detection of reviewsExpert Systems with Applications, 2009
- BigtableACM Transactions on Computer Systems, 2008
- MapReduceCommunications of the ACM, 2008
- Open-Domain Question–AnsweringFoundations and Trends® in Information Retrieval, 2007
- Brewer's conjecture and the feasibility of consistent, available, partition-tolerant web servicesACM SIGACT News, 2002