Hadoop framework for efficient sentiment classification using trees
Authors:
Open Access
- 22 September 2020
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Networks
- Vol. 9 (5) , 223-228
Abstract
Due to the increase in the speed of generation of data, the authors are forced to handle a massive volume of data with the help of conventional machine learning algorithms. Big data is an enormous volume of data which is beyond the capacity of the traditional database software tool to collect, store, manage, and process within a stipulated time limit. Sentiment analysis is analysing the data by classifying the text on the basis of strength and polarity of opinion (positive/negative) words that define the text. While handling big data, Hadoop provides a platform for users to develop their own sentiment analysis with the help of a lexicon dictionary or available application programming interface (API) or external programs. The aim of classifying data is to analyse extensive data and develop an appropriate description or model for every organised class with the feature present in the data. In this work, the feature extraction based on term frequency‐inverse document frequency is utilised and the Hadoop framework in attaining a useful classification with the help of random forest techniques.Keywords
This publication has 12 references indexed in Scilit:
- A Scalable Text Classification Using Naive Bayes with Hadoop Framework2019
- Mining Big Data with Random ForestsCognitive Computation, 2019
- A Review of Sentiment Semantic Analysis Technology and Progress2017
- Study of Sentiment Analysis Using Hadoop2017
- The parameter sensitivity of random forestsBMC Bioinformatics, 2016
- CLASSIFICATION ALGORITHMS FOR BIG DATA ANALYSIS, A MAP REDUCE APPROACHThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2015
- On the use of MapReduce for imbalanced big data using Random ForestInformation Sciences, 2014
- Hadoop Architecture and Its Issues2014
- Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised LearningFoundations and Trends in Computer Graphics and Vision, 2012
- Random ForestsMachine Learning, 2001