Apache Spark based analysis on word count application in Big Data
Authors:
- 23 February 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 491-495
Abstract
The rise in the volume of data, as well as the type of data and the rate at which data is produced, has led to the development of novel processing methods capable of working with such massive amounts of data, termed as Big Data. The most difficult aspects of managing Big Data include its collection and storage, as well as search, sharing, analysis, and visualizations. In this paper explain the characteristics, processing, application of bigdata and its challenges. Also explained how big data support Internet of Things and Cloud computing. By combining big data, IOT, Cloud provides the new architecture.Keywords
This publication has 14 references indexed in Scilit:
- Collaborative filtering-based recommendation system for big dataInternational Journal of Computational Science and Engineering, 2020
- Leveraging resource management for efficient performance of Apache SparkJournal of Big Data, 2019
- Data analysis in health and big data: A machine learning medical diagnosis model based on patients’ complaintsCommunications in Statistics - Theory and Methods, 2019
- Weather forecasting using parallel and distributed analytics approaches on big data cloudsJournal of Statistics and Management Systems, 2019
- Time Estimation and Resource Minimization Scheme for Apache Spark and Hadoop Big Data Systems With FailuresIEEE Access, 2019
- Big Data technologies: A surveyJournal of King Saud University Computer and Information Sciences, 2018
- Measuring Customer Agility from Online Reviews Using Big Data Text AnalyticsJournal of Management Information Systems, 2018
- Big data analytics on Apache SparkInternational Journal of Data Science and Analytics, 2016
- Big data management processing with Hadoop MapReduce and spark technology: A comparison2016
- Trends and challenges in big data processingProceedings of the VLDB Endowment, 2016