A Comprehensive Survey on Big Data Analytics: Characteristics, Tools and Techniques
Top Cited Papers
Open Access
- 5 March 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 57 (8) , 1-33
Abstract
Modern computing devices generate vast amounts of diverse data. It means that a fast transition through various computing devices leads to big data production. Big data with high velocity, volume, and variety presents challenges like data inconsistency, scalability, real-time analysis, and tool selection. Although numerous solutions have been proposed for big data processing, they are often limited in scope and effectiveness. This survey aims to address the lack of comprehensive analysis of big data challenges in relation to machine learning (ML) and the Internet of Things (IoT) environments, particularly concerning the 7Vs of big data. It emphasizes the significance of selecting suitable tools to address each unique big data characteristic, providing a structured approach to manage these challenges effectively. The article systematically reviews big data characteristics and associated techniques, with a detailed discussion of various tools and their applications. Additionally, it analyzes existing ML methods and techniques for IoT data analytics in big data contexts. Through a systematic literature review (SLR), we examine key aspects, including core concepts, benefits, limitations, and the impact of big data on ML algorithms and IoT data analytics. We highlight groundbreaking studies addressing big data challenges to impact future research and enhance big data-driven applications.Keywords
Funding Information
- University Grants Commission (NTA Ref. 210510235958)
This publication has 129 references indexed in Scilit:
- A Systematic Literature Review on Data Provenance Visualization2023
- Transfer Learning Approach and Nucleus Segmentation with MedCLNet Colon Cancer DatabaseJournal of Digital Imaging, 2022
- Data integrity within the biopharmaceutical sector in the era of Industry 4.0Biotechnology Journal, 2022
- The Curse of Dimensionality2022
- Radiology, AI and Big Data: Challenges and Opportunities for Medical Imaging2022
- Leveraging big data in smart cities: A systematic reviewConcurrency and Computation: Practice and Experience, 2021
- Modern Monte Carlo methods for efficient uncertainty quantification and propagation: A surveyWIREs Computational Statistics, 2020
- Analysis and Comparative Exploration of Elastic Search, MongoDB and Hadoop Big Data Processing2017
- The anatomy of big data computingSoftware: Practice and Experience, 2015
- A survey on indexing techniques for big data: taxonomy and performance evaluationKnowledge and Information Systems, 2015