An Iterative Methodology for Defining Big Data Analytics Architectures
Open Access
- 19 November 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 210597-210616
Abstract
Thanks to the advances achieved in the last decade, the lack of adequate technologies to deal with Big Data characteristics such as Data Volume is no longer an issue. Instead, recent studies highlight that one of the main Big Data issues is the lack of expertise to select adequate technologies and build the correct Big Data architecture for the problem at hand. In order to tackle this problem, we present our methodology for the generation of Big Data pipelines based on several requirements derived from Big Data features that are critical for the selection of the most appropriate tools and techniques. Thus, thanks to our approach we reduce the required know-how to select and build Big Data architectures by providing a step-by-step methodology that leads Big Data architects into creating their Big Data Pipelines for the case at hand. Our methodology has been tested in two use cases.Keywords
This publication has 29 references indexed in Scilit:
- IRIS: A goal-oriented big data analytics framework on Spark for better Business decisions2017
- Crowdsourcing roles, methods and tools for data-intensive disaster managementInformation Systems Frontiers, 2017
- Big Data in Health and Healthcare: Hopes and Fears for the Future2016
- Big data analytics in E-commerce: a systematic review and agenda for future researchElectronic Markets, 2016
- Data Warehousing in Big Data2016
- A survey of open source tools for machine learning with big data in the Hadoop ecosystemJournal of Big Data, 2015
- An iterative methodology for big data management, analysis and visualization2015
- Modeling the requirements for big data application using goal oriented approach2014
- A Model-Driven Goal-Oriented Requirement Engineering Approach for Data Warehouses2007
- A UML profile for multidimensional modeling in data warehousesData & Knowledge Engineering, 2006