The Six Pillars for Building Big Data Analytics Ecosystems
Authors:
Open Access
- 2 August 2016
- journal article
- survey
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 49 (2) , 1-36
Abstract
With almost everything now online, organizations look at the Big Data collected to gain insights for improving their services. In the analytics process, derivation of such insights requires experimenting-with and integrating different analytics techniques, while handling the Big Data high arrival velocity and large volumes. Existing solutions cover bits-and-pieces of the analytics process, leaving it to organizations to assemble their own ecosystem or buy an off-the-shelf ecosystem that can have unnecessary components to them. We build on this point by dividing the Big Data Analytics problem into six main pillars. We characterize and show examples of solutions designed for each of these pillars. We then integrate these six pillars into a taxonomy to provide an overview of the possible state-of-the-art analytics ecosystems. In the process, we highlight a number of ecosystems to meet organizations different needs. Finally, we identify possible areas of research for building future Big Data Analytics Ecosystems.Keywords
Funding Information
- IBM CAS research and NSERC
This publication has 83 references indexed in Scilit:
- A survey of large-scale analytical query processing in MapReduceThe VLDB Journal, 2013
- Scalable SQL and NoSQL data storesACM SIGMOD Record, 2011
- CassandraACM SIGOPS Operating Systems Review, 2010
- BigtableACM Transactions on Computer Systems, 2008
- MapReduceCommunications of the ACM, 2008
- Pellet: A practical OWL-DL reasonerJournal of Web Semantics, 2007
- DryadACM SIGOPS Operating Systems Review, 2007
- Distributed data mining and agentsEngineering Applications of Artificial Intelligence, 2005
- A taxonomy of scientific workflow systems for grid computingACM SIGMOD Record, 2005
- Building data mining solutions with OLE DB for DM and XML for analysisACM SIGMOD Record, 2005