HiPerData: An autonomous large-scale model building and management platform for big data analytics
Authors:
- 1 June 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 449-454
Abstract
Data mining is a difficult task that relies on an exploratory and analytic process of processing large quantities of data in order to discover meaningful patterns for valuable insights. The increasing heterogeneity and complexity of data requires expert knowledge on how to combine multiple data mining techniques to process and analyze the data in an effective and efficient way. This paper presents a distributed architecture, HiPerData, for automated data processing and mining using large-scale computational resource management, model building and selection, and predictive and inference analysis. We illustrate two data mining tasks in which we automate the data mining knowledge flow construction based on the use of standards that have been defined in both data mining and automated-planning communities.Keywords
This publication has 9 references indexed in Scilit:
- Purlieus2011
- A Hybrid Intelligent Method for Performance Modeling and Prediction of Workflow Activities in Grids2009
- Managing large collections of data mining modelsCommunications of the ACM, 2008
- A Survey of General‐Purpose Computation on Graphics HardwareComputer Graphics Forum, 2007
- Rule interestingness analysis using OLAP operations2006
- Run-time Optimisation of Grid Workflow Applications2006
- The gridbus toolkit for service oriented grid and utility computing: an overview and status report2004
- Web usage miningACM SIGKDD Explorations Newsletter, 2000
- Integrated Modeling Environments in Organizations: An Empirical StudyInformation Systems Research, 1998