Cloud Kotta: Enabling secure and scalable data analytics in the cloud
Open Access
- 1 December 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 302-310
Abstract
Distributed communities of researchers rely increasingly on valuable, proprietary, or sensitive datasets. Given the growth of such data, especially in fields new to data-driven research like the social sciences and humanities, coupled with what are often strict and complex data-use agreements, many research communities now require methods that allow secure, scalable and cost-effective storage and analysis. Here we present Cloud Kotta: a cloud-based data management and analytics framework. Cloud Kotta delivers an end-to-end solution for coordinating secure access to large datasets, and an execution model that provides both automated infrastructure scaling and support for executing analytics near to the data. Cloud Kotta implements a fine-grained security model ensuring that only authorized users may access, analyze, and download protected data. It also implements automated methods for acquiring and configuring low-cost storage and compute resources as they are needed. We present the architecture and implementation of Cloud Kotta and demonstrate the advantages it provides in terms of increased performance and flexibility. We show that Cloud Kotta's elastic provisioning model can reduce costs by up to 16x when compared with statically provisioned models.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Amplifying the impact of open access: Wikipedia and the diffusion of scienceJournal of the Association for Information Science and Technology, 2016
- A secure data enclave and analytics platform for social scientists2016
- The Globus Galaxies platform: delivering science gateways as a serviceConcurrency and Computation: Practice and Experience, 2015
- BigExcel: A web-based framework for exploring big data in social sciences2014
- Cloud computing data capsules for non-consumptiveuse of texts2014
- A Hybrid Cloud Architecture for a Social Science Research Computing Data Center2014
- Makeflow2012
- Harnessing cloud computing with Galaxy CloudNature Biotechnology, 2011
- Plug-and-play macroscopesCommunications of the ACM, 2011
- iRODS Primer: Integrated Rule-Oriented Data SystemSynthesis Lectures on Information Concepts, Retrieval, and Services, 2010