Cloud Kotta: Enabling Secure and Scalable Data Analytics in the Cloud
Preprint
Abstract
Distributed communities of researchers rely increasingly on valuable, proprietary, or sensitive datasets. Given the growth of such data, especially in fields new to data-driven, computationally intensive research like the social sciences and humanities, coupled with what are often strict and complex data-use agreements, many research communities now require methods that allow secure, scalable and cost-effective storage and analysis. Here we present CLOUD KOTTA: a cloud-based data management and analytics framework. CLOUD KOTTA delivers an end-to-end solution for coordinating secure access to large datasets, and an execution model that provides both automated infrastructure scaling and support for executing analytics near to the data. CLOUD KOTTA implements a fine-grained security model ensuring that only authorized users may access, analyze, and download protected data. It also implements automated methods for acquiring and configuring low-cost storage and compute resources as they are needed. We present the architecture and implementation of CLOUD KOTTA and demonstrate the advantages it provides in terms of increased performance and flexibility. We show that CLOUD KOTTA's elastic provisioning model can reduce costs by up to 16x when compared with statically provisioned models.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Amplifying the impact of open access: Wikipedia and the diffusion of scienceJournal of the Association for Information Science and Technology, 2016
- A secure data enclave and analytics platform for social scientists2016
- Weaving the fabric of science: Dynamic network models of science's unfolding structureSocial Networks, 2015
- The Globus Galaxies platform: delivering science gateways as a serviceConcurrency and Computation: Practice and Experience, 2015
- Harnessing cloud computing with Galaxy CloudNature Biotechnology, 2011
- The iPlant Collaborative: Cyberinfrastructure to Feed the WorldComputer, 2011
- iRODS Primer: Integrated Rule-Oriented Data SystemSynthesis Lectures on Information Concepts, Retrieval, and Services, 2010
- The NCBI dbGaP database of genotypes and phenotypesNature Genetics, 2007
- Special Issue: Science Gateways—Common Community Interfaces to Grid ResourcesConcurrency and Computation: Practice and Experience, 2006