Galaxy CloudMan: delivering cloud compute clusters
Open Access
- 21 December 2010
- journal article
- Published by Springer Nature in BMC Bioinformatics
- Vol. 11 (S12) , S4
Abstract
Background: Widespread adoption of high-throughput sequencing has greatly increased the scale and sophistication of computational infrastructure needed to perform genomic research. An alternative to building and maintaining local infrastructure is “cloud computing”, which, in principle, offers on demand access to flexible computational infrastructure. However, cloud computing resources are not yet suitable for immediate “as is” use by experimental biologists. Results: We present a cloud resource management system that makes it possible for individual researchers to compose and control an arbitrarily sized compute cluster on Amazon’s EC2 cloud infrastructure without any informatics requirements. Within this system, an entire suite of biological tools packaged by the NERC Bio-Linux team (http://nebc.nerc.ac.uk/tools/bio-linux) is available for immediate consumption. The provided solution makes it possible, using only a web browser, to create a completely configured compute cluster ready to perform analysis in less than five minutes. Moreover, we provide an automated method for building custom deployments of cloud resources. This approach promotes reproducibility of results and, if desired, allows individuals and labs to add or customize an otherwise available cloud system to better meet their needs. Conclusions: The expected knowledge and associated effort with deploying a compute cluster in the Amazon EC2 cloud is not trivial. The solution presented in this paper eliminates these barriers, making it possible for researchers to deploy exactly the amount of computing power they need, combined with a wealth of existing analysis software, to handle the ongoing data deluge.Keywords
This publication has 10 references indexed in Scilit:
- Galaxy CloudMan: delivering cloud compute clustersBMC Bioinformatics, 2010
- Cloud computing and the DNA data raceNature Biotechnology, 2010
- Cloud computing for comparative genomicsBMC Bioinformatics, 2010
- Searching for SNPs with cloud computingGenome Biology, 2009
- The Sequence Alignment/Map format and SAMtoolsBioinformatics, 2009
- Fast and accurate short read alignment with Burrows–Wheeler transformBioinformatics, 2009
- CloudBurst: highly sensitive read mapping with MapReduceBioinformatics, 2009
- Ultrafast and memory-efficient alignment of short DNA sequences to the human genomeGenome Biology, 2009
- Using Galaxy to Perform Large‐Scale Interactive Data AnalysesCurrent Protocols in Bioinformatics, 2007
- Open software for biologists: from famine to feastNature Biotechnology, 2006