Hadoop-BAM: directly manipulating next generation sequencing data in the cloud
Open Access
- 2 February 2012
- journal article
- research article
- Published by Oxford University Press (OUP) in Bioinformatics
- Vol. 28 (6) , 876-877
Abstract
Summary: Hadoop-BAM is a novel library for the scalable manipulation of aligned next-generation sequencing data in the Hadoop distributed computing framework. It acts as an integration layer between analysis applications and BAM files that are processed using Hadoop. Hadoop-BAM solves the issues related to BAM data access by presenting a convenient API for implementing map and reduce functions that can directly operate on BAM records. It builds on top of the Picard SAM JDK, so tools that rely on the Picard API are expected to be easily convertible to support large-scale distributed processing. In this article we demonstrate the use of Hadoop-BAM by building a coverage summarizing tool for the Chipster genome browser. Our results show that Hadoop offers good scalability, and one should avoid moving data in and out of Hadoop between analysis steps. Availability: Available under the open-source MIT license at http://sourceforge.net/projects/hadoop-bam/ Contact:matti.niemenmaa@aalto.fi Supplementary information: Supplementary material is available at Bioinformatics online.Keywords
This publication has 8 references indexed in Scilit:
- Chipster: user-friendly analysis software for microarray and other high-throughput dataBMC Genomics, 2011
- SEAL: a distributed short read mapping and duplicate removal toolBioinformatics, 2011
- SeqWare Query Engine: storing and searching sequence data in the cloudBMC Bioinformatics, 2010
- An overview of the Hadoop/MapReduce/HBase framework and its current applications in bioinformaticsBMC Bioinformatics, 2010
- The Genome Analysis Toolkit: A MapReduce framework for analyzing next-generation DNA sequencing dataGenome Research, 2010
- Hive - a petabyte scale data warehouse using Hadoop2010
- The Sequence Alignment/Map format and SAMtoolsBioinformatics, 2009
- MapReduceCommunications of the ACM, 2008