GenPipes: an open-source framework for distributed and scalable genomic analyses
Authors:
- Mathieu BourgeyMBMathieu Bourgey
- Rola DaliRDRola Dali
- Robert EveleighRERobert Eveleigh
- Kuang Chung ChenKCKuang Chung Chen
- Louis LetourneauLLLouis Letourneau
- Joel FillonJFJoel Fillon
- Marc MichaudMMMarc Michaud
- Maxime CaronMCMaxime Caron
- Johanna SandovalJSJohanna Sandoval
- Francois LefebvreFLFrancois Lefebvre
- Gary LevequeGLGary Leveque
- Eloi MercierEMEloi Mercier
Preprint
Abstract
With the decreasing cost of sequencing and the rapid developments in genomics technologies and protocols, the need for validated bioinformatics software that enables efficient large-scale data processing is growing. Here we present GenPipes, a flexible Python-based framework that facilitates the development and deployment of multi-step workflows optimized for High Performance Computing clusters and the cloud. GenPipes already implements 12 validated and scalable pipelines for various genomics applications, including RNA-Seq, ChIP-Seq, DNA-Seq, Methyl-Seq, Hi-C, capture Hi-C, metagenomics and PacBio long read assembly. The software is available under a GPLv3 open source license and is continuously updated to follow recent advances in genomics and bioinformatics. The framework has been already configured on several servers and a docker image is also available to facilitate additional installations. In summary, GenPipes offers genomic researchers a simple method to analyze different types of data, customizable to their needs and resources, as well as the flexibility to create their own workflows.Keywords
All Related Versions
- Published version: GigaScience, 8 (6).
This publication has 71 references indexed in Scilit:
- Nextflow enables reproducible computational workflowsNature Biotechnology, 2017
- The International Human Epigenome Consortium: A Blueprint for Scientific Collaboration and DiscoveryCell, 2016
- eFORGE: A Tool for Identifying Cell Type-Specific Signal in Epigenomic DataCell Reports, 2016
- The Galaxy platform for accessible, reproducible and collaborative biomedical analyses: 2016 updateNucleic Acids Research, 2016
- BigDataScript: a scripting language for data pipelinesBioinformatics, 2014
- Snakemake—a scalable bioinformatics workflow engineBioinformatics, 2012
- Bpipe: a tool for running and managing bioinformatics pipelinesBioinformatics, 2012
- CernVM – a virtual software appliance for LHC applicationsJournal of Physics: Conference Series, 2010
- The $1,000 genome, the $100,000 analysis?Genome Medicine, 2010
- The ENCODE (ENCyclopedia Of DNA Elements) ProjectScience, 2004