GeneSPIDER – gene regulatory network inference benchmarking with controlled network and data properties
- 25 April 2017
- journal article
- research article
- Published by Oxford University Press (OUP) in Molecular BioSystems
- Vol. 13 (7) , 1304-1312
Abstract
A key question in network inference, that has not been properly answered, is what accuracy can be expected for a given biological dataset and inference method. We present GeneSPIDER – a Matlab package for tuning, running, and evaluating inference algorithms that allows independent control of network and data properties to enable data-driven benchmarking. GeneSPIDER is uniquely suited to address this question by first extracting salient properties from the experimental data and then generating simulated networks and data that closely match these properties. It enables data-driven algorithm selection, estimation of inference accuracy from biological data, and a more multifaceted benchmarking. Included are generic pipelines for the design of perturbation experiments, bootstrapping, analysis of linear dependence, sample selection, scaling of SNR, and performance evaluation. With GeneSPIDER we aim to move the goal of network inference benchmarks from simple performance measurement to a deeper understanding of how the accuracy of an algorithm is determined by different combinations of network and data properties.Keywords
This publication has 29 references indexed in Scilit:
- RegulonDB v8.0: omics data sets, evolutionary conservation, regulatory phrases, cross-validated gold standards and moreNucleic Acids Research, 2012
- Wisdom of crowds for robust gene network inferenceNature Methods, 2012
- How to infer gene networks from expression profiles, revisitedInterface Focus, 2011
- GeneNetWeaver:in silicobenchmark generation and performance profiling of network inference methodsBioinformatics, 2011
- Methods for Generating Complex Networks with Selected Structural Properties for Simulations: A Review and Tutorial for NeuroscientistsFrontiers in Computational Neuroscience, 2011
- GeNGe: systematic generation of gene regulatory networksBioinformatics, 2009
- Reverse Engineering of Gene Regulatory Networks: A Comparative StudyEURASIP Journal on Bioinformatics and Systems Biology, 2009
- How to infer gene networks from expression profilesMolecular Systems Biology, 2007
- ARACNE: An Algorithm for the Reconstruction of Gene Regulatory Networks in a Mammalian Cellular ContextBMC Bioinformatics, 2006
- Statistical mechanics of complex networksReviews of Modern Physics, 2002