BioPreDyn-bench: a suite of benchmark problems for dynamic modelling in systems biology
Authors:
- Alejandro F VillaverdeAlejandro F Villaverde
- David HenriquesDHDavid Henriques
- Kieran SmallboneKSKieran Smallbone
- Sophia BongardSBSophia Bongard
- Joachim SchmidJSJoachim Schmid
- Damjan Cicin-SainDCDamjan Cicin-Sain
- Anton CrombachACAnton Crombach
- Julio Saez-RodriguezJSJulio Saez-Rodriguez
- Klaus MauchKMKlaus Mauch
- Eva Balsa-CantoEBEva Balsa-Canto
- Pedro MendesPMPedro Mendes
- Johannes JaegerJJJohannes Jaeger
Open Access
- 20 February 2015
- journal article
- research article
- Published by Springer Nature in BMC Systems Biology
- Vol. 9 (1) , 8
Abstract
Dynamic modelling is one of the cornerstones of systems biology. Many research efforts are currently being invested in the development and exploitation of large-scale kinetic models. The associated problems of parameter estimation (model calibration) and optimal experimental design are particularly challenging. The community has already developed many methods and software packages which aim to facilitate these tasks. However, there is a lack of suitable benchmark problems which allow a fair and systematic evaluation and comparison of these contributions. Here we present BioPreDyn-bench, a set of challenging parameter estimation problems which aspire to serve as reference test cases in this area. This set comprises six problems including medium and large-scale kinetic models of the bacterium E. coli, baker’s yeast S. cerevisiae, the vinegar fly D. melanogaster, Chinese Hamster Ovary cells, and a generic signal transduction network. The level of description includes metabolism, transcription, signal transduction, and development. For each problem we provide (i) a basic description and formulation, (ii) implementations ready-to-run in several formats, (iii) computational results obtained with specific solvers, (iv) a basic analysis and interpretation. This suite of benchmark problems can be readily used to evaluate and compare parameter estimation methods. Further, it can also be used to build test problems for sensitivity and identifiability analysis, model reduction and optimal experimental design methods. The suite, including codes and documentation, can be freely downloaded from the BioPreDyn-bench website, https://sites.google.com/site/biopredynbenchmarks/ .Keywords
All Related Versions
This publication has 64 references indexed in Scilit:
- GenSSI: a software toolbox for structural identifiability analysis of biological modelsBioinformatics, 2011
- AMIGO, a toolbox for advanced model identification in systems biology using global optimizationBioinformatics, 2011
- Bacterial adaptation through distributed sensing of metabolic fluxesMolecular Systems Biology, 2010
- Benchmarking regulatory network reconstruction with GRENDELBioinformatics, 2009
- Benchmarks for identification of ordinary differential equations from time series dataBioinformatics, 2009
- Insights into the behaviour of systems biology models from dynamic sensitivity and identifiability analysis: a case study of an NF-κB signalling pathwayMolecular BioSystems, 2006
- COPASI—a COmplex PAthway SImulatorBioinformatics, 2006
- Production of recombinant protein therapeutics in cultivated mammalian cellsNature Biotechnology, 2004
- Dynamic control of positional information in the early Drosophila embryoNature, 2004
- The systems biology markup language (SBML): a medium for representation and exchange of biochemical network modelsBioinformatics, 2003