Toward a gold standard for promoter prediction evaluation
Open Access
- 27 May 2009
- journal article
- research article
- Published by Oxford University Press (OUP) in Bioinformatics
- Vol. 25 (12) , i313-i320
Abstract
Motivation: Promoter prediction is an important task in genome annotation projects, and during the past years many new promoter prediction programs (PPPs) have emerged. However, many of these programs are compared inadequately to other programs. In most cases, only a small portion of the genome is used to evaluate the program, which is not a realistic setting for whole genome annotation projects. In addition, a common evaluation design to properly compare PPPs is still lacking. Results: We present a large-scale benchmarking study of 17 state-of-the-art PPPs. A multi-faceted evaluation strategy is proposed that can be used as a gold standard for promoter prediction evaluation, allowing authors of promoter prediction software to compare their method to existing methods in a proper way. This evaluation strategy is subsequently used to compare the chosen promoter predictors, and an in-depth analysis on predictive performance, promoter class specificity, overlap between predictors and positional bias of the predictions is conducted. Availability: We provide the implementations of the four protocols, as well as the datasets required to perform the benchmarks to the academic community free of charge on request. Contact: yves.vandepeer@psb.ugent.be Supplementary information: Supplementary data are available at Bioinformatics online.Keywords
This publication has 25 references indexed in Scilit:
- ProSOM: core promoter prediction based on unsupervised clustering of DNA physical profilesBioinformatics, 2008
- Generic eukaryotic core promoter prediction using structural features of DNAGenome Research, 2007
- DBTSS: database of transcription start sites, progress report 2008Nucleic Acids Research, 2007
- Mammalian RNA polymerase II core promoters: insights from genome-wide studiesNature Reviews Genetics, 2007
- A mammalian promoter model links cis elements to genetic networksBiochemical and Biophysical Research Communications, 2006
- Dragon Promoter Finder: recognition of vertebrate RNA polymerase II promotersBioinformatics, 2002
- STOCHASTIC SEGMENT MODELS OF EUKARYOTIC PROMOTER REGIONS1999
- Promoter2.0: for the recognition of PolII promoter sequences.Bioinformatics, 1999
- Eukaryotic Promoter RecognitionGenome Research, 1997
- Predicting Pol II Promoter Sequences using Transcription Factor Binding SitesJournal of Molecular Biology, 1995