ProteoBench: the community-curated platform for comparing proteomics data analysis workflows
Authors:
- Robbe DevreeseRDRobbe Devreese
- Caroline JachmannCJCaroline Jachmann
- Bart Van PuyveldeBPBart Van Puyvelde
- Holda A. Anagho-MattanovichHAHolda A. Anagho-Mattanovich
- Witold E. WolskiWWWitold E. Wolski
- Henry WebelHWHenry Webel
- Matthias Anagho-MattanovichMAMatthias Anagho-Mattanovich
- Wout BittremieuxWBWout Bittremieux
- Karima ChaouiKCKarima Chaoui
- Cristina ChivaCCCristina Chiva
- Tine ClaeysTCTine Claeys
- Hector Mauricio Castaneda CortesHCHector Mauricio Castaneda Cortes
Preprint
Abstract
Mass spectrometry (MS)-based proteomics is a well-established strategy for analyzing complex biological mixtures. Many MS instruments and data acquisition strategies are available, and the data they acquire differ substantially, thus requiring tailored analysis algorithms. Hence, many dedicated bioinformatics workflows are developed. These are in constant evolution, and the community lacks a centralized platform for comparing their performance. Here, we propose ProteoBench, a single platform that brings together software developers and software users to provide an ever-evolving comparison of state-of-the-art proteomics data processing tools. ProteoBench is an open-source resource that enables the community to evaluate data analysis workflows, develop benchmarking modules dedicated to specific comparisons, and discuss the best methods to compare software tools. The platform ensures that the benchmark evolves alongside advances in proteomics data analysis workflows. ProteoBench guides researchers towards the best-suited tool and parameters for their specific project and data according to their needs, and developers can test their newly developed tools or workflows privately, before adding them as public references. This community-driven effort will increase transparency and reproducibility between MS data analysis workflows, as well as facilitate the development and publication of software workflows in the field.Keywords
This publication has 32 references indexed in Scilit:
- Updates to the CASP Infrastructure in 2024Proteins: Structure, Function, and Bioinformatics, 2025
- Deep Learning Methods for De Novo Peptide SequencingMass Spectrometry Reviews, 2024
- Sage: An Open-Source Tool for Fast Proteomics Searching and Quantification at ScaleJournal of Proteome Research, 2023
- Protein Contaminants Matter: Building Universal Protein Contaminant Libraries for DDA and DIA ProteomicsJournal of Proteome Research, 2022
- Dataset containing physiological amounts of spike-in proteins into murine C2C12 background as a ground truth quantitative LC-MS/MS referenceData in Brief, 2022
- Proteomics Standards Initiative’s ProForma 2.0: Unifying the Encoding of Proteoforms and PeptidoformsJournal of Proteome Research, 2022
- Extensive and Accurate Benchmarking of DIA Acquisition Methods and Software Tools Using a Complex Proteomic StandardJournal of Proteome Research, 2021
- A Case Study on the Comparison of Different Software Tools for Automated Quantification of Peptides2011
- An evaluation, comparison, and accurate benchmarking of several publicly available MS/MS search algorithms: Sensitivity and specificity analysisProteomics, 2005
- A decade of CASP: progress, bottlenecks and prognosis in protein structure predictionCurrent Opinion in Structural Biology, 2005