On Using Samples of Known Protein Content to Assess the Statistical Calibration of Scores Assigned to Peptide-Spectrum Matches in Shotgun Proteomics
Authors:
- 10 March 2011
- journal article
- research article
- Published by American Chemical Society (ACS) in Journal of Proteome Research
- Vol. 10 (5) , 2671-2678
Abstract
In shotgun proteomics, the quality of a hypothesized match between an observed spectrum and a peptide sequence is quantified by a score function. Because the score function lies at the heart of any peptide identification pipeline, this function greatly affects the final results of a proteomics assay. Consequently, valid statistical methods for assessing the quality of a given score function are extremely important. Previously, several research groups have used samples of known protein composition to assess the quality of a given score function. We demonstrate that this approach is problematic, because the outcome can depend on factors other than the score function itself. We then propose an alternative use of the same type of data to validate a score function. The central idea of our approach is that database matches that are not explained by any protein in the purified sample comprise a robust representation of incorrect matches. We apply our alternative assessment scheme to several commonly used score functions, and we show that our approach generates a reproducible measure of the calibration of a given peptide identification method. Furthermore, we show how our quality test can be useful in the development of novel score functions.Keywords
This publication has 22 references indexed in Scilit:
- The Generating Function of CID, ETD, and CID/ETD Pairs of Tandem Mass Spectra: Applications to Database SearchMolecular & Cellular Proteomics, 2010
- Repeatability and Reproducibility in Proteomic Identifications by Liquid Chromatography−Tandem Mass SpectrometryJournal of Proteome Research, 2009
- False Discovery Rates of Protein Identifications: A Strike against the Two-Peptide RuleJournal of Proteome Research, 2009
- A HUPO test sample study reveals common problems in mass spectrometry–based proteomicsNature Methods, 2009
- Rapid and Accurate Peptide Identification from Tandem Mass SpectraJournal of Proteome Research, 2008
- The Standard Protein Mix Database: A Diverse Data Set To Assist in the Production of Improved Peptide and Protein Identification Software ToolsJournal of Proteome Research, 2007
- Prediction of Error Associated with False-Positive Rate Determination for Peptide Identification in Large-Scale Proteomics Experiments Using a Combined Reverse and Forward Peptide Sequence Database StrategyJournal of Proteome Research, 2006
- A uniform proteomics MS/MS analysis platform utilizing open XML file formatsMolecular Systems Biology, 2005
- Empirical Statistical Model To Estimate the Accuracy of Peptide Identifications Made by MS/MS and Database SearchAnalytical Chemistry, 2002
- An approach to correlate tandem mass spectral data of peptides with amino acid sequences in a protein databaseJournal of the American Society for Mass Spectrometry, 1994