Comparison of methods for the detection of outliers and associated biomarkers in mislabeled omics data
Authors:
Open Access
- 14 August 2020
- journal article
- research article
- Published by Springer Nature in BMC Bioinformatics
- Vol. 21 (1) , 1-23
Abstract
Background: Previous studies have reported that labeling errors are not uncommon in omics data. Potential outliers may severely undermine the correct classification of patients and the identification of reliable biomarkers for a particular disease. Three methods have been proposed to address the problem: sparse label-noise-robust logistic regression (Rlogreg), robust elastic net based on the least trimmed square (enetLTS), and Ensemble. Ensemble is an ensembled classification based on distinct feature selection and modeling strategies. The accuracy of biomarker selection and outlier detection of these methods needs to be evaluated and compared so that the appropriate method can be chosen.Results: The accuracy of variable selection, outlier identification, and prediction of three methods (Ensemble, enetLTS, Rlogreg) were compared for simulated and an RNA-seq dataset. On simulated datasets, Ensemble had the highest variable selection accuracy, as measured by a comprehensive index, and lowest false discovery rate among the three methods. When the sample size was large and the proportion of outliers was ≤5%, the positive selection rate of Ensemble was similar to that of enetLTS. However, when the proportion of outliers was 10% or 15%, Ensemble missed some variables that affected the response variables.Overall, enetLTS had the best outlier detection accuracy with false positive rates< 0.05 and high sensitivity, and enetLTS still performed well when the proportion of outliers was relatively large. With 1% or 2% outliers, Ensemble showed high outlier detection accuracy, but with higher proportions of outliers Ensemble missed many mislabeled samples. Rlogreg and Ensemble were less accurate in identifying outliers than enetLTS. The prediction accuracy of enetLTS was better than that of Rlogreg. Running Ensemble on a subset of data after removing the outliers identified by enetLTS improved the variable selection accuracy of Ensemble.Conclusions: When the proportion of outliers is ≤5%, Ensemble can be used for variable selection. When the proportion of outliers is > 5%, Ensemble can be used for variable selection on a subset after removing outliers identified by enetLTS. For outlier identification, enetLTS is the recommended method. In practice, the proportion of outliers can be estimated according to the inaccuracy of the diagnostic methods used.Keywords
Funding Information
- Excellent Young Scientists Fund (81502891)
- National Natural Science Foundation of China (81473073, 81872715)
This publication has 50 references indexed in Scilit:
- A fatty acid‐binding protein 7/RXRβ pathway enhances survival and proliferation in triple‐negative breast cancerThe Journal of Pathology, 2012
- On the C‐statistics for evaluating overall adequacy of risk prediction procedures with censored survival dataStatistics in Medicine, 2011
- American Society of Clinical Oncology/College of American Pathologists Guideline Recommendations for Immunohistochemical Testing of Estrogen and Progesterone Receptors in Breast CancerJournal of Oncology Practice, 2010
- Methods for labeling error detection in microarrays based on the effect of data perturbation on the regression modelBioinformatics, 2009
- Loci at chromosomes 13, 19 and 20 influence age at natural menopauseNature Genetics, 2009
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Classification and diagnostic prediction of pediatric cancers using gene expression profiling and artificial neural networks2002
- Masking unmaskedBiometrika, 1986
- The Collinearity Problem in Linear Regression. The Partial Least Squares (PLS) Approach to Generalized InversesSIAM Journal on Scientific and Statistical Computing, 1984
- The complete sequence of human preprocalcitoninFEBS Letters, 1984