Benchmarking computational methods for multi-omics biomarker discovery in cancer
Preprint
Abstract
Multi-omics profiling characterizes cancer biology and supports biomarker discovery for prognosis and therapy selection. Although numerous computational multi-omics biomarker identification methods have been proposed, their ability to identify clinically relevant biomarkers has not been systematically evaluated, leaving it unclear whether the resulting biomarker nominations are reliable for downstream validation. Here we systematically benchmark 20 representative statistical, machine learning and deep learning methods using curated gold-standard prognostic and therapeutic biomarkers across five real-world datasets. We evaluate performance in terms of both biomarker identification accuracy and stability. Overall, DeePathNet and Deep-KEGG achieve the best performance. Across methods, effective biomarker recovery is associated with the integration of biological knowledge, global feature interactions, multivariate feature attribution, and effective regularization. Analysis of omics type contributions reveals method- and modality-specific biases, highlighting the importance of broader omics integration. We further evaluate methods on simulated datasets to probe sensitivity with controlled signal and noise. By aggregating results from top-performing methods, we construct consensus biomarker panels that nominate candidates for potential investigations. Finally, we provide user-friendly interfaces to allow researchers to benchmark new methods against the 20 baselines or apply selected methods for biomarker identification on custom multi-omics datasets. Our benchmark is publicly available at https://github.com/athanzli/CancerMOBI-Bench .Keywords
All Related Versions
- Published version: Briefings in Bioinformatics, 27 (3).
This publication has 65 references indexed in Scilit:
- Benchmarking feature selection and feature extraction methods to improve the performances of machine-learning algorithms for patient classification using metabolomics biomedical dataComputational and Structural Biotechnology Journal, 2024
- Stable feature selection utilizing Graph Convolutional Neural Network and Layer-wise Relevance Propagation for biomarker discovery in breast cancerArtificial Intelligence in Medicine, 2024
- Integration of multi-omics data using adaptive graph learning and attention mechanism for patient classification and biomarker identificationComputers in Biology and Medicine, 2023
- Critical Assessment of the Biomarker Discovery and Classification Methods for Multiclass MetabolomicsAnalytical Chemistry, 2023
- Biomarker discovery by feature ranking: Evaluation on a case study of embryonal tumorsComputers in Biology and Medicine, 2021
- TP53 Mutations and Outcomes in Breast Cancer: Reading beyond the HeadlinesTrends in Cancer, 2020
- Standards and Guidelines for the Interpretation and Reporting of Sequence Variants in CancerThe Journal of Molecular Diagnostics, 2017
- InterSIM: Simulation tool for multiple integrative ‘omic datasets’Computer Methods and Programs in Biomedicine, 2016
- Multiplatform Analysis of 12 Cancer Types Reveals Molecular Classification within and across Tissues of OriginCell, 2014
- Cancer-associated IDH1 mutations produce 2-hydroxyglutarateNature, 2009