Robust Evaluation of Deep Learning-based Representation Methods for Survival and Gene Essentiality Prediction on Bulk RNA-seq Data
Authors:
Preprint
Abstract
Deep learning (DL) has shown potential to provide powerful representations of bulk RNA-seq data in cancer research. However, there is no consensus regarding the impact of design choices of DL approaches on the performance of the learned representation, including the model architecture, the training methodology and the various hyperparameters. To address this problem, we evaluate the performance of various design choices of DL representation learning methods using TCGA and DepMap pan-cancer datasets, and assess their predictive power for survival and gene essentiality predictions. We demonstrate that non DL-based baseline methods achieve comparable or superior performance compared to more complex models on survival predictions tasks. DL representation methods, however, are the most efficient to predict the gene essentiality of cell lines. We show that auto-encoders (AE) are consistently improved by techniques such as masking and multi-head training. Our results suggest that the impact of DL representations and of pre-training are highly task- and architecture-dependent, highlighting the need for adopting rigorous evaluation guidelines. These guidelines for robust evaluation are implemented in a pipeline made available to the research community.Keywords
All Related Versions
- Published version: Scientific Reports, 14 (1), 1.
This publication has 58 references indexed in Scilit:
- Evaluating Machine Learning Models and Their Diagnostic Value2023
- Molecular subtypes of lung adenocarcinoma patients for prognosis and therapeutic response prediction with machine learning on 13 programmed cell death patternsJournal of Cancer Research and Clinical Oncology, 2023
- Generative pretraining from large-scale transcriptomes for single-cell decipheringiScience, 2023
- Critical assessment of methods of protein structure prediction (CASP)—Round XIVProteins: Structure, Function, and Bioinformatics, 2021
- Miscell: An efficient self-supervised learning approach for dissecting single-cell transcriptomeiScience, 2021
- Prediction and interpretation of cancer survival using graph convolution neural networksMethods, 2021
- An Integrated TCGA Pan-Cancer Clinical Data Resource to Drive High-Quality Survival Outcome AnalyticsCell, 2018
- A Community Challenge for Inferring Genetic Predictors of Gene Essentialities through Analysis of a Functional Screen of Cancer Cell LinesCell Systems, 2017
- MULTIVARIABLE PROGNOSTIC MODELS: ISSUES IN DEVELOPING MODELS, EVALUATING ASSUMPTIONS AND ADEQUACY, AND MEASURING AND REDUCING ERRORSStatistics in Medicine, 1996
- A neural network model for survival dataStatistics in Medicine, 1995