PCM-SABRE: a platform for benchmarking and comparing outcome prediction methods in precision cancer medicine
Open Access
- 17 January 2017
- journal article
- software
- Published by Springer Nature in BMC Bioinformatics
- Vol. 18 (1) , 1-7
Abstract
Numerous publications attempt to predict cancer survival outcome from gene expression data using machine-learning methods. A direct comparison of these works is challenging for the following reasons: (1) inconsistent measures used to evaluate the performance of different models, and (2) incomplete specification of critical stages in the process of knowledge discovery. There is a need for a platform that would allow researchers to replicate previous works and to test the impact of changes in the knowledge discovery process on the accuracy of the induced models. We developed the PCM-SABRE platform, which supports the entire knowledge discovery process for cancer outcome analysis. PCM-SABRE was developed using KNIME. By using PCM-SABRE to reproduce the results of previously published works on breast cancer survival, we define a baseline for evaluating future attempts to predict cancer outcome with machine learning. We used PCM-SABRE to replicate previous work that describe predictive models of breast cancer recurrence, and tested the performance of all possible combinations of feature selection methods and data mining algorithms that was used in either of the works. We reconstructed the work of Chou et al. observing similar trends – superior performance of Probabilistic Neural Network (PNN) and logistic regression (LR) algorithms and inconclusive impact of feature pre-selection with the decision tree algorithm on subsequent analysis. PCM-SABRE is a software tool that provides an intuitive environment for rapid development of predictive models in cancer precision medicine.Keywords
Funding Information
- Israeli Science Foundation (304/12)
- Israel Cancer Association (20150913)
- Ministry of Science and Technology, Israel (IL) (0000000)
- The Paul Ivanier Center for Production Management, Ben-Gurion University of the Negev
This publication has 9 references indexed in Scilit:
- Prospective Validation of a 21-Gene Expression Assay in Breast CancerNew England Journal of Medicine, 2015
- Primary breast cancer: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-upAnnals of Oncology, 2015
- Gene expression profiling of breast cancer survivability by pooled cDNA microarray analysis using logistic regression, artificial neural networks and decision treesBMC Bioinformatics, 2013
- Mojo Hand, a TALEN design tool for genome editing applicationsBMC Bioinformatics, 2013
- Development of 95-gene classifier as a powerful predictor of recurrences in node-negative and ER-positive breast cancer patientsBreast Cancer Research and Treatment, 2010
- An online survival analysis tool to rapidly assess the effect of 22,277 genes on breast cancer prognosis using microarray data of 1,809 patientsBreast Cancer Research and Treatment, 2009
- KNIME: The Konstanz Information Miner2008
- Analytical Validation of the Oncotype DX Genomic Diagnostic Test for Recurrence Prognosis and Therapeutic Response Prediction in Node-Negative, Estrogen Receptor–Positive Breast CancerClinical Chemistry, 2007
- On a Test of Whether one of Two Random Variables is Stochastically Larger than the OtherThe Annals of Mathematical Statistics, 1947