Neural networks outperform expert humans in predicting patient impressions of symptomatic improvement following overactive bladder treatment
- 26 July 2022
- journal article
- research article
- Published by Springer Nature in International Urogynecology Journal
- Vol. 34 (5) , 1009-1016
Abstract
Introduction and hypothesis The objective was to accurately predict patient-centered subjective outcomes following the overactive bladder (OAB) treatments OnabotulinumtoxinA (OBTX-A) injection and sacral neuromodulation (SNM) using a neural network-based machine-learning approach. In the context of treatments designed to improve quality of life, a patient’s perception of improvement should be the gold standard outcome measure. Methods Cutting-edge neural network-based algorithms using reproducing kernel techniques were trained to predict patient-reported improvements in urinary leakage and bladder function as assessed by Patient Global Impression of Improvement score using the ROSETTA trial datasets. Blinded expert urologists provided with the same variables also predicted outcomes. Receiver operating characteristic curves and areas under the curve were generated for algorithm and human expert predictions in an out-of-sample holdout dataset. Results Algorithms demonstrated excellent accuracy in predicting patient subjective improvement in urinary leakage (OBTX-A: AUC 0.75; SNM: 0.80). Similarly, algorithms accurately predicted patient subjective improvement in bladder function (OBTX-A: AUC 0.86; SNM: 0.96). The top-performing algorithms outcompeted human experts across outcome measures. Conclusions Novel neural network-based machine-learning algorithms accurately predicted OBTX-A and SNM patient subjective outcomes, and generally outcompeted expert humans. Subtle aspects of the physician–patient interaction remain uncomputable, and thus the machine-learning approach may serve as an aid, rather than as an alternative, to human interaction and clinical judgment.Keywords
This publication has 17 references indexed in Scilit:
- OnabotulinumtoxinA vs Sacral Neuromodulation on Refractory Urgency Urinary Incontinence in WomenJAMA, 2016
- The Refractory Overactive Bladder: Sacral NEuromodulation vs. BoTulinum Toxin Assessment: ROSETTA trialContemporary Clinical Trials, 2014
- Article Commentary: Patient-Reported Outcomes (PROs) and Patient-Reported Outcome Measures (PROMs)Health Services Insights, 2013
- Diagnosis and Treatment of Overactive Bladder (Non-Neurogenic) in Adults: AUA/SUFU GuidelineJournal of Urology, 2012
- Validation of the Patient Global Impression scales for use in detrusor overactivity: secondary analysis of the RELAX studyBJOG: An International Journal of Obstetrics & Gynaecology, 2012
- Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidanceHealth and Quality of Life Outcomes, 2006
- What You See May Not Be What You Get: A Brief, Nontechnical Introduction to Overfitting in Regression-Type ModelsPsychosomatic Medicine, 2004
- Validation of two global impression questionnaires for incontinenceAmerican Journal of Obstetrics and Gynecology, 2003
- How widespread are the symptoms of an overactive bladder and how are they managed? A population‐based prevalence studyBJU International, 2001
- Overactive bladder significantly affects quality of life.2000