Linear-Scaling Kernels for Protein Sequences and Small Molecules Outperform Deep Learning While Providing Uncertainty Quantitation and Improved Interpretability
Authors:
- Jonathan ParkinsonJPJonathan Parkinson
- Wei WangWWWei Wang
- 27 July 2023
- journal article
- research article
- Published by American Chemical Society (ACS) in Journal of Chemical Information and Modeling
- Vol. 63 (15) , 4589-4601
Abstract
Gaussian process (GP) is a Bayesian model which provides several advantages for regression tasks in machine learning such as reliable quantitation of uncertainty and improved interpretability. Their adoption has been precluded by their excessive computational cost and by the difficulty in adapting them for analyzing sequences (e.g., amino acid sequences) and graphs (e.g., small molecules). In this study, we introduce a group of random feature-approximated kernels for sequences and graphs that exhibit linear scaling with both the size of the training set and the size of the sequences or graphs. We incorporate these new kernels into our new Python library for GP regression, xGPR, and develop an efficient and scalable algorithm for fitting GPs equipped with these kernels to large datasets. We compare the performance of xGPR on 17 different benchmarks with both standard and state-of-the-art deep learning models and find that GP regression achieves highly competitive accuracy for these tasks while providing with well-calibrated uncertainty quantitation and improved interpretability. Finally, in a simple experiment, we illustrate how xGPR may be used as part of an active learning strategy to engineer a protein with a desired property in an automated way without human intervention.Keywords
All Related Versions
Funding Information
- National Institutes of Health (R21A158114)
This publication has 32 references indexed in Scilit:
- Protein Engineering: Past, Present, and Future2017
- Global analysis of protein folding using massively parallel design, synthesis, and testingScience, 2017
- Communication: Understanding molecular representations in machine learning: The role of uniqueness and target similarityThe Journal of Chemical Physics, 2016
- Adaptation in protein fitness landscapes is facilitated by indirect pathseLife, 2016
- Local fitness landscape of the green fluorescent proteinNature, 2016
- Quantum chemistry structures and properties of 134 kilo moleculesScientific Data, 2014
- On representing chemical environmentsPhysical Review B, 2013
- Navigating the protein fitness landscape with Gaussian processesProceedings of the National Academy of Sciences, 2012
- Efficient Kernel Clustering Using Random Fourier Features2012
- Unified Matrix Treatment of the Fast Walsh-Hadamard TransformIEEE Transactions on Computers, 1976