Randomly pivoted Cholesky: Practical approximation of a kernel matrix with few entry evaluations
Authors:
Top Cited Papers
Open Access
- 4 December 2024
- journal article
- research article
- Published by Wiley in Communications on Pure and Applied Mathematics
- Vol. 78 (5) , 995-1041
Abstract
The randomly pivoted Cholesky algorithm (RPCholesky) computes a factorized rank‐ approximation of an positive‐semidefinite (psd) matrix. RPCholesky requires only entry evaluations and additional arithmetic operations, and it can be implemented with just a few lines of code. The method is particularly useful for approximating a kernel matrix. This paper offers a thorough new investigation of the empirical and theoretical behavior of this fundamental algorithm. For matrix approximation problems that arise in scientific machine learning, experiments show that RPCholesky matches or beats the performance of alternative algorithms. Moreover, RPCholesky provably returns low‐rank approximations that are nearly optimal. The simplicity, effectiveness, and robustness of RPCholesky strongly support its use in scientific computing and machine learning applications.Keywords
All Related Versions
Funding Information
- U.S. Department of Energy (DE‐SC0021110)
- Office of Naval Research (N00014‐18‐1‐2363)
- National Science Foundation (1952777)
This publication has 40 references indexed in Scilit:
- Kernel methods are competitive for operator learningJournal of Computational Physics, 2023
- Unsupervised Learning Methods for Molecular Simulation DataChemical Reviews, 2021
- Randomized numerical linear algebra: Foundations and algorithmsActa Numerica, 2020
- High-Dimensional Probability2018
- Time-lagged autoencoders: Deep learning of slow collective variables for molecular kineticsThe Journal of Chemical Physics, 2018
- Quantum chemistry structures and properties of 134 kilo moleculesScientific Data, 2014
- Enumeration of 166 Billion Organic Small Molecules in the Chemical Universe Database GDB-17Journal of Chemical Information and Modeling, 2012
- Determination of reaction coordinates via locally scaled diffusion mapThe Journal of Chemical Physics, 2011
- Matrix Theory2011
- Adaptive Sampling and Fast Low-Rank Matrix Approximation2006