Joel A. Tropp
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Joel A. Tropp has a total of 92 co-authors. Here are the top co-authors by number of shared publications:
- Madeleine Udell
Department of Management Science and Engineering Stanford University CA United States
8 shared publications - Robert Wendell Heath
Department of Electrical and Computer Engineering, University of California, San Diego, La Jolla, CA, USA
7 shared publications - Holger Rauhut
Dept. of Mathematics LMU Munich Germany
5 shared publications Anna C. Gilbert
4 shared publications- Ethan N. Epperly
Department of Computing and Mathematical Sciences, California Institute of Technology, Pasadena, CA 91125 USA
4 shared publications Inderjit S. Dhillon
4 shared publications
Latest Publications
- Open Access
- 13 July 2026
- Published by Society for Industrial & Applied Mathematics (SIAM)
- p. 129-149
Applied Random Matrix Theory
Continuing the legacy of the International Congress of Mathematicians, these proceedings bring together presentations delivered by invited speakers at the 2026 Congress held in Philadelphia. Publis... Continuing the legacy of the International Congress of Mathematicians, these proceedings bring together presentations delivered by invited speakers at the 2026 Congress held in Philadelphia. Publis...
- 13 July 2026
- Published by Society for Industrial & Applied Mathematics (SIAM)
- p. 129-149
Open AccessApplied Random Matrix Theory
Continuing the legacy of the International Congress of Mathematicians, these proceedings bring together presentations delivered by invited speakers at the 2026 Congress held in Philadelphia. Publis... Continuing the legacy of the International Congress of Mathematicians, these proceedings bring together presentations delivered by invited speakers at the 2026 Congress held in Philadelphia. Publis...
- Top Cited PapersOpen Access
- 10 March 2026
- Published by Verein zur Forderung des Open Access Publizierens in den Quantenwissenschaften in Quantum
- Vol. 10, 2022
Successive randomized compression: A randomized algorithm for the compressed MPO-MPS product
Tensor networks like matrix product states (MPSs) and matrix product operators (MPOs) are powerful tools for representing exponentially large states and operators, with applications in quantum many-body physics, machine learning, numerical analysis, and other areas. In these applications, computing a compressed representation of the MPO-MPS product is a fundamental computational primitive. For this operation, this paper introduces a new single-pass, randomized algorithm, called successive randomized compression (SRC), that improves on existing approaches in speed or in accuracy. The performance of the new algorithm is evaluated on synthetic problems and unitary time evolution problems for quantum spin systems.
- 10 March 2026
- Published by Verein zur Forderung des Open Access Publizierens in den Quantenwissenschaften in Quantum
- Vol. 10, 2022
Top Cited PapersOpen AccessSuccessive randomized compression: A randomized algorithm for the compressed MPO-MPS product
Tensor networks like matrix product states (MPSs) and matrix product operators (MPOs) are powerful tools for representing exponentially large states and operators, with applications in quantum many-body physics, machine learning, numerical analysis, and other areas. In these applications, computing a compressed representation of the MPO-MPS product is a fundamental computational primitive. For this operation, this paper introduces a new single-pass, randomized algorithm, called successive randomized compression (SRC), that improves on existing approaches in speed or in accuracy. The performance of the new algorithm is evaluated on synthetic problems and unitary time evolution problems for quantum spin systems.
- Top Cited Papers
- 1 March 2026
- Published by Annals of Mathematics in Annals of Mathematics
- Vol. 203 (2) , 555-602
A new approach to strong convergence
A family of random matrices $\boldsymbol{X}^N=(X_1^N,\ldots,X_d^N)$ is said to converge strongly to a family of bounded operators $\boldsymbol{x}=(x_1,\ldots,x_d)$ when $\|P(\boldsymbol{X}^N,\boldsymbol{X}^{N*})\|\to\|P(\boldsymbol{x}, \boldsymbol{x}^*)\|$ for every noncommutative polynomial $P$. This phenomenon plays a key role in several recent breakthroughs on random graphs, geometry, and operator algebras. However, proofs of strong convergence are notoriously delicate and have relied largely on problem-specific methods. In this paper, we develop a new approach to strong convergence that uses only soft arguments. Our method exploits the fact that for many natural models, the expected trace of $P(\boldsymbol{X}^N,\boldsymbol{X}^{N*})$ is a rational function of $\frac{1}{N}$ whose lowest order asymptotics are easily understood. We develop a general technique to deduce strong convergence directly from these inputs using the inequality of A. and V. Markov for univariate polynomials and elementary Fourier analysis. To illustrate the method, we develop the following applications: 1. We give a short proof of the result of Friedman that random regular graphs have a near-optimal spectral gap and obtain a sharp understanding of the large deviations probabilities of the second eigenvalue. 2. We prove a strong quantitative form of the strong convergence property of random permutation matrices due to Bordenave and Collins. 3. We extend the above to any stable representation of the symmetric group, providing many new examples of the strong convergence phenomenon.- 1 March 2026
- Published by Annals of Mathematics in Annals of Mathematics
- Vol. 203 (2) , 555-602
Top Cited PapersA new approach to strong convergence
A family of random matrices $\boldsymbol{X}^N=(X_1^N,\ldots,X_d^N)$ is said to converge strongly to a family of bounded operators $\boldsymbol{x}=(x_1,\ldots,x_d)$ when $\|P(\boldsymbol{X}^N,\boldsymbol{X}^{N*})\|\to\|P(\boldsymbol{x}, \boldsymbol{x}^*)\|$ for every noncommutative polynomial $P$. This phenomenon plays a key role in several recent breakthroughs on random graphs, geometry, and operator algebras. However, proofs of strong convergence are notoriously delicate and have relied largely on problem-specific methods. In this paper, we develop a new approach to strong convergence that uses only soft arguments. Our method exploits the fact that for many natural models, the expected trace of $P(\boldsymbol{X}^N,\boldsymbol{X}^{N*})$ is a rational function of $\frac{1}{N}$ whose lowest order asymptotics are easily understood. We develop a general technique to deduce strong convergence directly from these inputs using the inequality of A. and V. Markov for univariate polynomials and elementary Fourier analysis. To illustrate the method, we develop the following applications: 1. We give a short proof of the result of Friedman that random regular graphs have a near-optimal spectral gap and obtain a sharp understanding of the large deviations probabilities of the second eigenvalue. 2. We prove a strong quantitative form of the strong convergence property of random permutation matrices due to Bordenave and Collins. 3. We extend the above to any stable representation of the symmetric group, providing many new examples of the strong convergence phenomenon. - 17 November 2025
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Matrix Analysis and Applications
- Vol. 46 (4) , 2527-2557
Embrace Rejection: Kernel Matrix Approximation by Accelerated Randomly Pivoted Cholesky
Randomly pivoted Cholesky (RPCholesky) is an algorithm for constructing a low-rank approximation of a positive-semidefinite matrix using a small number of columns. This paper develops an accelerated version of RPCholesky that employs block matrix computations and rejection sampling to efficiently simulate the execution of the original algorithm. For the task of approximating a kernel matrix, the accelerated algorithm can run over [Formula: see text] faster. The paper contains implementation details, theoretical guarantees, experiments on benchmark data sets, and an application to computational chemistry. Reproducibility of computational results. This paper has been awarded the “SIAM Reproducibility Badge: Code and data available” as a recognition that the authors have followed reproducibility principles valued by SIMAX and the scientific computing community. Code and data that allow readers to reproduce the results in this paper are available at https://github.com/eepperly/Randomly-Pivoted-Cholesky and in the supplementary materials ( github-repo.zip [82.9KB]). [Formula: see text]
- 17 November 2025
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Matrix Analysis and Applications
- Vol. 46 (4) , 2527-2557
Embrace Rejection: Kernel Matrix Approximation by Accelerated Randomly Pivoted Cholesky
Randomly pivoted Cholesky (RPCholesky) is an algorithm for constructing a low-rank approximation of a positive-semidefinite matrix using a small number of columns. This paper develops an accelerated version of RPCholesky that employs block matrix computations and rejection sampling to efficiently simulate the execution of the original algorithm. For the task of approximating a kernel matrix, the accelerated algorithm can run over [Formula: see text] faster. The paper contains implementation details, theoretical guarantees, experiments on benchmark data sets, and an application to computational chemistry. Reproducibility of computational results. This paper has been awarded the “SIAM Reproducibility Badge: Code and data available” as a recognition that the authors have followed reproducibility principles valued by SIMAX and the scientific computing community. Code and data that allow readers to reproduce the results in this paper are available at https://github.com/eepperly/Randomly-Pivoted-Cholesky and in the supplementary materials ( github-repo.zip [82.9KB]). [Formula: see text]
- Top Cited Papers
- 20 June 2024
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Matrix Analysis and Applications
- Vol. 45 (2) , 1183-1214
Fast and Accurate Randomized Algorithms for Linear Systems and Eigenvalue Problems
This paper develops a class of algorithms for general linear systems and eigenvalue problems. These algorithms apply fast randomized dimension reduction (“sketching”) to accelerate standard subspace projection methods, such as GMRES and Rayleigh–Ritz. This modification makes it possible to incorporate nontraditional bases for the approximation subspace that are easier to construct. When the basis is numerically full rank, the new algorithms have accuracy similar to classic methods but run faster and may use less storage. For model problems, numerical experiments show large advantages over the optimized MATLAB routines, including a [Formula: see text] speedup over [Formula: see text] and a [Formula: see text] speedup over [Formula: see text].
- 20 June 2024
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Matrix Analysis and Applications
- Vol. 45 (2) , 1183-1214
Top Cited PapersFast and Accurate Randomized Algorithms for Linear Systems and Eigenvalue Problems
This paper develops a class of algorithms for general linear systems and eigenvalue problems. These algorithms apply fast randomized dimension reduction (“sketching”) to accelerate standard subspace projection methods, such as GMRES and Rayleigh–Ritz. This modification makes it possible to incorporate nontraditional bases for the approximation subspace that are easier to construct. When the basis is numerically full rank, the new algorithms have accuracy similar to classic methods but run faster and may use less storage. For model problems, numerical experiments show large advantages over the optimized MATLAB routines, including a [Formula: see text] speedup over [Formula: see text] and a [Formula: see text] speedup over [Formula: see text].
- Open Access
- 9 February 2024
- Published by American Physical Society (APS) in Physical Review X
- Vol. 14 (1) , 011014
Sparse Random Hamiltonians Are Quantumly Easy
A candidate application for quantum computers is to simulate the low-temperature properties of quantum systems. For this task, there is a well-studied quantum algorithm that performs quantum phase estimation on an initial trial state that has a non-negligible overlap with a low-energy state. However, it is notoriously hard to give theoretical guarantees that such a trial state can be prepared efficiently. Moreover, the heuristic proposals that are currently available, such as with adiabatic state preparation, appear insufficient in practical cases. This paper shows that, for most random sparse Hamiltonians, the maximally mixed state is a sufficiently good trial state, and phase estimation efficiently prepares states with energy arbitrarily close to the ground energy. Furthermore, any low-energy state must have non-negligible quantum circuit complexity, suggesting that low-energy states are classically nontrivial and phase estimation is the optimal method for preparing such states (up to polynomial factors). These statements hold for two models of random Hamiltonians: (i) a sum of random signed Pauli strings and (ii) a random signed -sparse Hamiltonian. The main technical argument is based on some new results in nonasymptotic random matrix theory. In particular, a refined concentration bound for the spectral density is required to obtain complexity guarantees for these random Hamiltonians.- 9 February 2024
- Published by American Physical Society (APS) in Physical Review X
- Vol. 14 (1) , 011014
Open AccessSparse Random Hamiltonians Are Quantumly Easy
A candidate application for quantum computers is to simulate the low-temperature properties of quantum systems. For this task, there is a well-studied quantum algorithm that performs quantum phase estimation on an initial trial state that has a non-negligible overlap with a low-energy state. However, it is notoriously hard to give theoretical guarantees that such a trial state can be prepared efficiently. Moreover, the heuristic proposals that are currently available, such as with adiabatic state preparation, appear insufficient in practical cases. This paper shows that, for most random sparse Hamiltonians, the maximally mixed state is a sufficiently good trial state, and phase estimation efficiently prepares states with energy arbitrarily close to the ground energy. Furthermore, any low-energy state must have non-negligible quantum circuit complexity, suggesting that low-energy states are classically nontrivial and phase estimation is the optimal method for preparing such states (up to polynomial factors). These statements hold for two models of random Hamiltonians: (i) a sum of random signed Pauli strings and (ii) a random signed -sparse Hamiltonian. The main technical argument is based on some new results in nonasymptotic random matrix theory. In particular, a refined concentration bound for the spectral density is required to obtain complexity guarantees for these random Hamiltonians. - 8 February 2024
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Scientific Computing
- Vol. 46 (1) , A508-A528
Efficient Error and Variance Estimation for Randomized Matrix Computations
Randomized matrix algorithms have become workhorse tools in scientific computing and machine learning. To use these algorithms safely in applications, they should be coupled with posterior error estimates to assess the quality of the output. To meet this need, this paper proposes two diagnostics: a leave-one-out error estimator for randomized low-rank approximations and a jackknife resampling method to estimate the variance of the output of a randomized matrix computation. Both of these diagnostics are rapid to compute for randomized low-rank approximation algorithms such as the randomized SVD and randomized Nyström approximation, and they provide useful information that can be used to assess the quality of the computed output and guide algorithmic parameter choices.
- 8 February 2024
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Scientific Computing
- Vol. 46 (1) , A508-A528
Efficient Error and Variance Estimation for Randomized Matrix Computations
Randomized matrix algorithms have become workhorse tools in scientific computing and machine learning. To use these algorithms safely in applications, they should be coupled with posterior error estimates to assess the quality of the output. To meet this need, this paper proposes two diagnostics: a leave-one-out error estimator for randomized low-rank approximations and a jackknife resampling method to estimate the variance of the output of a randomized matrix computation. Both of these diagnostics are rapid to compute for randomized low-rank approximation algorithms such as the randomized SVD and randomized Nyström approximation, and they provide useful information that can be used to assess the quality of the computed output and guide algorithmic parameter choices.
- Top Cited Papers
- 3 January 2024
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Matrix Analysis and Applications
- Vol. 45 (1) , 1-23
XTrace: Making the Most of Every Sample in Stochastic Trace Estimation
The implicit trace estimation problem asks for an approximation of the trace of a square matrix, accessed via matrix-vector products (matvecs). This paper designs new randomized algorithms, XTrace and XNysTrace, for the trace estimation problem by exploiting both variance reduction and the exchangeability principle. For a fixed budget of matvecs, numerical experiments show that the new methods can achieve errors that are orders of magnitude smaller than existing algorithms, such as the Girard–Hutchinson estimator or the Hutch++ estimator. A theoretical analysis confirms the benefits by offering a precise description of the performance of these algorithms as a function of the spectrum of the input matrix. The paper also develops an exchangeable estimator, XDiag, for approximating the diagonal of a square matrix using matvecs.
- 3 January 2024
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Matrix Analysis and Applications
- Vol. 45 (1) , 1-23
Top Cited PapersXTrace: Making the Most of Every Sample in Stochastic Trace Estimation
The implicit trace estimation problem asks for an approximation of the trace of a square matrix, accessed via matrix-vector products (matvecs). This paper designs new randomized algorithms, XTrace and XNysTrace, for the trace estimation problem by exploiting both variance reduction and the exchangeability principle. For a fixed budget of matvecs, numerical experiments show that the new methods can achieve errors that are orders of magnitude smaller than existing algorithms, such as the Girard–Hutchinson estimator or the Hutch++ estimator. A theoretical analysis confirms the benefits by offering a precise description of the performance of these algorithms as a function of the spectrum of the input matrix. The paper also develops an exchangeable estimator, XDiag, for approximating the diagonal of a square matrix using matvecs.
- 30 May 2023
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Matrix Analysis and Applications
- Vol. 44 (2) , 718-752
Randomized Nyström Preconditioning
This paper introduces the Nyström preconditioned conjugate gradient (PCG) algorithm for solving a symmetric positive-definite linear system. The algorithm applies the randomized Nyström method to form a low-rank approximation of the matrix, which leads to an efficient preconditioner that can be deployed with the conjugate gradient algorithm. Theoretical analysis shows that the preconditioned system has constant condition number as soon as the rank of the approximation is comparable with the number of effective degrees of freedom in the matrix. The paper also develops adaptive methods that provably achieve similar performance without knowledge of the effective dimension. Numerical tests show that Nyström PCG can rapidly solve large linear systems that arise in data analysis problems, and it surpasses several competing methods from the literature.
- 30 May 2023
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Matrix Analysis and Applications
- Vol. 44 (2) , 718-752
Randomized Nyström Preconditioning
This paper introduces the Nyström preconditioned conjugate gradient (PCG) algorithm for solving a symmetric positive-definite linear system. The algorithm applies the randomized Nyström method to form a low-rank approximation of the matrix, which leads to an efficient preconditioner that can be deployed with the conjugate gradient algorithm. Theoretical analysis shows that the preconditioned system has constant condition number as soon as the rank of the approximation is comparable with the number of effective degrees of freedom in the matrix. The paper also develops adaptive methods that provably achieve similar performance without knowledge of the effective dimension. Numerical tests show that Nyström PCG can rapidly solve large linear systems that arise in data analysis problems, and it surpasses several competing methods from the literature.
- 5 May 2023
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Applied Dynamical Systems
- Vol. 22 (2) , 527-558
Learning to Forecast Dynamical Systems from Streaming Data
Kernel analog forecasting (KAF) is a methodology for data-driven, nonparametric forecasting of dynamically generated time series data. This approach has a rigorous foundation in Koopman operator theory and it produces good forecasts in practice, but it suffers from the heavy computational costs common to kernel methods. This paper proposes a streaming algorithm for KAF that only requires a single pass over the training data. This algorithm dramatically reduces the costs of training and prediction without sacrificing forecasting skill. Computational experiments demonstrate that the streaming KAF method can successfully forecast several classes of dynamical systems (periodic, quasi-periodic, and chaotic) in both data-scarce and data-rich regimes. The overall methodology may have wider interest as a new template for streaming kernel regression.
- 5 May 2023
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Applied Dynamical Systems
- Vol. 22 (2) , 527-558
Learning to Forecast Dynamical Systems from Streaming Data
Kernel analog forecasting (KAF) is a methodology for data-driven, nonparametric forecasting of dynamically generated time series data. This approach has a rigorous foundation in Koopman operator theory and it produces good forecasts in practice, but it suffers from the heavy computational costs common to kernel methods. This paper proposes a streaming algorithm for KAF that only requires a single pass over the training data. This algorithm dramatically reduces the costs of training and prediction without sacrificing forecasting skill. Computational experiments demonstrate that the streaming KAF method can successfully forecast several classes of dynamical systems (periodic, quasi-periodic, and chaotic) in both data-scarce and data-rich regimes. The overall methodology may have wider interest as a new template for streaming kernel regression.