SASiavash Ameli

Siavash Ameli

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Siavash Ameli has a total of 5 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Spectral Estimation with Free Decompression

    by Siavash Ameli, Chris van der Heide, Liam Hodgkinson, Michael W. Mahoney

    Computing eigenvalues of very large matrices is a critical task in many machine learning applications, including the evaluation of log-determinants, the trace of matrix functions, and other important metrics. As datasets continue to grow in scale, the corresponding covariance and kernel matrices become increasingly large, often reaching magnitudes that make their direct formation impractical or impossible. Existing techniques typically rely on matrix-vector products, which can provide efficient approximations, if the matrix spectrum behaves well. However, in settings like distributed learning, or when the matrix is defined only indirectly, access to the full data set can be restricted to only very small sub-matrices of the original matrix. In these cases, the matrix of nominal interest is not even available as an implicit operator, meaning that even matrix-vector products may not be available. In such settings, the matrix is "impalpable," in the sense that we have access to only masked snapshots of it. We draw on principles from free probability theory to introduce a novel method of "free decompression" to estimate the spectrum of such matrices. Our method can be used to extrapolate from the empirical spectral densities of small submatrices to infer the eigenspectrum of extremely large (impalpable) matrices (that we cannot form or even evaluate with full matrix-vector products). We demonstrate the effectiveness of this approach through a series of examples, comparing its performance against known limiting distributions from random matrix theory in synthetic settings, as well as applying it to submatrices of real-world datasets, matching them with their full empirical eigenspectra.

  • Open Access

    A Singular Woodbury and Pseudo-Determinant Matrix Identities and Application to Gaussian Process Regression

    by Siavash Ameli, Shawn C. Shadden

    We study a matrix that arises from a singular form of the Woodbury matrix identity. We present generalized inverse and pseudo-determinant identities for this matrix, which have direct applications for Gaussian process regression, specifically its likelihood representation and precision matrix. We extend the definition of the precision matrix to the Bott-Duffin inverse of the covariance matrix, preserving properties related to conditional independence, conditional precision, and marginal precision. We also provide an efficient algorithm and numerical analysis for the presented determinant identities and demonstrate their advantages under specific conditions relevant to computing log-determinant terms in likelihood functions of Gaussian process regression.

  • Open Access

    Interpolating log-determinant and trace of the powers of matrix $\textbf{A} + t\textbf{B}$

    by Siavash Ameli, Shawn C. Shadden

    We develop heuristic interpolation methods for the functions $$t\mapsto \log \det \left( \textbf{A} + t\textbf{B} \right) $$t↦logdetA+tB and $$t\mapsto {{\,\textrm{trace}\,}}\left( (\textbf{A} + t\textbf{B})^{p} \right) $$t↦trace(A+tB)p where the matrices $$\textbf{A}$$A and $$\textbf{B}$$B are Hermitian and positive (semi) definite and $$p$$p and $$t$$t are real variables. These functions are featured in many applications in statistics, machine learning, and computational physics. The presented interpolation functions are based on the modification of sharp bounds for these functions. We demonstrate the accuracy and performance of the proposed method with numerical examples, namely, the marginal maximum likelihood estimation for Gaussian process regression and the estimation of the regularization parameter of ridge regression with the generalized cross-validation method.


  • Open Access

    Interpolating Log-Determinant and Trace of the Powers of Matrix $\mathbf{A} + t \mathbf{B}$

    by Siavash Ameli, Shawn C. Shadden

    We develop heuristic interpolation methods for the functions $t \mapsto \log \det \left( \mathbf{A} + t \mathbf{B} \right)$ and $t \mapsto \operatorname{trace}\left( (\mathbf{A} + t \mathbf{B})^{p} \right)$ where the matrices $\mathbf{A}$ and $\mathbf{B}$ are Hermitian and positive (semi) definite and $p$ and $t$ are real variables. These functions are featured in many applications in statistics, machine learning, and computational physics. The presented interpolation functions are based on the modification of sharp bounds for these functions. We demonstrate the accuracy and performance of the proposed method with numerical examples, namely, the marginal maximum likelihood estimation for Gaussian process regression and the estimation of the regularization parameter of ridge regression with the generalized cross-validation method.

  • Open Access

    A Transport Method for Restoring Incomplete Ocean Current Measurements

    by Siavash Ameli, Shawn C. Shadden

    Remote sensing of oceanographic data often yields incomplete coverage of the measurement domain. This can limit interpretability of the data and identification of coherent features informative of ocean dynamics. Several methods exist to fill gaps of missing oceanographic data and are often based on projecting the measurements onto basis functions or a statistical model. Herein, we use an information transport approach inspired from an image processing algorithm. This approach aims to restore gaps in data by advecting and diffusing information of features as opposed to the field itself. Since this method does not involve fitting or projection, the portions of the domain containing measurements can remain unaltered, and the method offers control over the extent of local information transfer. This method is applied to measurements of ocean surface currents by high frequency radars. This is a relevant application because data coverage can be sporadic, and filling data gaps can be essential to data usability. Application to two regions with differing spatial scale is considered. The accuracy and robustness of the method is tested by systematically blinding measurements and comparing the restored data at these locations to the actual measurements. These results demonstrate that even for locally large percentages of missing data points, the restored velocities have errors within the native error of the original data (e.g., <10% for velocity magnitude and <3% for velocity direction). Results were relatively insensitive to model parameters, facilitating a priori selection of default parameters for de novo applications.