Paperlane

no. 6 · Monday 2 November 2026

Stochastic Rayleigh-Ritz Ascent: Global Linear Convergence under a Spectral Gap

Jonas Bresch and Oleh Melnyk

math.OC

Abstract

We consider the adjoint-free random-plane iteration algorithm for finding the top eigenvector of a matrix proposed in (SIAM J. Matrix Anal. Appl. 47 (2026), 1349-1374). Unlike standard methods such as the power method or gradient descent, the above algorithm lacked linear convergence guarantees in the presence of a spectral gap. In this paper, we establish explicit spectral-gap-dependent global linear convergence rates in expectation, providing quantitative guarantees for the empirically observed convergence.

fields
Optimization and Control, Numerical Analysis, Probability
pdf ↗ page arXiv:2610.42071 ↗