Paperlane

no. 9 · Thursday 5 November 2026

Occupation Measures in the ODE Method: Wasserstein Convergence and Rates

Dimitrios Katselis

math.PR

Abstract

We study occupation measures associated with stochastic approximation recursions within the ordinary differential equation (ODE) method. Under Lyapunov conditions ensuring that the limiting ODE has a globally exponentially stable equilibrium, we establish that the continuous-time occupation measures associated with the piecewise linear interpolation of the iterates converge almost surely in the $2$-Wasserstein topology to the Dirac mass at the equilibrium, the unique invariant probability measure of the limiting semiflow. The choice of the $2$-Wasserstein distance is naturally aligned with our continuous- and discrete-time Lyapunov drift analysis. We also consider two discrete-time sequences of occupation measures, induced by the algorithmic time scale and the iteration count, respectively, and we establish their almost sure convergence to the same invariant measure in the $2$-Wasserstein distance. We then derive corresponding convergence rates in expectation, providing a nonasymptotic complement to the almost sure results. These expectation bounds also imply some tail probability estimates. Finally, we verify that our results apply to a canonical class of linear recursions.

fields
Probability, Dynamical Systems
pdf ↗ page arXiv:2611.05921 ↗