Paperlane

no. 12 · Tuesday 10 November 2026

Riemannian Ordinary Least Squares

Xiaoyu Chen, Yujing Huang and Yingyan Zeng

math.ST · via stat.ME · code

Abstract

Many scientific responses take values in Riemannian manifolds, with predictors that are scalar- and/or manifold-valued. A regression analysis in such settings must provide accurate prediction with hypothesis testing for individual coefficients. Yet no current manifold-regression framework accommodates both predictor types and enables per-coefficient hypothesis tests. We propose Riemannian Ordinary Least Squares (ROLS) as a tangent space conditional-mean model, which is the ordinary least squares (OLS) analogue for Riemannian manifolds. ROLS is well-defined under an explicit injectivity condition that keeps the logarithm maps single-valued, with cut-locus conditions for branch-sensitive cases outside it. Within the local geometric setting it admits a closed-form estimator, an $O(n^{-1})$ excess prediction-error bound with explicit curvature bias, and asymptotic $t$- and Wald tests for individual coefficients. With synthetic simulations and three real-data case studies, ROLS is shown to be competitive with the state-of-the-art baselines. In addition, the per-coefficient tests agree with effects reported in literature. We envision ROLS to be a standard tool for manifold-valued regression with coefficient-level inference to support scientific discovery, which can be interpreted in the same way as Euclidean OLS. The source code is available at https://github.com/XiaoyuChenPub/ROLS.

code
github.com/XiaoyuChenPub/ROLS
journal
Xiaoyu Chen, Yujing (Zipan) Huang, Yingyan Zeng. Riemannian Ordinary Least Squares. Advances in Neural Information Processing Systems (NeurIPS), 2026
fields
Statistics Theory
pdf ↗ page arXiv:2611.10459 ↗