Paperlane

no. 16 · Tuesday 17 November 2026

Correspondence-Free Camera Pose Estimation by Matching Moments

Subhransu S. Bhattacharjee, Dylan Campbell and Rahul Shome

math.OC · via cs.CV · 65 pp

Abstract

The blind perspective-$n$-point (PnP) problem is to estimate the pose of a calibrated camera from 2D and 3D point sets with unknown correspondences. We show that, for complete, noiseless observations, fourteen permutation-invariant image moments up to order four identify a fixed camera pose for almost every 3D point set containing at least twenty points. Our learning-free method, MomentPnP, matches these moments between the observed 2D points and the projected 3D points to initialize a camera pose without correspondences and refines the pose and correspondence weights using expectation–maximization. Across the test sets of three benchmarks, our method reduces median rotation error by $5$--$170\times$ relative to the best learned baseline, both with and without outliers. We recover accurate poses even with as many outliers as inliers. On dense ETH3D scans, pose accuracy improves as the point sets grow, even as individual correspondences become harder to resolve.

comments
65 pages, including references and appendices; under review
fields
Optimization and Control
pdf ↗ page arXiv:2611.20797 ↗