Paperlane

no. 16 · Tuesday 17 November 2026

Variance Stable Gaussian Smoothing Estimator for Arbitrary High-order Derivatives

Shuixin Fang, Xuerui Wang, Hang Zeng and Tao Zhou

math.NA · 20 pp

Abstract

Computing high-order partial derivatives in high dimensions by automatic differentiation can be costly in both computation and memory. Stein's identity offers an alternative through Gaussian smoothing, but the variance of the resulting estimators can diverge as the step size tends to zero, even with antithetic sampling. We propose a variance stabilization technique that extends antithetic sampling from a reflection pair to $n$ equally spaced points on a circle in the complex plane. Under local analyticity, we prove that, when $n$ is at least the derivative order, the bias is of order $O(σ^n)$ and the variance remains bounded as the smoothing step size $σ$ tends to zero. Numerical experiments support these predictions and demonstrate the effectiveness of the estimator in physics-informed neural networks (PINNs) for polyharmonic and Cahn–Hilliard equations. The technique mitigates the bias-variance trade-off in smoothing-based derivative estimation and is useful for PINNs solving high-order partial differential equations.

comments
20 pages, 6 figures
fields
Numerical Analysis
pdf ↗ page arXiv:2611.19909 ↗