no. 16 · Tuesday 17 November 2026
Structural interpretability in SVMs with truncated orthogonal polynomial kernels
Abstract
Support vector machines (SVMs) can yield classifiers with similar predictive performance but different internal structures, particularly in the contributions of individual explanatory variables and their interactions. We introduce Orthogonal Representation Contribution Analysis (ORCA), a post-training methodology for SVMs constructed from tensor products of truncated Christoffel–Darboux kernels. The associated reproducing kernel Hilbert space (RKHS) admits a finite orthonormal polynomial basis in which the regularized component of the fitted decision function has an exact expansion. Squared expansion coefficients induce an additive decomposition of its squared RKHS norm. Based on this representation, normalized Orthogonal Kernel Contribution (OKC) indices quantify the fractions of the squared RKHS norm associated with total polynomial degrees, interaction orders, and input-variable contributions, both individually and through interactions of arbitrary order. ORCA summarizes these indices through joint structural maps, variable-specific displays, and comparisons of fitted classifiers. A controlled quartet of classification problems illustrates substantial structural differences under matched predictive performance. A double-spiral experiment compares five Jacobi kernels, while an application to the Vertebral Column data illustrates the method after cross-validated model selection. ORCA provides a quantitative characterization of the internal structure of fitted SVMs, revealing differences that may remain undetected by standard predictive performance metrics.
- fields
- Statistics Theory