Paperlane

no. 3 · Tuesday 27 October 2026

Data-Driven Stochastic Control of Delayed Air-Conditioning Systems

Christian Bayer, Raul Tempone and Leon Wilkosz

math.OC

Abstract

We consider a stochastic optimal control problem arising in the operation of industrial air-conditioning systems with delayed activation effects. The delayed transition between inactive and operational regimes induces a non-Markovian structure in the controlled dynamics. We derive a regression-based discrete dynamic programming algorithm on nested state-control grids. We give a probabilistic proof of convergence of the idealized time-discrete dynamic programming problem to the continuous-time value function. Numerical experiments based on calibrated multidimensional forecast-tracking Ornstein–Uhlenbeck models illustrate the effectiveness of the proposed methodology.

fields
Optimization and Control
pdf ↗ page arXiv:2610.35811 ↗