Approximate stochastic dynamic programming for hydroelectric production planning

This paper presents a novel approach for approximate stochastic dynamic programming (ASDP) over a continuous state space when the optimization phase has a near-convex structure. The approach entails a simplicial partitioning of the state space. Bounds on the true value function are used to refine the partition. We also provide analytic formulae for the computation of the expectation of the value function in the “uni-basin” case where natural inflows are strongly correlated. The approach is experimented on several configurations of hydro-energy systems. It is also tested against actual industrial data.