Optimization Online


Exact converging bounds for Stochastic Dual Dynamic Programming via Fenchel duality

V Leclère(vincent.leclere***at***enpc.fr)
P Carpentier(pierre.carpentier***at***ensta-paristech.fr)
J-Ph Chancelier(jpc***at***cermics.enpc.fr)
A Lenoir(arnaud.lenoir***at***edf.fr)
F Pacaud(f.pacaud***at***efficacity.com)

Abstract: The Stochastic Dual Dynamic Programming (SDDP) algorithm has become one of the main tools to address convex multistage stochastic optimal control problem. Recently a large amount of work has been devoted to improve the convergence speed of the algorithm through cut-selection and regularization, or to extend the field of applications to non-linear, integer or risk-averse problems. However one of the main downside of the algorithm remains the difficulty to give an upper bound of the optimal value, usually estimated through Monte Carlo methods and therefore difficult to use in the algorithm stopping criterion. In this paper we present a dual SDDP algorithm that yields a converging exact upper bound for the optimal value of the optimization problem. Incidently we show how to compute an alternative control policy based on an inner approximation of Bellman value functions instead of the outer approximation given by the standard SDDP algorithm. We illustrate the approach on an energy production problem involving zones of production and transportation links between the zones. The numerical experiments we carry out on this example show the effectiveness of the method.

Keywords: Stochastic Dual Dynamic Programming ; Decomposition Methods ; Fenchel Duality

Category 1: Stochastic Programming

Category 2: Other Topics (Dynamic Programming )


Download: [PDF]

Entry Submitted: 04/12/2018
Entry Accepted: 04/14/2018
Entry Last Modified: 04/12/2018

Modify/Update this entry

  Visitors Authors More about us Links
  Subscribe, Unsubscribe
Digest Archive
Search, Browse the Repository


Coordinator's Board
Classification Scheme
Give us feedback
Optimization Journals, Sites, Societies
Mathematical Optimization Society