Optimization Online


A Data-Driven Approach for a Class of Stochastic Dynamic Optimization Problems

Thuener Silva (thuener***at***esp.puc-rio.br)
Davi Valladão (davimv***at***puc-rio.br)
Tito Homem-de-Mello (tito.hmello***at***uai.cl)

Abstract: Dynamic stochastic optimization models provide a powerful tool to represent sequential decision-making processes. Typically, these models use statistical predictive methods to capture the structure of the underlying stochastic process without taking into consideration estimation errors and model misspecification. In this context, we propose a data-driven prescriptive analytics framework aiming to integrate the machine learning and dynamic optimization machinery in a consistent and efficient way to build a bridge from data to decisions. The proposed framework tackle a relevant class of dynamic decision problems comprising many important practical applications. The basic building blocks of our proposed framework are: (i) a Hidden Markov Model as a predictive (machine learning) method to represent uncertainty; and (ii) a distributionally robust dynamic optimization model as a prescriptive method that takes into account estimation errors associated with the predictive model and allows for control of the risk associated with decisions. Moreover, we present an evaluation framework to assess out-of-sample performance in rolling horizon schemes. A complete case study on dynamic asset allocation illustrates the proposed framework showing superior out-of-sample performance against selected benchmarks. The numerical results shows the practical importance and applicability of the proposed framework since it extracts valuable information from data to obtain robustified decisions with an empirical certificate of out-of-sample performance evaluation.

Keywords: Data-driven prescriptive analytics, Hidden Markov models, Distributionally robust dynamic optimization, Stochastic Dynamic Dual Programming

Category 1: Stochastic Programming


Download: [PDF]

Entry Submitted: 10/16/2019
Entry Accepted: 10/21/2019
Entry Last Modified: 05/21/2021

Modify/Update this entry

  Visitors Authors More about us Links
  Subscribe, Unsubscribe
Digest Archive
Search, Browse the Repository


Coordinator's Board
Classification Scheme
Give us feedback
Optimization Journals, Sites, Societies
Mathematical Optimization Society