Optimization Online


Data-driven sample average approximation with covariate information

Rohit Kannan(rohit.kannan***at***wisc.edu)
Güzin Bayraksan(bayraksan.1***at***osu.edu)
James Luedtke(jim.luedtke***at***wisc.edu)

Abstract: We consider optimization for decision-making in which parameters within the optimization model are uncertain, but predictions of these parameters can be made using available covariate information. We consider a data-driven setting in which we have observations of the uncertain parameters together with concurrently-observed covariates. Given a new covariate observation, the goal is to choose a decision that minimizes the expected cost conditioned on this observation. We investigate three data-driven frameworks that integrate a machine learning prediction model within a stochastic programming sample average approximation (SAA) for approximating the solution to this problem. Two of the SAA frameworks are new and use out-of-sample residuals of leave-one-out prediction models for scenario generation. The frameworks we investigate are flexible and accommodate parametric, nonparametric, and semiparametric regression techniques. We derive conditions on the data generation process, the prediction model, and the stochastic program under which solutions of these data-driven SAAs are consistent and asymptotically optimal, and also derive convergence rates and finite sample guarantees. Computational experiments validate our theoretical results, demonstrate the potential advantages of our data-driven formulations over existing approaches (even when the prediction model is misspecified), and illustrate the benefits of our new data-driven formulations in the limited data regime.

Keywords: Data-driven stochastic programming, covariates, regression, sample average approximation, convergence rate, large deviations

Category 1: Stochastic Programming


Download: [PDF]

Entry Submitted: 07/24/2020
Entry Accepted: 07/24/2020
Entry Last Modified: 07/24/2020

Modify/Update this entry

  Visitors Authors More about us Links
  Subscribe, Unsubscribe
Digest Archive
Search, Browse the Repository


Coordinator's Board
Classification Scheme
Give us feedback
Optimization Journals, Sites, Societies
Mathematical Optimization Society