Optimization Online


Risk-Sensitive Variational Bayes: Formulations and Bounds

Prateek Jaiswal(jaiswalp***at***purdue.edu)
Harsha Honnappa(honnappa***at***purdue.edu)
Vinayak A. Rao(varao***at***purdue.edu)

Abstract: We study data-driven decision-making problems in a parametrized Bayesian framework. We adopt a risk-sensitive approach to modeling the interplay between statistical estimation of parameters and optimization, by computing a risk measure over a loss/disutility function with respect to the posterior distribution over the parameters. While this forms the standard Bayesian decision-theoretic approach, we focus on problems where calculating the posterior distribution is intractable, a typical situation in modern applications with large datasets, heterogeneity due to observed covariates and latent group structure. The key methodological innovation we introduce in this paper is to leverage a dual representation of the risk measure to introduce an optimization-based framework for approximately computing the posterior risk-sensitive objective, as opposed to using standard sampling based methods such as Markov Chain Monte Carlo. Our analytical contributions include rigorously proving finite sample bounds on the ‘optimality gap’ of optimizers obtained using the computational methods in this paper, from the ‘true’ optimizers of a given decision-making problem. We illustrate our results by comparing the theoretical bounds with simulations of a newsvendor problem on two methods extracted from our computational framework.

Keywords: Variational Bayes, Risk sensitivity, Stochastic programs.

Category 1: Stochastic Programming

Category 2: Other Topics (Other )

Citation: Technical Report, School of Industrial Engineering, 315 N. Grant St., West Lafayette IN 47906 05/2019.

Download: [PDF]

Entry Submitted: 05/10/2019
Entry Accepted: 05/13/2019
Entry Last Modified: 05/10/2019

Modify/Update this entry

  Visitors Authors More about us Links
  Subscribe, Unsubscribe
Digest Archive
Search, Browse the Repository


Coordinator's Board
Classification Scheme
Give us feedback
Optimization Journals, Sites, Societies
Mathematical Optimization Society