  


Bayesian Solution Estimators in Stochastic Optimization
Danial Davarnia(ddavarniandrew.cmu.edu) Abstract: We study a class of stochastic programs where some of the elements in the objective function are random, and their probability distribution has unknown parameters. The goal is to find a good estimate for the optimal solution of the stochastic program using data sampled from the distribution of the random elements. We investigate two natural criteria for evaluating the quality of a solution estimator, one based on the difference in objective values, and the other based on the Euclidean distance between solutions. We use "risk" as the expected value of such criteria over the sample space. Under a Bayesian framework, where a prior distribution is assumed for the unknown parameters, two natural estimationoptimization strategies arise. A "separate" scheme first finds an estimator for the unknown parameters, and then uses this estimator in the optimization problem. A "joint" scheme combines the estimation and optimization steps by directly adjusting the distribution in the stochastic program. We study the risk difference between the solutions obtained from these two schemes for several classes of stochastic programs, while providing insight on the computational effort to solve these problems. In particular, (i) we identify conditions under which the solution estimators of both schemes are equal, (ii) for general problems, we show that the risk difference between the two schemes can be arbitrarily large, (iii) for stochastic piecewise linear programs, we derive explicit bounds on risk differences, and (iv) for stochastic geometric programs, we discuss the difference in computational complexity of the two schemes and provide computational experiments. Keywords: Stochastic optimization, Bayesian inference, Estimation, Piecewise linear function, Geometric program Category 1: Stochastic Programming Category 2: Applications  Science and Engineering (Statistics ) Category 3: Global Optimization (Stochastic Approaches ) Citation: Download: [PDF] Entry Submitted: 11/07/2017 Modify/Update this entry  
Visitors  Authors  More about us  Links  
Subscribe, Unsubscribe Digest Archive Search, Browse the Repository

Submit Update Policies 
Coordinator's Board Classification Scheme Credits Give us feedback 
Optimization Journals, Sites, Societies  