-

 

 

 




Optimization Online





 

Risk-Averse Control of Undiscounted Transient Markov Models

Ozlem Cavus (ozlem.cavus***at***bilkent.edu.tr)
Andrzej Ruszczynski (rusz***at***business.rutgers.edu)

Abstract: We use Markov risk measures to formulate a risk-averse version of the undiscounted total cost problem for a transient controlled Markov process. We derive risk-averse dynamic programming equations and we show that a randomized policy may be strictly better than deterministic policies, when risk measures are employed. We illustrate the results on an optimal stopping problem and an organ transplant problem.

Keywords: Dynamic Risk Measures; Markov Risk Measures; Stochastic Shortest Path; Optimal Stopping; Randomized Policy

Category 1: Other Topics (Dynamic Programming )

Category 2: Stochastic Programming

Citation:

Download: [PDF]

Entry Submitted: 12/30/2012
Entry Accepted: 01/01/2013
Entry Last Modified: 03/22/2014

Modify/Update this entry


  Visitors Authors More about us Links
  Subscribe, Unsubscribe
Digest Archive
Search, Browse the Repository

 

Submit
Update
Policies
Coordinator's Board
Classification Scheme
Credits
Give us feedback
Optimization Journals, Sites, Societies
Mathematical Optimization Society