-

 

 

 




Optimization Online





 

Finite State Approximations for Robust Markov Decision Processes

Kerem Ugurlu (keremugurlu***at***gmail.com)

Abstract: We give a finite state approximation scheme to countable state controlled robust/risk-averse Markov chains, where there is uncertainty in the transition probability. A convergence theorem along with the corresponding rate for this approximation is established. An approximation to the stationary optimal policy is also given. Our results show a fundamental difference between the finite state approximations for classical/riskneutral and robust/risk averse controlled Markov chains. In risk averse case, based onthe size of the uncertainty radius in transition densities, the discount rate 0≤β <1must be small enough to compensate for the radius of uncertainty, otherwise the convergence can not be guaranteed. This is not to be seen in finite state approximations for risk neutral controlled Markov chains.

Keywords:

Category 1: Applications -- OR and Management Sciences

Citation:

Download: [PDF]

Entry Submitted: 12/10/2019
Entry Accepted: 12/10/2019
Entry Last Modified: 12/10/2019

Modify/Update this entry


  Visitors Authors More about us Links
  Subscribe, Unsubscribe
Digest Archive
Search, Browse the Repository

 

Submit
Update
Policies
Coordinator's Board
Classification Scheme
Credits
Give us feedback
Optimization Journals, Sites, Societies
Mathematical Optimization Society