Optimization Online


Monitoring With Limited Information

Dan Iancu (daniancu***at***stanford.edu)
Nikolaos Trichakis (ntrichakis***at***mit.edu)
Do Young Yoon (doyoung***at***stanford.edu)

Abstract: We consider a system with an evolving state that can be stopped at any time by a decision maker (DM), yielding a state-dependent reward. The DM does not observe the state except for a limited number of monitoring times, which he must choose, in conjunction with a suitable stopping policy, to maximize his reward. Dealing with this type of stopping problems, which arise in a variety of applications from healthcare to finance, often requires excessive amounts of data for calibration purposes, and prohibitive computational resources. To overcome these challenges, we propose a robust optimization approach, whereby adaptive uncertainty sets capture the information acquired through monitoring. We consider two versions of the problem–-static and dynamic–-depending on how the monitoring times are chosen. We show that, under certain conditions, the same worst-case reward is achievable under either static or dynamic monitoring. This allows recovering the optimal dynamic monitoring policy by resolving static versions of the problem. We discuss cases when the static problem becomes tractable, and highlight conditions when monitoring at equi-distant times is optimal. Lastly, we showcase our framework in the context of a healthcare problem (monitoring heart transplant patients for Cardiac Allograft Vasculopathy), where we design optimal monitoring policies that substantially improve over the status quo treatment recommendations.

Keywords: robust optimization, stopping problem, monitoring, learning

Category 1: Robust Optimization

Category 2: Applications -- OR and Management Sciences

Category 3: Other Topics (Dynamic Programming )


Download: [PDF]

Entry Submitted: 04/23/2018
Entry Accepted: 04/23/2018
Entry Last Modified: 05/13/2019

Modify/Update this entry

  Visitors Authors More about us Links
  Subscribe, Unsubscribe
Digest Archive
Search, Browse the Repository


Coordinator's Board
Classification Scheme
Give us feedback
Optimization Journals, Sites, Societies
Mathematical Optimization Society