当前位置:首页>学术报告
应用数学研究所
学术报告


浏览次数:

 
Speaker:

郭先平 博士,中山大学

Inviter: 董昭 研究员
Title:
Optimal stopping time on discounted semi-Markov processes
Time & Venue:

2021.5.13 16:00 N620

Abstract:

In this talk we consider the optimal stopping problem for semi-Markov processes (SMPs) under the expected discount criterion. By introducing an explicit construction of semi-Markov decision processes (SMDPs), we prove the equivalence between the expected discounted SMPs and SMDPs, that is, every stopping time of SMPs can induce a policy of SMDPs such that the value functions are equal, and vice versa. Then, the existence and computation of an optimal stopping time of SMPs are given by the equivalence relation and the SMDP theory. Moreover, we show that the optimal and epsilon-optimal stopping time can be characterized by the hitting time of the sets of special states. Finally, we illustrate our results by a maintenance system.

Affiliation: