D.V. Khlopin. Differential game with the possibility of early termination ... P. 189-214

We consider a zero-sum differential game on a finite interval, in which the players not only control the system’s trajectory but also influence the terminal time of the game. It is assumed that the early terminal time is an absolutely continuous random variable, and its density is given by bounded measurable functions of time assigned by both players (the intensities of the influence of each player on the termination of the game). The payoff function may depend both on the terminal time of the game together with the position of the system at this time and on the player who initiates the termination. The strategies are formalized by using nonanticipating càdlàg processes. The existence of the game value is shown under the Isaacs condition. For this, the original game is approximated by an auxiliary game based on a Markov chain with continuous time, which depends on the controls and intensities of the players. Based on the strategies optimal in this Markov game, a control procedure with a stochastic guide is proposed for the original game. It is shown that, under an unlimited increase in the number of points in the Markov game, this procedure leads to a near-optimal strategy in the original game.

Keywords: two-person zero-sum game, Dynkin game, differential game, stochastic guide, extremal shift, Markov chain with continuous time

Received February 8, 2021

Revised May 11, 2021

Accepted May 17, 2021

Funding Agency: This work was supported by the Russian Science Foundation (project no. 17-11-01093).

Dmitry Valer’evich Khlopin, Cand. Sci. (Phys.-Math.), Krasovskii Institute of Mathematics and Mechanics of the Ural Branch of the Russian Academy of Sciences, Yekaterinburg, 620108 Russia, e-mail: khlopin@imm.uran.ru

REFERENCES

1.   Amir R., Evstigneev I.V., Schenk-Hoppe K.R. Asset market games of survival: a synthesis of evolutionary and dynamic games. Ann. Finance, 2013, vol. 9, no. 2, pp. 121–144. doi: 10.1007/s10436-012-0210-5 

2.   Averboukh Y. Approximate solutions of continuous-time stochastic games. SIAM Journal on Control and Optimization, 2016, vol. 54, no. 5, pp. 2629–2649. doi: 10.1137/16M1062247 

3.   Averboukh Y. Approximate public-signal correlated equilibria for nonzero-sum differential games. SIAM J. Control Optim., 2019, vol. 57, no. 1, pp. 743–772. doi: 10.1137/17M1161403 

4.   Basu A., Stettner L. Zero-sum Markov games with impulse controls. SIAM J. Control Optim., 2020, vol. 58, no. 1, pp. 580–604. doi: 10.1137/18M1229365 

5.   Bensoussan B., Friedman F. Nonlinear variational inequalities and differential games with stopping times. J. Functional Analysis, 1974, vol. 16, no. 3, pp. 305–352. doi: 10.1016/0022-1236(74)90076-7 

6.   Bensoussan A., Friedman A. Nonzero-sum stochastic differential games with stopping times and free boundary problems. Trans. Amer. Math. Soc., 1977, vol. 231, no. 2, pp. 275–327. doi: 10.1090/S0002-9947-1977-0453082-7 

7.   Bielecki T.R., Crepey S., Jeanblanc M., Rutkowski M. Arbitrage pricing of defaultable game options with applications to convertible bonds. Quantitative Finance, 2008, vol. 8, no. 8, pp. 795–810. doi: 10.1080/14697680701401083 

8.   Billingsley P. Convergence of probability measures. NY: Wiley, 1968, 253 p. ISBN: 0471072427. Translated to Russian under the title Skhodimost’ veroyatnostnykh mer. Moscow: Nauka Publ., 1977, 352 p.

9.   Borovkov A.A. Teoriya veroyatnostei [Probability theory]. Moscow: URSS Publ., 1999, 470 p. ISBN: 5-901006-66-6 .

10.   Dynkin E.B. Game variant of a problem on optimal stopping. Soviet Math. Dokl., 1969, vol. 10, pp. 270–274.

11.   Ekström E., Peskir G. Optimal stopping games for Markov processes. SIAM J. Control Optim., 2008, vol. 47, no. 2, pp. 684–702. doi: 10.1137/060673916 

12.   Gensbittel F., Grün C. Zero-sum stopping games with asymmetric information. Math. Oper. Research, 2018, vol. 44, no. 1, pp. 277–302. doi: 10.1287/moor.2017.0924 

13.   Gromova E., Malakhova A., Palestini A. Payoff distribution in a multi-company extraction game with uncertain duration. Mathematics, 2018, vol. 6, no. 9, art. no. 165. doi: 10.3390/math6090165 

14.   Guo X., Hernandez-Lerma O. Zero-sum continuous-time Markov games with unbounded transition and discounted payoff rates. Bernoulli, 2005, vol. 11, no. 6, pp. 1009–1029. doi: 10.3150/bj/1137421638 

15.   Hamadene S. Mixed zero-sum stochastic differential game and American game options. SIAM J. Control Optim., 2006, vol. 45, no. 2, pp. 496–518. doi: 10.1137/S036301290444280X 

16.   Kolokoltsov V.N. Markov processes, semigroups and generators. Ser. De Gruyter Studies in Mathematics, vol. 38. Berlin; NY: De Gruyter, 2011, 430 p. doi: 10.1515/9783110250114 

17.   Krasovskii N.N. A convergence-evasion game with stochastic guide. Dokl. Akad. Nauk SSSR, 1977, vol. 237, no. 5. pp. 1020–1023 (in Russian).

18.   Krasovskii N.N., Kotel’nikova A.N. On a differential interception game. Proc. Steklov Inst. Math., 2010, vol. 268, no. 1, pp. 161–206. doi: 10.1134/S008154381001013X 

19.   Krasovskii N.N., Kotel’nikova A.N. Stochastic guide for a time-delay object in a positional differential game. Proc. Steklov Inst. Math., 2012, vol. 277, suppl. 1, pp. 145–151. doi: 10.1134/S0081543812050148 

20.   Krasovskii N.N., Subbotin A.I. Pozicionnye differencial’nye igry [Positional differential games]. Moscow: Nauka Publ., 1974, 458 p.

21.   Krasovskii N.N., Subbotin A.I. Game-theoretical control problems. NY: Springer, 1988, 517 p.  ISBN: 978-1-4612-8318-8 .

22.   Laraki R., Solan E. The value of zero-sum stopping games in continuous time. SIAM J. Control Optim., 2005, vol. 43, no. 5, pp. 1913–1922. doi: 10.1137/S0363012903429025 

23.   Marin-Solano J., Shevkoplyas E. Non-constant discounting and differential games with random time horizon. Automatica, 2011, vol. 47, no. 12, pp. 2626–2638. doi: 10.1016/j.automatica.2011.09.010 

24.   Mazalov V.V. Dynamic games with optimal stopping. In: Game Theory and Applications, vol. 2, L.A. Petrosjan and V.V. Mazalov (eds.), NY: Nova Science Publ., 1996, pp. 37–46. ISBN: 1-56072-390-4 .

25.   Meyer P.-A. Probability and potentials. Massachusetts: Blaisdell Publ. Company, 1966, 266 p. Translated to Russian under the title Veroyatnost’ i potentsialy, Moscow: Mir Publ., 1973, 324 p.

26.   Neyman A. Continuous-time stochastic games. Games and Economic Behavior, 2017, vol. 104, pp. 92–130. doi: 10.1016/j.geb.2017.02.004 

27.   Prieto-Rumeau T., Hernandez-Lerma O. Selected topics on continuous-time controlled Markov chains and Markov games. London: Imperial College Press, 2012, Ser. ICP Advanced Texts in Math., vol 5, 279 p. ISBN: 978-1-84816-848-0 .

28.   Rockafellar R.T., Wets R.J.B. Variational analysis. Vol. 317. Berlin: Springer–Verlag, 2009, A Series of Comprehensive Studies in Mathematics, 734 p. ISBN: 978-3-540-62772-2 .

29.   Sorin S., Vigeral G. Reversibility and oscillations in zero-sum discounted stochastic games. J. Dyn. Games, 2015, vol. 2, no. 1, pp. 103–115. doi: 10.3934/jdg.2015.2.103 

30.   Subbotin A.I. Generalized solutions of first-order PDEs. The dynamical optimization perspective. Basel: Birkhauser, 1995, 314 p. doi: 10.1007/978-1-4612-0847-1 . Translated to Russian under the title Obobshchennye resheniya uravnenii v chastnykh proizvodnykh pervogo poryadka: Perspektivy dinamicheskoi optimizatsii, Moscow; Izhevsk: Inst. Komp’yuter. Issled. Publ., 2003, 336 p.

Cite this article as: D.V. Khlopin. Differential game with the possibility of early termination, Trudy Instituta Matematiki i Mekhaniki UrO RAN, 2021, vol. 27, no. 4, pp. 189–214.