M.S. Nikol’skii. On the maximal guaranteed payoff in some problems of conflict control of multistep processes ... P. 167-172

We consider multistep conflict-controlled processes with two controlling partners. The duration of the process is fixed, and there are no constraints on the right end of the discrete trajectory. The first player aims to maximize the terminal functional without information about the future behavior of the second player. We study the important notion of maximal guaranteed payoff of the first player using the ideas of Bellman’s dynamic programming method. Based on this method, a formula for the maximal guaranteed payoff is derived in Theorem 1 under broad assumptions on the conflict-controlled process. In Theorem 2, we obtain sufficient conditions under which the corresponding functions of Bellman type are Lipschitz. Two examples are considered.

Keywords: discrete controlled processes, conflict, dynamical programming

Received November 4, 2019

Revised February 5, 2020

Accepted February 10, 2020

Mikhail Sergeevich Nikolskii, Dr. Phys.-Math. Sci, Steklov Mathematical Institute of the Russian Academy of Science, Moscow, 119991 Russia, e-mail: mni@mi-ras.ru

REFERENCES

1.   Petrosyan L.A., Zenkevich N.A., Semina E.A. Teoriya igr [Game theory]. Moscow: Vysshaya Shkola Publ., 1998, 302 p. ISBN: 5-06-001005-8 .

2.   Zhukovskii V.I., Salukvadze M.E. Otsenka riskov i mnogoshagovye pozitsionnye konflikty [Estimations of risks and multistep position conflicts]. Moscow: Urait Publ., 2018, 304 p. ISBN: 978-5-534-08782-6 .

3.   Gorelov M.A., Kononenko A.F. Dynamical conflict models. I. Language of modeling. Autom. Remote Control, 2014, vol. 75, no. 11, pp. 1996–2013. doi: 10.1134/S0005117914110083 

4.   Krasovskii N.N., Subbotin A.I. Game-theoretical control problems. N Y: Springer, 1988, 517 p. ISBN: 978-1-4612-8318-8 . Original Russian text published in Krasovskii N.N., Subbotin A.I. Pozitsionnye differentsial’nye igry. Moscow: Nauka Publ., 1974, 456 p.

Cite this article as: M.S. Nikolskii. On the maximal guaranteed payoff in some problems of conflict control of multistep processes, Trudy Instituta Matematiki i Mekhaniki URO RAN, 2020, vol. 26, no. 1, pp. 167–172; Proceedings of the Steklov Institute of Mathematics (Suppl.), 2021, Vol. 313, Suppl. 1, pp. S169–S174.