Two-player nonzero-sum stopping games in discrete time

Abstract

We prove that every two-player nonzero-sum stopping game in discrete time admits an ε-equilibrium in randomized strategies for every ε > 0. We use a stochastic variation of Ramsey's theorem, which enables us to reduce the problem to that of studying properties of ε-equilibria in a simple class of stochastic games with finite state space.