Discrete multi-armed bandits and multi-parameter processes

Abstract

The general multi-armed bandit problem is reformulated and solved as a control problem over a partially ordered set. The approach taken provides a technically convenient framework for bandit-like problems. It also adds insight to the structure of strategies over partially ordered sets. © 1986 Springer-Verlag.