Minimax Approach

Abstract

A bandit problem is interesting only if there are arms with unknown characteristics. To choose among the available arms a decision maker must first decide how to handle this uncertainty. In the first eight chapters of this monograph the approach used is to average the payoff over the unknown characteristics with respect to a specified prior distribution — a Bayesian approach, in statistical parlance.