Neural networks as a learning component for designing board games

Abstract

In this paper we present a new strategy game, with machine learning computer players, which have been developed using temporal difference reinforcement learning coupled with neural networks; the latter are used for value approximation and for storing the players’ knowledge. We set out the game rules and then design and implement a comprehensive experimentation session to allow us to explore a large state space for investigating learning and playing behavior, without placing unreasonable demands on speed and accuracy. Our experiments demonstrate how computer players manage to adapt to their environment and improve their tactic over time, based on experience only, while still accommodating a variety of behaviors which are tuned via the conventional parameters of the reinforcement learning and neural network mechanisms.