Advantage of prediction and mental imagery for goal-directed behaviour in agents and robots

Abstract

Mental imagery and planning are important aspects of cognitive behaviour. Being able to predict outcomes through mental simulation can increase environmental fitness and reduce uncertainty. Such predictions reduce surprise and fit with thermodynamically driven theories of brain function by attempting to reduce entropy. In the present work, the authors tested these ideas in a predator–prey scenario where agents with a limited energy budget had to maximise food intake, while avoiding a predator. Forward planning agents, with the ability to mentalise, to Actor Critic agents that do not plan beyond the current state were also compared. The authors show that the ability to mentalise has distinct advantages when in noisy, uncertain stimuli. These advantages are even more prevalent when tested in the real world on physical robots. The authors’ results highlight the importance of taking into consideration mental imagery and embodiment when constructing artificial cognitive systems.