Incorporating perception-based information in reinforcement learning using computing with words

Abstract

In this paper, a general fuzzy reinforcement learning (FRL) agent that can utilise not only measurement-based information but also perception-based information by means of computing with words (CW) is proposed. By introducing fuzzy numbers and their arithmetic operations and fuzzy Lyapunov synthesis in the domain of CW, a set of stable fuzzy control rules can be derived from perception-based information. Moreover, based on a neuro-fuzzy network architecture, the fuzzy rules can be incorporated in the FRL agent to initialise its action network, critic network and evaluation feedback module so as to improve the learning. The performance and applicability of the proposed approach are illustrated through the practical implementation of learning control of an autonomous pole-balancing mobile robot. © Springer-Verlag Berlin Heidelberg 2001.