On-line training of ESN and IP tuning effect

Abstract

In the present paper we investigate influence of IP tuning of Echo state network (ESN) reservoir on the overall behavior of the on-line trained adaptive critic network. The experiments were done using Adaptive Critic Design (ACD) scheme with on-line trainable ESN critic for real time control of a mobile laboratory robot. Comparison of behavior of ESN critics trained with and without IP tuning showed that IP algorithm improved critic behavior significantly. It was observed that IP tuning prevents uncontrolled increase of reservoir output weights during on-line training. © 2014 Springer International Publishing Switzerland.