Does a pedagogical agent’s gesture frequency assist advanced foreign language users with learning declarative knowledge?

Abstract

Since the conception of pedagogical agents in multimedia environments, researchers have advocated for agents to be designed to exhibit social cues that prime the social interaction of the target audience. One powerful social cue has been agent gesturing. While most agents are created only to use deictic (pointing) gestures, there is recent evidence that agents that perform all gesture types (iconic, metaphoric, deictic, and beat) with enhanced frequency help foreign language users learn more procedural knowledge. Therefore, this research examines how all gesture types and different frequencies influence agent persona and learning outcomes when foreign language users learn declarative knowledge. The results indicated that the use of gestures, regardless of frequency, significantly increase agent persona. However, gesture frequency produced conflicting learning outcomes. While enhancing gestures were beneficial for cued recall and recognition, the average gesture condition was not, which indicates that the strength of social cues is important.