CALMsystem: A Conversational Agent for Learner Modelling

Abstract

This paper describes a system which incorporates natural languagetechnologies, database manipulation and educational theories in order tooffer learners a Negotiated Learner Model, for integration into anIntelligent Tutoring System. The system presents the learner with theirlearner model, offering them the opportunity to compare their ownbeliefs regarding their capabilities with those inferred by the system.A conversational agent, or `' chatbot `' has been developed to allow thelearner to negotiate over the representations held about them usingnatural language. The system aims to support the metacognitive goals ofself-assessment and reflection, which are increasingly seen as key tolearning and are being incorporated into UK educational policy. Thepaper describes the design of the system, and reports a user trial, inwhich the chatbot was found to support users in increasing the accuracyof their self-assessments, and in reducing the number of discrepanciesbetween system and user beliefs in the learner model. Some lessonslearned in the development have been highlighted and future research andexperimentation directions are outlined.