Learning analytics in mobile applications based on multimodal interaction

Abstract

One of the most valuable skills for teachers is the ability to produce their own digital solutions, translating teaching concepts into end-user computer systems. This often requires the involvement of computing specialists. As a result, the development of educational programming environments remains a challenge. Learning experiences based multimodal interaction applications (gesture interaction, voice recognition or artificial vision) are becoming commonplace in education because they motivate and involve students. This chapter analyses the state-of-the-art in LA techniques and user-friendly authoring tools. It presents a tool to support the creation of multimodal interactive applications equipped with non-intrusive monitoring and analytics capabilities. This tool enables teachers with no programming skills to create interactive LA-enriched learning scenarios. To this end, several components that manage LA activities are included in the tool, they range from automatically capturing users’ interaction with mobile applications, to querying data and retrieving metrics, to visualising tables and charts.