The CaMeLi framework—A multimodal virtual companion for older adults

Abstract

Artificial Social Companions are a promising solution for the increasing challenges in elderly care. This chapter describes the CaMeLi autonomous conversational agent system which simulates human-like affective behaviour and acts as a companion for older adults living alone at home. The agent employs synthetic speech, gaze, facial expressions, and gestures to support multimodal natural interaction with its users and assists them in a number of daily life scenarios.We present the agent’s overall architecture, with a focus on the perception, decision making and synthesis components which give rise to the agent’s intelligent affective behavior. The agent was evaluated in an exploratory study where it was introduced in 20 homes of older adults (aged 65+) in three European countries (Switzerland, the Netherlands, Portugal) for a total duration of 12 weeks. We present the results of the evaluation study with regards to acceptance, perceived usability, and usefulness of the agent, and discuss future opportunities for fellow researchers who are striving to bring virtual agents out of the laboratories into successful real world applications.