Designing responsive interactive applications by emotion-tracking and pattern-based dynamic user interface adaptation

Abstract

Model-based user interface development environments (MB-UIDEs) can be enhanced by pattern-based frameworks to allow for richer design capabilities and more flexible responsive behavior during the runtime of the implemented target application. In this paper an experimental system prototype for integrating facial analysis and eye-tracking into a pattern-based dynamic user interface adaptation process is discussed. The resulting system evaluates the emotional state of the system users to trigger the HCI-pattern-based adaptation of the user interface. By monitoring the emotional states of the users over longer time periods, while the system changes its behavior and its appearance, conclusions about the perceived quality dimensions of the interactive application can be drawn.