This paper presents a system built for improving the evaluation process of multimodal dialogue systems by providing a graphical representation of event-based recording data. Low-level information from recordings can visually be combined to form higher-level actions using pattern definitions to create a hierarchy of actions. Actions are visually represented by a multitrack player-like view where all modalities of the recording can be watched and manipulated. But besides tagging and derivation of higher-level actions, further help is provided by a correlation analysis and an export of charts and tables to Microsoft Excel. The tool is tested on recording data and questionnaire answers obtained from Wizard of Oz (WOZ) experiments performed within the DICIT project. © 2008 Springer-Verlag Berlin Heidelberg.
CITATION STYLE
Wesseling, H., Bezold, M., & Beringer, N. (2008). Automatic evaluation tool for multimodal dialogue systems. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 5078 LNCS, pp. 297–305). https://doi.org/10.1007/978-3-540-69369-7_36
Mendeley helps you to discover research relevant for your work.