Multimodal discussion analysis based on temporal sequence

Abstract

This research proposes a novel method for analysis of discussion record. One of the important features of our approach is to use both a logical analysis method and a word occurrence analysis method. A subject of discussion is analyzed and important issue factors are listed before the discussion starts. The logical analysis method describes the structure of the discussion referring to the issue factors. The word occurrence analysis method recognizes key topics and key utterance by observing utterances and nonverbal information such as action, facial expressions and so on.