Collection and analysis of perceived information in chat-oriented dialogue

Abstract

Understanding the various information from user utterances is important for chatoriented dialogue systems. However, no study has yet clarified the types of information that should be understood by such systems. With this purpose in mind, we first collected information that humans perceive from each utterance (perceived information) in chat-oriented dialogue. We then categorized the types of perceived information. The types were evaluated on the basis of inter-annotator agreement, which showed substantial agreement and demonstrated the validity of our categorization. To the best of our knowledge, this study is the first attempt to clarify the types of information that a chatoriented dialogue system should understand from varied user utterances.