A Multi-modal Seq2seq Chatbot Framework

3Citations
Citations of this article
24Readers
Mendeley users who have this article in their library.

Abstract

The pandemic has forced young people to stay away from school and friends, complete online learning at home and live at home. Therefore, various mental illnesses such as anxiety and depression occur more frequently. Chatbot is a communication method that is more acceptable to young people. This paper proposes a multi-modal chatbot seq2seq framework, which divides the mental state of young people into different types through multi-modal information such as text and images entered by users in the chatbot. This model combines image description and text summarization modules with the attention mechanism in a multi-modal model to control related content in different modalities. Experiments on multi-modal data sets show that this method has 70% average accuracy and real users who use this system also believe that this method has good judgment ability.

Cite

CITATION STYLE

APA

Ji, Z. (2022). A Multi-modal Seq2seq Chatbot Framework. In Lecture Notes in Electrical Engineering (Vol. 942 LNEE, pp. 225–233). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-981-19-2456-9_24

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free