Submodularity-inspired data selection for goal-oriented chatbot training based on sentence embeddings

5Citations
Citations of this article
53Readers
Mendeley users who have this article in their library.

Abstract

Spoken language understanding (SLU) systems, such as goal-oriented chatbots or personal assistants, rely on an initial natural language understanding (NLU) module to determine the intent and to extract the relevant information from the user queries they take as input. SLU systems usually help users to solve problems in relatively narrow domains and require a large amount of in-domain training data. This leads to significant data availability issues that inhibit the development of successful systems. To alleviate this problem, we propose a technique of data selection in the low-data regime that enables us to train with fewer labeled sentences, thus smaller labelling costs. We propose a submodularity-inspired data ranking function, the ratio-penalty marginal gain, for selecting data points to label based only on the information extracted from the textual embedding space. We show that the distances in the embedding space are a viable source of information that can be used for data selection. Our method outperforms two known active learning techniques and enables cost-efficient training of the NLU unit. Moreover, our proposed selection technique does not need the model to be retrained in between the selection steps, making it time efficient as well.

Cite

CITATION STYLE

APA

Dimovski, M., Musat, C., Ilievski, V., Hossmann, A., & Baeriswyl, M. (2018). Submodularity-inspired data selection for goal-oriented chatbot training based on sentence embeddings. In IJCAI International Joint Conference on Artificial Intelligence (Vol. 2018-July, pp. 4019–4025). International Joint Conferences on Artificial Intelligence. https://doi.org/10.24963/ijcai.2018/559

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free