ConvLab-2: An open-source toolkit for building, evaluating, and diagnosing dialogue systems

71Citations
Citations of this article
162Readers
Mendeley users who have this article in their library.

Abstract

We present ConvLab-2, an open-source toolkit that enables researchers to build task-oriented dialogue systems with state-of-the-art models, perform an end-to-end evaluation, and diagnose the weakness of systems. As the successor of ConvLab (Lee et al., 2019b), ConvLab-2 inherits ConvLab’s framework but integrates more powerful dialogue models and supports more datasets. Besides, we have developed an analysis tool and an interactive tool to assist researchers in diagnosing dialogue systems. The analysis tool presents rich statistics and summarizes common mistakes from simulated dialogues, which facilitates error analysis and system improvement. The interactive tool provides a user interface that allows developers to diagnose an assembled dialogue system by interacting with the system and modifying the output of each system component.

Cite

CITATION STYLE

APA

Zhu, Q., Zhang, Z., Fang, Y., Li, X., Takanobu, R., Li, J., … Huang, M. (2020). ConvLab-2: An open-source toolkit for building, evaluating, and diagnosing dialogue systems. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (pp. 142–149). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/2020.acl-demos.19

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free