Improving a neural semantic parser by counterfactual learning from human bandit feedback

25Citations
Citations of this article
131Readers
Mendeley users who have this article in their library.

Abstract

Counterfactual learning from human bandit feedback describes a scenario where user feedback on the quality of outputs of a historic system is logged and used to improve a target system. We show how to apply this learning framework to neural semantic parsing. From a machine learning perspective, the key challenge lies in a proper reweighting of the estimator so as to avoid known degeneracies in counterfactual learning, while still being applicable to stochastic gradient optimization. To conduct experiments with human users, we devise an easy-to-use interface to collect human feedback on semantic parses. Our work is the first to show that semantic parsers can be improved significantly by counterfactual learning from logged human feedback data.

Cite

CITATION STYLE

APA

Lawrence, C., & Riezler, S. (2018). Improving a neural semantic parser by counterfactual learning from human bandit feedback. In ACL 2018 - 56th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers) (Vol. 1, pp. 1820–1830). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/p18-1169

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free