Abstract
The GIVE Challenge is a recent shared task in which NLG systems are evaluated over the Internet. In this paper, we validate this novel NLG evaluation methodology by comparing the Internet-based results with results we collected in a lab experiment. We find that the results delivered by both methods are consistent, but the Internetbased approach offers the statistical power necessary for more fine-grained evaluations and is cheaper to carry out. © 2009 ACL and AFNLP.
Cite
CITATION STYLE
Koller, A., Striegnitz, K., Byron, D., Cassell, J., Dale, R., Dalzel-Job, S., … Moore, J. (2009). Validating the web-based evaluation of NLG systems. In ACL-IJCNLP 2009 - Joint Conf. of the 47th Annual Meeting of the Association for Computational Linguistics and 4th Int. Joint Conf. on Natural Language Processing of the AFNLP, Proceedings of the Conf. (pp. 301–304). Association for Computational Linguistics (ACL). https://doi.org/10.3115/1667583.1667676
Register to see more suggestions
Mendeley helps you to discover research relevant for your work.
