How Do We Answer Complex Questions: Discourse Structure of Long-form Answers

11Citations
Citations of this article
69Readers
Mendeley users who have this article in their library.

Abstract

Long-form answers, consisting of multiple sentences, can provide nuanced and comprehensive answers to a broader set of questions. To better understand this complex and understudied task, we study the functional structure of long-form answers collected from three datasets, ELI5 (Fan et al., 2019), WebGPT (Nakano et al., 2021) and Natural Questions (Kwiatkowski et al., 2019). Our main goal is to understand how humans organize information to craft complex answers. We develop an ontology of six sentence-level functional roles for long-form answers, and annotate 3.9k sentences in 640 answer paragraphs. Different answer collection methods manifest in different discourse structures. We further analyze model-generated answers - finding that annotators agree less with each other when annotating model-generated answers compared to annotating human-written answers. Our annotated data enables training a strong classifier that can be used for automatic analysis. We hope our work can inspire future research on discourse-level modeling and evaluation of long-form QA systems.

References Powered by Scopus

Rhetorical Structure Theory: Toward a functional theory of text organization

2534Citations
N/AReaders
Get full text

Natural Questions: A Benchmark for Question Answering Research

1804Citations
N/AReaders
Get full text

Datasheets for datasets

801Citations
N/AReaders
Get full text

Cited by Powered by Scopus

WEBCPM: Interactive Web Search for Chinese Long-form Question Answering

28Citations
N/AReaders
Get full text

DAPIE: Interactive Step-by-Step Explanatory Dialogues to Answer Children's Why and How Questions

16Citations
N/AReaders
Get full text

WikiHowQA: A Comprehensive Benchmark for Multi-Document Non-Factoid Question Answering

12Citations
N/AReaders
Get full text

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Cite

CITATION STYLE

APA

Xu, F., Li, J. J., & Choi, E. (2022). How Do We Answer Complex Questions: Discourse Structure of Long-form Answers. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (Vol. 1, pp. 3556–3572). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/2022.acl-long.249

Readers over time

‘22‘23‘24‘25010203040

Readers' Seniority

Tooltip

PhD / Post grad / Masters / Doc 12

50%

Researcher 10

42%

Professor / Associate Prof. 1

4%

Lecturer / Post doc 1

4%

Readers' Discipline

Tooltip

Computer Science 21

70%

Linguistics 4

13%

Social Sciences 4

13%

Chemistry 1

3%

Save time finding and organizing research with Mendeley

Sign up for free
0