Deep Hierarchical Attention Flow for Visual Commonsense Reasoning

3Citations
Citations of this article
2Readers
Mendeley users who have this article in their library.
Get full text

Abstract

Visual Commonsense Reasoning (VCR) requires a thoroughly understanding general information connecting language and vision, as well as the background world knowledge. In this paper, we introduce a novel yet powerful deep hierarchical attention flow framework, which takes full advantage of text information in the query and candidate responses to perform reasoning over the image. Moreover, inspired by the success of machine reading comprehension, we also model the correlation among candidate responses to obtain better response representations. Extensive quantitative and qualitative experiments are conducted to evaluate the proposed model. Empirical results on the benchmark VCR1.0 show that the proposed model outperforms existing strong baselines, which demonstrates the effectiveness of our method.

Cite

CITATION STYLE

APA

Song, Y., & Jian, P. (2020). Deep Hierarchical Attention Flow for Visual Commonsense Reasoning. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 12430 LNAI, pp. 16–28). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-60450-9_2

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free