Few-shot relation classification by context attention-based prototypical networks with BERT

18Citations
Citations of this article
37Readers
Mendeley users who have this article in their library.

This article is free to access.

Abstract

Human-computer interaction under the cloud computing platform is very important, but the semantic gap will limit the performance of interaction. It is necessary to understand the semantic information in various scenarios. Relation classification (RC) is an import method to implement the description of semantic formalization. It aims at classifying a relation between two specified entities in a sentence. Existing RC models typically rely on supervised learning and distant supervision. Supervised learning requires large-scale supervised training datasets, which are not readily available. Distant supervision introduces noise, and many long-tail relations still suffer from data sparsity. Few-shot learning, which is widely used in image classification, is an effective method for overcoming data sparsity. In this paper, we apply few-shot learning to a relation classification task. However, not all instances contribute equally to the relation prototype in a text-based few-shot learning scenario, which can cause the prototype deviation problem. To address this problem, we propose context attention-based prototypical networks. We design context attention to highlight the crucial instances in the support set to generate a satisfactory prototype. Besides, we also explore the application of a recently popular pre-trained language model to few-shot relation classification tasks. The experimental results demonstrate that our model outperforms the state-of-the-art models and converges faster.

References Powered by Scopus

GloVe: Global vectors for word representation

26881Citations
N/AReaders
Get full text

Human-level concept learning through probabilistic program induction

2160Citations
N/AReaders
Get full text

Attention-based bidirectional long short-term memory networks for relation classification

1966Citations
N/AReaders
Get full text

Cited by Powered by Scopus

Cluster & Tune: Boost Cold Start Performance in Text Classification

17Citations
N/AReaders
Get full text

Few-Shot Emotion Recognition in Conversation with Sequential Prototypical Networks

15Citations
N/AReaders
Get full text

Enhance prototypical networks with hybrid attention and confusing loss function for few-shot relation classification

10Citations
N/AReaders
Get full text

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Cite

CITATION STYLE

APA

Hui, B., Liu, L., Chen, J., Zhou, X., & Nian, Y. (2020). Few-shot relation classification by context attention-based prototypical networks with BERT. Eurasip Journal on Wireless Communications and Networking, 2020(1). https://doi.org/10.1186/s13638-020-01720-6

Readers over time

‘20‘21‘22‘23‘24‘2505101520

Readers' Seniority

Tooltip

PhD / Post grad / Masters / Doc 13

72%

Researcher 3

17%

Professor / Associate Prof. 2

11%

Readers' Discipline

Tooltip

Computer Science 11

69%

Engineering 2

13%

Business, Management and Accounting 2

13%

Neuroscience 1

6%

Save time finding and organizing research with Mendeley

Sign up for free
0