Cross-lingual transfer of knowledge in distributional language models: Experiments in Hungarian

1Citations
Citations of this article
6Readers
Mendeley users who have this article in their library.

Abstract

In this paper, we argue that the very convincing performance of recent deep-neural-model-based NLP applications has demonstrated that the distributionalist approach to language description has proven to be more successful than the earlier subtle rule-based models created by the generative school. The now ubiquitous neural models can naturally handle ambiguity and achieve human-like linguistic performance with most of their training consisting only of noisy raw linguistic data without any multimodal grounding or external supervision refuting Chomsky's argument that some generic neural architecture cannot arrive at the linguistic performance exhibited by humans given the limited input available to children. In addition, we demonstrate in experiments with Hungarian as the target language that the shared internal representations in multilingually trained versions of these models make them able to transfer specific linguistic skills, including structured annotation skills, from one language to another remarkably efficiently.

Cite

CITATION STYLE

APA

Novák, A., & Novák, B. (2022). Cross-lingual transfer of knowledge in distributional language models: Experiments in Hungarian. Acta Linguistica Academica, 69(4), 405–449. https://doi.org/10.1556/2062.2022.00580

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free