Attention Mechanism in Machine Translation

Abstract

Machine translation is an important field in machine learning. In recent years, the way to improve the effect of machine translation through attention mechanism has been well introduced and developed, and has become an important research part in machine translation. However, how to use the attention mechanism to ensure the translation speed and accuracy at the same time has also become an important problem for researchers to solve. In this article, we will introduce the development process of attention mechanism in the field of machine translation, and introduce in detail the algorithm changes of four papers on the development of Attention in Machine translation. Through the analysis of their experimental data, the development level of attention mechanism in the field of machine translation is shown.