Word deletion (WD) problems have a critical impact on the adequacy of translation and can lead to poor comprehension of lexical meaning in the translation result. This paper studies how the word deletion problem can be handled in statistical machine translation (SMT) in detail. We classify this problem into desired and undesired word deletion based on spurious and meaningful words. Consequently, we propose four effective models to handle undesired word deletion. To evaluate word deletion problems, we develop an automatic evaluation metric that highly correlates with human judgement. Translation systems are simultaneously tuned for the proposed evaluation metric and BLEU using minimum error rate training (MERT). The experimental results demonstrate that our methods achieve significant improvements in word deletion problems on Chinese-to-English translation tasks.
CITATION STYLE
Li, Q., Zhang, D., Li, M., Xiao, T., & Zhu, J. (2016). Better addressing word deletion for statistical machine translation. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 10102, pp. 91–102). Springer Verlag. https://doi.org/10.1007/978-3-319-50496-4_8
Mendeley helps you to discover research relevant for your work.