Chinese language learners evaluating machine translation accuracy

Abstract

With increasingly rapid advances in machine translation (MT) technology, such as Google Translate, MT has become an indispensable learning resource for second or additional language learners. Many studies indicate that MT or postediting of MT (PEMT) can be an effective tool for L2 learning and teaching. Nevertheless, little research illustrates how language learners judge or evaluate the accuracy of MT output. The judgement of MT accuracy is essential because MT is not yet error-free. Therefore, the aim of this research is to explore how L2 learners attempt to judge the accuracy of MT output when using MT or PEMT. This study was undertaken through a teaching intervention in an online English-Chinese translation course. Student participants included L2 learners of Chinese studying at a university in Taiwan. Findings from observations of screen recordings and focus group discussions reveal that students use different MT tools and additional online-based resources as complementary strategies to better judge MT accuracy. These include: 1) using more than one MT tool to cross-check MT output; 2) using dictionaries to check word meaning and word usage by looking at example sentences; 3) using search engines to check word definitions, translations, and collocations.