Multidimensional Quality Metrics (MQM): A Framework for Declaring and Describing Translation Quality Metrics

Abstract

In recent years translation quality evaluation has emerged as a major, and at times contentious, topic. Despite a focus on systematizing the evaluation of translation quality, the industry landscape is still highly fragmented, in part because different kinds of translation projects require very different evaluations of quality. In addition, human and machine translation (MT) quality evaluation methods have been fundamentally different in kind, preventing comparison of MT with human translation. The lack of clarity has contributed to an environment in which requesters of translation often cannot be certain whether or not a translation meets their needs or the needs of end users and where providers are unclear about what requesters need and want. In response the EU-funded QTLaunchPad project has developer the Multidimensional Quality Metrics (MQM) framework, an open an extensible system for declaring and describing translation quality metrics using a shared vocabulary of “issue types”.