This paper describes a small-scale but organized attempt to evaluate output quality of several Japanese MT systems. The project also served as the first experiment of the implementation of the in-house MT evaluation guidelines created in 2000. Since time was limited and the budget was not infinite, it was launched with the following compact components: Five people; 300 source sentences per language pair; and 160 hours per evaluator. The quantitative results showed noteworthy phenomena. Although the test materials had been presented in a way that evaluators could not identify the performance of any particular system, the results were quite consistent.
CITATION STYLE
Darwin, M. (2001). Trial and Error: An Evaluation Project on Japanese <> English MT Output Quality. Congreso Sobre Traducción Automática, (8). Retrieved from http://www.eamt.org/summitVIII/papers/darwin.pdf
Mendeley helps you to discover research relevant for your work.