Measuring the capability of a speech translation system

Abstract

This chapter introduces an evaluation method for speech translation systems. Since the method estimates the system’s capability in a commonly known English proficiency measurement score such as TOEIC, the evaluation results are very comprehensible not only for researchers but also for system users. This chapter also formulates the evaluation errors and discusses the costs necessary for evaluation. Lastly, we provide a solution to the evaluation cost issue by applying an automatic evaluation method.