We propose a new approach toward evaluation of spoken dialog systems. The novelty of our method is based on utilization of domain-specific knowledge combined with the deterministic measurement of dialog system performance on a set of individual tasks within the domain. The proposed methodology thus attempts to answer questions such as: "How well is my dialog system performing on a specific domain?", "How much has my dialog system improved since the previous version?", "How much is my dialog system better/worse than other dialog systems performing on that domain?" © 2009 Springer Berlin Heidelberg.
CITATION STYLE
Kleindienst, J., Cuřín, J., & Labský, M. (2009). ADiEU: Toward domain-based evaluation of spoken dialog systems. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 5610 LNCS, pp. 287–294). https://doi.org/10.1007/978-3-642-02574-7_32
Mendeley helps you to discover research relevant for your work.