An evaluation methodology for automatic transcription system of radiology reports

Abstract

This research combines knowledge from Computer Science and Health Science in order to propose an evaluation methodology for Automatic Transcription System of Radiology Reports. This methodology was designed based on Voice User interface requirements and specific requirements of automatic transcription systems of Radiology report. The same methodology was previously validated through some inspections and usability tests outside the hospital environment and, afterwards, it was used in two hospitals in São Paulo city. This approach aims to reduce costs of testing and available time by radiologists interviewed. Thus, the final product in this work consists of a set of criteria for evaluation of usability, comprising the name of the metric, evaluating method, steps to be followed and material to be used. By the use of this set, the evaluators can process the results of each requirement from the software. © 2011 Springer-Verlag.