How accurately can the google web speech API recognize and transcribe Japanese L2 english learners' oral production?

Abstract

The ultimate aim of our research project was to use the Google Web Speech API to auto mate scoring of elicited imitation (EI) tests. However, in order to achieve this goal, we had to take a number of preparatory steps. We needed to assess how accurate this speech rec ognition tool is in recognizing native speakers' production of the test items; we had to assess its accuracy with our Japanese EFL learners; and, on the basis of these trials, we needed to evaluate the potential for using the ApI for our purposes. Through comparing our own assessments of the learners' pronunciation with the system's ability to transcribe utter ances, we were able to ascertain that the learners' pronunciation of certain sounds is probably the single biggest reason for a fall in recognition accuracy compared to native speaker input. However, we argue that pro nunciation may not be an insurmountable barrier to using this speech recognition sys tem for our EFL purposes. By going through this double screening process, we feel we have arrived at a set of items which can be used to assess student's grammatical ability in an EI test using a custom Google Web Speech system.