xUnit-like TT4V: Text-based Testing Environment for Voice-based Services

Abstract

Like traditional software products, voice-based services should be tested. However, during testing, the service is activated and executed by a spoken command. Speaking the command for every test case would be very time consuming. TT4V saves testing time by enabling text-form test cases instead of voice-form test cases. It implements an xUnit-style interface. xUnit has been a de facto standard framework for testing tools for many years. Without TT4V, we roughly measured the time to speak 55 commands, listen to 55 responses, and then verify the correctness of the responses. First, we ran five of the 55 test cases without TT4V, and it took 28.03 seconds. For 55 test cases, it would be multiplied by 11 roughly. We ran 55 test cases using TT4V. It took only 0.61 seconds from executing the test cases to showing the analysis of the testing results.