What is it? How to collect urgent utterances using a gamification approach

Abstract

Many modern cars today have voice assistants. The problem is that current in car speech interfaces are mostly designed for certain commands in a very restricted form. In the future, these interfaces will have to deal with more complex user input like several intentions in one utterance or quick urgent insertions. Especially in rapidly changing situations like during a highly automated journey, it becomes relevant to detect urgent utterances and react accordingly. Collecting data by reproducing the conditions for the interaction in a real vehicle can by very difficult. Therefore we propose, to abstract the problem and use a gamification approach. We successfully simulated urgent situations and collected spoken utterances with the game "What is it?".