Natural interaction in video image investigation and its evaluation

Abstract

Video image investigation has become an important way to protect the public security. Traditional paper-based investigation method lacks of natural interactive tools to organize case and clue information, leading to poor work efficiency and performance. By interviewing professional video analysts, the current study developed the mental model of the video image investigation and designed an interactive video image investigation system based on the mental model. To evaluate the naturalness and the efficiency of the newly designed system, a user study were conducted involving 28 volunteers. Half of them used the interactive video image investigation system, while the other half used traditional paper-based method to complete an investigation task with a set of real surveillance videos. Through the analysis of brain activity and behavioral indices, we found that the proposed interactive video image investigation system led to higher work efficiency, lower mental workload, and more positive emotional experience or approach motivational tendencies compared to traditional paper-based method. These results suggested the potential application of efficiency, mental workload, and emotional experience for the evaluation of the naturalness of an interactive system.