Multi-touch Interaction Data Analysis System (MIDAS) for 2-D tactile display research

Abstract

The study of haptic perception and cognition requires data about how humans interact with tactile surfaces in the context of performing cognitive tasks. MIDAS is a set of three tools for the digital capture, coding, analysis, and interpretation of time-series, multitouch, interactive behaviors on a tactile surface. The MIDAS-logger uses the current screen technology of tablet computers to capture touches (up to ten fingers at high spatial and temporal resolution) through conventional tactile graphics that are overlaid on the screen. The MIDAS-analyser is a software program for the qualitative and quantitative analysis of MIDAS-logger touch data, which includes a fully interactive visualization of the data and a yoked display of a conventional simultaneous video recording made of the interactions. MIDAS-tactile protocol analysis (TPA) provides a scheme and a method to enable the rich coding and interpretation of tactile behaviors over multiple spatial and temporal scales. The efficacy of MIDAS was assessed against a set of criteria drawn from the successes and limitations of prior approaches to the study of tactile interactions. To demonstrate the functions of MIDAS, its three components were used to capture, analyze, code, and interpret the behavior of an experienced user and an inexperienced user of tactile graphics as they performed a shape-matching task.