Designing a Multimodal Graph System to Support Non-Visual Interpretation of Graphical Information

Abstract

While researchers have performed numerous studies to understand the human interpretation of visual graphs in reading, comprehending and interpreting displayed data; visually impaired (VI) users still face many challenges that prevent them from fully benefiting from these graphs. Thus, it influences their understanding of data visualization and in turn reduces their role in collaborating with their sighted colleagues in educational and working environments. We intend to develop a mobile application where visually impaired users can work together to build a collaborative graph that supported by data sonification in the mobile environment. The system properties were all tested by the task of identifying line trends in time series, which resulted in an accuracy of more than 80% for notes below 20 points. The usability testing has given result of 6.7 out 10 based on users' perception on the effectivity of the features.