EdgeSonic : Image Feature Sonification for the Visually Impaired Categories and Subject Descriptors

  • Yoshida T
  • Kitani K
  • Belongie S
 et al. 
  • 49

    Readers

    Mendeley users who have this article in their library.
  • 13

    Citations

    Citations of this article.

Abstract

We propose a framework to aid a visually impaired user to recognize objects in an image by sonifying image edge features and distance-to-edge maps. Visually impaired people usually touch objects to recognize their shape. However, it is difficult to recognize objects printed on flat surfaces or objects that can only be viewed from a distance, solely with our haptic senses. Our ultimate goal is to aid a visually impaired user to recognize basic object shapes, by transposing them to aural information. Our proposed method provides two types of image sonification: (1) local edge gradient sonification and (2) sonification of the distance to the closest image edge. Our method was implemented on a touch-panel mobile device, which allows the user to aurally explore image context by sliding his finger across the image on the touch screen. Preliminary experiments show that the combination of local edge gradient sonification and distance-to-edge sonification are effective for understanding basic line drawings. Furthermore, our tests show a significant improvement in image understanding with the introduction of proper user training.

Author-supplied keywords

  • image sonification
  • sensory substitution
  • visually impaired

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in

Find this document

Authors

  • Tsubasa Yoshida

  • Kris M Kitani

  • Serge Belongie

  • Kevin Schlei

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free