A new gesture control for zooming on tablets and smartphones for visually impaired people

Abstract

We propose a new interaction model for zooming in and out the screen content of smartphones and tablets for visually impaired people. It consists in gestures that are captured by the front-facing camera to control the zooming factor and to scroll in the zoomed-in image. A first prototype involving video processing has been developed. As it avoids using a hand to touch the screen, this interaction model is interesting for other mobile applications. Human factor study and tests has been performed on visually impaired people and operators using assistance with augmented reality on tablets.