Typing braille code in the air with the leap motion controller

Abstract

The paper presents the new concept of typing the Braille Code. Developed method use a Leap Motion controller to recognize fingers responsible for typing proper Braille dots in the air. The recognition of input characters bases on the analysis of coordinates of the hands, fingers, phalanges and hand joints in three-dimensional space, which is observed by the controller. The arrangement of the hands doesn’t affect the accuracy of typed codes. Proposed method is implemented in the form of desktop application for personal computers. The evaluation shows the writing speed (7.4 WPM) and the MSD error rate (13.18%) comparable to Braille virtual keyboards using touchscreen.