Single Fingertip Detection Using Simple Geometric Properties of the Hand Image: A Case Study for Augmented Reality in an Educational App

Abstract

We propose a fingertip detection method suitable for portable devices’ applications where the user can interact with objects or interface elements located in the augmented space. The method has been experimentally implemented in the context of an application that uses a board containing ArUco markers [1]. The user can press virtual buttons laid on the board or drag items along predetermined paths on the board level by extending the index finger (or thumb) and placing its edge on the object of interest, while the other hand holds the device so that both the object and the hand are visible. We present brief but indicative results of our technique.