Human gaze tracking with an active multi-camera system

Abstract

This paper presents a framework for determining the direction of human gaze with an active multi-camera system. A fixed camera is employed in order to estimate the position of the human face and its features, like the eyes. By means of the Supervised Descent Method (SDM) for minimizing a Non-linear Least Squares (NLS) function we can compute correctly the position of the two eyes using 6 landmarks for each of them and the pose of the head. Then an active pan-tilt camera is oriented to one of the users eyes. This way a high precision gaze direction determination is accomplished.