Deep Learning Based Face Recognition Application with Augmented Reality Devices

Abstract

Augmented reality devices such as the Microsoft HoloLens are currently in development and have potential uses in many applications. These devices allow the user to interact with holograms projected into their surroundings. Because the augmented reality devices can project into the user’s environment, one potential application for these devices is in recognizing and labeling objects and people in the user’s view. This paper describes a deep learning based method that uses a deep Convolutional Neural Network (CNN) with the HoloLens to recognize and classify individual faces in a scene.