A Deep Neural Network for Real-Time Driver Drowsiness Detection

Abstract

We develop a deep neural network (DNN) for detect- ing driver drowsiness in videos. The proposed DNN model that receives driver’s faces extracted from video frames as inputs consists of three com- ponents - a convolutional neural network (CNN), a convolutional control gate-based recurrent neural network (ConvCGRNN), and a voting layer. The CNN is to learn facial representations from global faces which are then fed to the ConvCGRNN to learn their temporal dependencies. The voting layer works like an ensemble of many sub-classifiers to predict drowsi- ness state. Experimental results on the NTHU-DDD dataset show that our model not only achieve a competitive accuracy of 84.81% without any post- processing but it can work in real-time with a high speed of about 100 fps.