Fatigue state detection based on multi-index fusion and state recognition network

Abstract

Fatigued driving detection in complex environments is a challenging problem. This paper proposes a fatigued driving detection algorithm based on multi-index fusion and a state recognition network, for further analysis of driver fatigue states. This study uses a multi-task cascade convolutional neural network for face detection and facial key point detection, corrects the face according to the key points of the eye, intercepts a binoculus image to recognize the eye state, and intercepts a mouth image according to the left and right corner points to recognize the mouth state. This can improve the detection accuracy of the driver's head tilt, deflection, and so on. Next, an eye state recognition network is constructed for the binoculus image to identify the eye closure state, and a mouth state recognition network is used to identify the mouth state. Finally, a fatigue judgment model is established by combining the two characteristics of the eye state and the mouth state to further analyze the driver fatigue state. The algorithm achieved 98.42% detection accuracy on a public eye dataset and achieved 97.93% detection accuracy on an open mouth dataset. As compared with other existing algorithms, the proposed algorithm has the advantages of high accuracy and simple implementation.