Drowsiness Detection System through Eye and Mouth Analysis

Abstract

Traffic jams are one of the serious issues in many developed countries. After the pandemic, many employees were allowed to travel interstate to work. This contributes to more severe jams, especially in the capital and nearby states. Long-distance driving and congestion can easily make the drivers sleepy and thus lead to traffic accidents. This paper aims to study and analyze facial cues to detect early symptoms of drowsy driving. The proposed method employs a deep learning approach, utilizing ensemble CNNs and Dlib's 68 landmark face detectors to analyze the facial cues. The analyzed symptoms include the frequency of eyes opened or closed and yawning or no yawning. Three individual CNN models and an ensemble CNN structure are built for the classification of the eyes and mouth yawn. The model training and validation accuracy graph and training loss and validation loss graph are plotted to verify that the models have not been overfitted. The ensemble CNN models achieved an approximate accuracy of 97.4% from the eyes and 96.5% from the mouth. It outperforms the other pre-trained models. The proposed system can immediately alert the driver and send text drowsy messages and emails to the third party, ensuring timely intervention to prevent accidents. The proposed method can be integrated into vehicles and transportation systems to ensure driver's safety. It can also be applied to monitor the driving behavior of those who drive long distances.