A Novel Extension for e-Safety Initiative Based on Developed Fusion of Biometric Traits

Abstract

Safety is one of the central elements of society functioning. The eSafety aims at increasing road safety through the use of intelligent integrated safety systems. This article presents the concept and PCB implementation of an on-board compact eCall device that can be installed at the owners' request in a used vehicle. The prototype includes accident and rollover detection, passenger detection, and GSM communication with the eCall PSAP service center. Two accident detection algorithms are implemented: the first relates to the collision detection based on exceeding the threshold of acceleration using an accelerometer to measure the dynamic force caused by movement and the gravity force, the second - the rollover detection based on exceeding the threshold of the vehicle angle of inclination using data coming from the accelerometer and a gyroscope. The prototype was tested in eight different test scenarios using laboratory accident simulators as well as during driving. The proposed solution of passenger detection is based on images coming from a built-in 360° view camera. In the authors' approach the obtained images were transformed into linear ones and subject to subsequent operations - initial processing, object detection and redundant detection filtering. The authors utilize biometric methods in object detection such as Viola-Jones and Single Shot MultiBox Detector for face localization, and You Look Only Once for whole body detection. An additional testing mechanism for passenger detection are seat pressure pads that are independent of camera detection. All necessary sensors and communication components verified by practical experiments have been integrated on the custom designed motherboard with the NVIDIA Jetson Nano processing module installed. The tests confirmed the performance is sufficient for rapid accident detection, real-time image analysis and all mandatory eCall communication functions. Results of experiments were promising, providing high accident and passenger detection rates.