Recognition of Drivers’ Hard and Soft Braking Intentions Based on Hybrid Brain-Computer Interfaces

Abstract

In this paper, we propose simultaneous and sequential hybrid brain-computer interfaces (hBCIs) that incorporate electroencephalography (EEG) and electromyography (EMG) signals to classify drivers’ hard braking, soft braking, and normal driving intentions to better assist driving for the first time. The simultaneous hBCIs adopt a feature-level fusion strategy (hBCI-FL) and classifier-level fusion strategies (hBCIs-CL). The sequential hBCIs include the hBCI-SE1, where EEG signals are prioritized to detect hard braking, and hBCI-SE2, where EMG signals are prioritized to detect hard braking. Experimental results show that the proposed hBCI-SE1 with spectral features and the one-vs-rest classification strategy performs best with an average system accuracy of 96.37% among hBCIs. This work is valuable for developing human-centric intelligent assistant driving systems to improve driving safety and driving comfort and promote the application of BCIs.