Driver Mental Fatigue Detection Based on Head Posture Using New Modified reLU-BiLSTM Deep Neural Network

Early detection of driver mental fatigue is one of the active areas of research in smart and intelligent vehicles. There are various methods, based on measuring the physiological characteristics of the driver utilising sensors and computer vision, proposed in the literature. In general, driver behaviour is unpredictable that can suddenly change the nature of driving and dynamics under mental fatigue. This results in sudden variations in driver body posture and head movement, with consequent inattentive behaviour that can end in fatal accidents and crashes. In the process of delineating the different driving patterns of driver states while active or influenced by mental fatigue, this paper contributes to advancing direct measurement approaches. In the novel approach proposed in this paper, driver mental fatigue and drowsiness are measured by monitoring driver's head posture motions using XSENS motion capture system. The experiments were conducted on 15 healthy subjects on a MATHWORKS driver-in-loop (DIL) simulator, interfaced with Unreal Engine 4 studio. A new modified bidirectional long short-term memory deep neural network, based on a rectified linear unit layer, was designed, trained and tested on 3D time-series head angular acceleration data for sequence-to-sequence classification. The results showed that the proposed classifier outperformed state-of-art approaches and conventional machine learning tools, and successfully recognised driver's active, fatigue and transition states, with overall training accuracy of 99.2%, sensitivity of 97.54%, precision and F1 scores of 97.38% and 97.46%, respectively. The limitations of the current work and directions for future work are also explored.

Automated summary

Early detection of driver mental fatigue is crucial in smart vehicles research. The unpredictability of driver behavior under mental fatigue can lead to fatal accidents. This study proposes a novel approach using motion capture system to monitor head posture motions for measuring mental fatigue and drowsiness. The results show promising accuracy in recognizing driver states.