4.7 Article

Real-Time Multistep Time-Series Prediction of Driver's Head Pose During IVIS Secondary Tasks for Human-Machine Codriving and Distraction Warning Systems

期刊

IEEE SENSORS JOURNAL
卷 22, 期 24, 页码 24364-24379

出版社

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/JSEN.2022.3216057

关键词

Attention mechanism; bidirectional long short-term memory (BiLSTM); convolutional neural network (CNN); head pose prediction; hybrid prediction model; time-series data

资金

  1. National Key Research and Development Program of China [2018YFB1600500]

向作者/读者索取更多资源

An innovative scheme is proposed for accurate prediction of a driver's head pose in the in-vehicle information system tasks. By collecting real-world data on driver behavior and vehicle state under different road conditions, a combination of machine-learning-based method and geometric method is used to estimate the head pose. The proposed model outperforms other models in prediction steps.
An accurate prediction of a driver's head pose in the in-vehicle information system (IVIS) tasks is essential for both distraction warning and vehicle takeover rule-making in human-machine codriving. In this study, a real-world experiment is conducted to collect data on driver behavior and vehicle state during the IVIS tasks under different road conditions. An innovative scheme is proposed for multistep time-series prediction of a driver's head pose. The proposed scheme consists of two main parts: a data-processing module and a model module. Furthermore, a combination of a machine-learning-based method and a geometric method is used to estimate a driver's head pose, and the MediaPipe model is used to extract the hand data. In the model module, a convolutional neural network (CNN), which can automatically capture short-term local dependencies in the head pose data, and a bidirectional long short-term memory (BiLSTM), which can capture long-term macro dependencies, are combined. In addition, an attention mechanism is used to weigh important time periods and variables. Finally, the performance of the proposed hybrid CNN-BiLSTM-attention model in the head pose prediction is validated, and the proposed model is compared with three traditional machine-learning-based models and the CNN-BiLSTM model. The comparison results show that the proposed model outperforms the other models in the prediction steps and can provide reliable driver's head pose data for distraction warning and takeover rules.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据