Search

An eye-movement-based predicted trajectory guidance control (ePTGC) is proposed to mitigate the maneuverability degradation of a teleoperated ground vehicle caused by communication delays. Human sensitivity to delays is the main reason for the performance degradation of a ground vehicle teleoperation system. The proposed framework extracts human intention from eye-movement. Then, it combines it with contextual constraints to generate an intention-compliant guidance trajectory, which is then employed to control the vehicle directly. The advantage of this approach is that the teleoperator is removed from the direct control loop by using the generated trajectories to guide vehicle, thus reducing the adverse sensitivity to delay. The delay can be compensated as long as the prediction horizon exceeds the delay. A human-in-loop simulation platform is designed to evaluate the teleoperation performance of the proposed method at different delay levels. The results are analyzed by repeated measures ANOVA, which shows that the proposed method significantly improves maneuverability and cognitive burden at large delay levels (>200 ms). The overall performance is also much better than the PTGC which does not employ the eye-movement feature., Comment: 9 pages, 11 figures

Maneuverability and drivability of the teleoperated ground vehicle could be seriously degraded by large communication delays if the delays are not properly compensated. This paper proposes a predicted trajectory guidance control (PTGC) framework to compensate for such delays, thereby improving the performance of the teleoperation system. The novelty of this PTGC framework is that teleoperators intended trajectory is predicted at the vehicle side with their delayed historical control commands and the LiDAR 3D point cloud of the environment, and then the vehicle is guided by the predicted trajectory. By removing the teleoperator from the direct control loop, the presented method is less sensitive to delays, and delays are compensated as long as the prediction horizon exceeds the delays. Human-in-the-loop simulation experiments are designed to evaluate the teleoperation performance with the proposed method under five delay levels. Based on the repeated measurement analysis of variance, it is concluded that the PTGC method can significantly improve the performance of the teleoperated ground vehicles under large delays(>200ms), such as the task completion time (TCT), deviation to centerline (D2C) and steering effort (SE). In addition, the results also show that teleoperators can adapt to smaller delays, and the presented method is ineffective in such cases., Comment: 10 pages, 11 figures

Accurate and reliable prediction of driving intentions and future trajectories contributes to cooperation between human drivers and ADAS in complex traffic environments. This paper proposes a visual AOI (Area of Interest) based multimodal trajectory prediction model for probabilistic risk assessment at intersections. In this study, we find that the visual AOI implies the driving intention and is about 0.6-2.1 s ahead of the operation. Therefore, we designed a trajectory prediction model that integrates the driving intention (DI) and the multimodal trajectory (MT) predictions. The DI model was pre-trained independently to extract the driving intention using features including the visual AOI, historical vehicle states, and environmental context. The intention prediction experiments verify that the visual AOI-based DI model predicts steering intention 0.925 s ahead of the actual steering operation. The trained DI model is then integrated into the trajectory prediction model to filter multimodal trajectories. The trajectory prediction experiments show that the proposed model outperforms the state-of-the-art models. Risk assessment for traffics at intersections verifies that the proposed method achieves high accuracy and a low false alarm rate, and identifies the potential risk about 3 s before a conflict occurs., Comment: 11 pages, 13 figures