Augmented reality based on driving situation awareness in vehicle

In this paper, we introduce a vehicle augmented reality (AR) system to present information of driving situation awareness in a vehicle. Today, manufacturers related with vehicles have been pointing to AR as a next-generation visualization technology for in-car driving displays. Such in-vehicle AR-based display systems are helpful in reducing driver distractions, thereby increasing driver safety, and provide intelligent interactions for enhancing driver convenience. The proposed system offers information of driving situation and warning to a driver through the augmented reality using head-up display. The system consists of several sub-modules such as sensor, vehicle/pedestrian recognition, vehicle state information, driving information, time to collision (TTC), threat assessment, warning strategy, and display modules. We have defined the threat level and the presentation of AR information based on TTC values and driver's preference throughout experiments. The proposed system have been installed to a test vehicle with a vehicle AR information system prototype and carried out in the real road environments. The proposed system demonstrates to offer intuitively danger information according to the presentation rules to a driver on real road.