Search

Self-driving systems have a hard real-time nature, and the control commands of the vehicle must be output before the end-to-end deadline using sufficiently new data. It must also have the functionality to quickly shift to a safe state in the event of a deadline miss. However, the current self-driving system can only detect a deadline miss at the end of the process. To further improve safety, a method for detecting the possibility of a deadline miss in the middle of the process is required. Therefore, we represent such a real-time system as a mixed timer-driven and event-driven directed acyclic graph (DAG) and propose an early detection method for deadline misses by deriving a time constraint for each node. The experimental evaluation shows that the proposed method can detect deadline misses early for various scheduling algorithms. It also shows that the deadline miss ratio can be reduced by prioritizing the scheduling of jobs with a small margin to the time constraint determined using the proposed method for each job.

In the vision task of a self-driving system, the use of visible light images to segment an object often loses its functionality at night or in harsh weather. The far-infrared image shows different pixel values according to the thermal radiation quantity of the object itself, so it can be adapted to perform well at night and in harsh weather conditions. However, at the same time, it has insufficient texture features, blurred object boundaries and temperature inversion, which has a great impact on the segmentation task of traditional algorithms. In response to the above problems, this article proposes a far-infrared object segmentation algorithm using deep learning. In the current popular encoding-decoding structure, multi-scale pooling layers are used to obtain receptive fields of different sizes. This is used to solve the effects caused by the blurring of infrared objects. The feature enhancement module is designed for the multi-receptive field feature map, which can filter out the most versatile and highly semantic feature channels to reduce the effect of temperature inversion on segmentation. The obtained high semantic feature map is guided into the decoding structure and is fused with the features obtained by the encoder and the decoder. This allows richer information to be obtained between different feature maps. Finally, we also release a new low-resolution far-infrared segmentation dataset. Experiments are performed on three datasets, and the segmentation result of the mIoU(mean Intersection over Union) reaches 70.59%, 30.98% and 60.67%. A large number of experiments confirm the effectiveness and robustness of the network in far-infrared images and verify that the dataset released in this article has strong reference significance.