Search

Object detection is one of the core technologies for autonomous driving. Current road object detection mainly relies on visible light, which is prone to missed detections and false alarms in rainy, night-time, and foggy scenes. Multispectral object detection based on the fusion of RGB and infrared images can effectively address the challenges of complex and changing road scenes, improving the detection performance of current algorithms in complex scenarios. However, previous multispectral detection algorithms suffer from issues such as poor fusion of dual-mode information, poor detection performance for multi-scale objects, and inadequate utilization of semantic information. To address these challenges and enhance the detection performance in complex road scenes, this paper proposes a novel multispectral object detection algorithm called MRD-YOLO. In MRD-YOLO, we utilize interaction-based feature extraction to effectively fuse information and introduce the BIC-Fusion module with attention guidance to fuse different modal information. We also incorporate the SAConv module to improve the model's detection performance for multi-scale objects and utilize the AIFI structure to enhance the utilization of semantic information. Finally, we conduct experiments on two major public datasets, FLIR_Aligned and M3FD. The experimental results demonstrate that compared to other algorithms, the proposed algorithm achieves superior detection performance in complex road scenes. [ABSTRACT FROM AUTHOR]

The traditional infrared inspection of substations is usually done by employees with handheld infrared equipment, but the traditional inspection efficiency is not high, and some of the inspection locations have harsh environments, high voltage levels, and high‐risk factors. Given the above problems, this paper proposes an improved defect detection algorithm for substations based on YOLO v7 to solve the difficult problem of infrared inspection of substations. First, the lighter SE‐GhostNetV2 feature extraction network is designed to reduce the computation volume; second, the de‐weighted BIFPN structure is designed for the substation infrared image features to improve the ability of information interaction; finally, the new C‐NWD Loss is proposed to realize the detection of smaller substation equipment and reducing missed detections. The experimental results show that the hybrid accuracy of the algorithm designed in this paper is improved from 92.1% to 96.6%, the model parameters are reduced by 40.1%, the computation amount is reduced by 65%, the detection speed is improved by 87 FPS, and the false detection and missed detections is less, which can achieve real‐time infrared inspection of substations and solve the difficulties existing in traditional substation infrared detection. [ABSTRACT FROM AUTHOR]

Substation electrical equipment generates a massive number of infrared images during operation. However, the overall quality of the infrared images is low and it lacks image detail information. When using traditional target detection algorithms for detection, feature extraction poses great difficulties. Therefore, to address this problem, this paper proposes a target detection algorithm based on the improved faster region-based convolutional neural network (Faster R-CNN). It achieves the correct identification of different types of electrical equipment in infrared images. First, the algorithm improves the backbone network of Faster R-CNN for feature extraction. An InResNet structure is proposed to replace the residual block structure of the original ResNet-34 network, which enhances the richness of feature extraction. Second, the rectified linear unit activation function in the original feature extraction network is replaced by the exponential linear unit activation function, and group normalization is used instead of batch normalization as the network normalization method. Then, the dense connection structure is introduced into the ResNet-34 network, and the whole network is called residual dense connection network. Finally, the improved Faster R-CNN is compared to the original Faster R-CNN, a single-shot multibox detector, and you only look once v3 plus spatial pyramid pooling. The experimental results show that the improved algorithm has the highest mean average precision and average recall for most of the substation electrical equipment in infrared images. Moreover, from the confidence level of the detected electrical equipment and the accuracy of the prediction box, the improved Faster R-CNN has the best performance. [ABSTRACT FROM AUTHOR]

• An edge detection algorithm for thermal infrared weak texture images. • Construct a high-quality thermal infrared image edge dataset RI-BSDS500 for training to improve the training convergence speed and generalization ability of the model. • Different thermal infrared image datasets are tested under different algorithms, and the results are analyzed from the perspectives of objective parameters and subjective effects, which proves that the proposed algorithm in this paper is more effective on thermal infrared images. In order to solve the problems such as difficulties in extracting image edge information caused by low contrast and blurred edges of thermal infrared images, a thermal infrared image edge detection algorithm PiDiNet-TIR constructed based on the PiDiNet model is proposed. On the basis of the visible light image dataset BSDS500, the visible light image is grayed out, noise is added, and contrast is reduced to construct the thermal infrared image edge dataset I R-BSDS500, which provides image data for model training and testing. Deeply study the theory of PiDiNet model, add rich convolution mechanism to its backbone network, improve the activation function, pooling layer and up-sampling module, study the SimAM attention mechanism and add it to the side network. Using the open-source thermal infrared image dataset and homemade thermal infrared images for testing, we compare and analyze the mean square error (MSE), structural similarity of image (SSIM), feature similarity of image (FSIM), and Frames Per Second (FPS)of different detection algorithms, such as HED, RCF, DexiNet, PiDiNet, and the algorithm proposed in this paper. The results of image evaluation parameters prove that the edge detection algorithm proposed in this paper has high feature extraction efficiency and feature expression ability, and the algorithm detection performance is higher than other algorithms. [ABSTRACT FROM AUTHOR]

Current challenges in visible and infrared image fusion include color information distortion, texture detail loss, and target edge blur. To address these issues, a fusion algorithm based on double-domain transform filter and nonlinear contrast transform feature extraction (DDCTFuse) is proposed. First, for the problem of incomplete detail extraction that exists in the traditional transform domain image decomposition, an adaptive high-pass filter is proposed to decompose images into high-frequency and low-frequency portions. Second, in order to address the issue of fuzzy fusion target caused by contrast loss during the fusion process, a novel feature extraction algorithm is devised based on a novel nonlinear transform function. Finally, the fusion results are optimized and color-corrected by our proposed spatial-domain logical filter, in order to solve the color loss and edge blur generated in the fusion process. To validate the benefits of the proposed algorithm, nine classical algorithms are compared on the LLVIP, MSRS, INO, and Roadscene datasets. The results of these experiments indicate that the proposed fusion algorithm exhibits distinct targets, provides comprehensive scene information, and offers significant image contrast. [ABSTRACT FROM AUTHOR]