Search

Pedestrian detection is a critical task for safety-critical systems, but detecting pedestrians is challenging in low-light and adverse weather conditions. Thermal images can be used to improve robustness by providing complementary information to RGB images. Previous studies have shown that multi-modal feature fusion using convolution operation can be effective, but such methods rely solely on local feature correlations, which can degrade the performance capabilities. To address this issue, we propose an attention-based novel fusion network, referred to as INSANet (INtra-INter Spectral Attention Network), that captures global intra- and inter-information. It consists of intra- and inter-spectral attention blocks that allow the model to learn mutual spectral relationships. Additionally, we identified an imbalance in the multispectral dataset caused by several factors and designed an augmentation strategy that mitigates concentrated distributions and enables the model to learn the diverse locations of pedestrians. Extensive experiments demonstrate the effectiveness of the proposed methods, which achieve state-of-the-art performance on the KAIST dataset and LLVIP dataset. Finally, we conduct a regional performance evaluation to demonstrate the effectiveness of our proposed network in various regions. [ABSTRACT FROM AUTHOR]

In this paper, multispectral pedestrian detection is mainly discussed, which can contribute to assigning human-aware properties to automated forklifts to prevent accidents, such as collisions, at an early stage. Since there was no multispectral pedestrian detection dataset in an intralogistics domain, we collected a dataset; the dataset employs a method that aligns image pairs with different domains, i.e. RGB and thermal, without the use of a cumbersome device such as a beam splitter, but rather by exploiting the disparity between RGB sensors and camera geometry. In addition, we propose a multispectral pedestrian detector called SSD 2.5D that can not only detect pedestrians but also estimate the distance between an automated forklift and workers. In extensive experiments, the performance of detection and centroid localization is validated with respect to evaluation metrics used in the driving car domain but with distinct categories, such as hazardous zone and warning zone, to make it more applicable to the intralogistics domain. [ABSTRACT FROM AUTHOR]

Plant disease detection is essential for optimizing agricultural productivity and crop quality. With the recent advent of deep learning and large-scale plant disease datasets, many studies have shown high performance of supervised learning-based plant disease detectors. However, these studies still have limitations due to two aspects. First, labeling cost and class imbalance problems remain challenging in supervised learning-based methods. Second, plant disease datasets are either unstructured or weakly-unstructured and the shapes of leaves and diseased areas on them are variable, rendering plant disease detection even more challenging. To overcome these limitations, we propose an instance-aware unsupervised plant disease detector, which leverages normalizing flows, a visual saliency map and positional encodings. A novel way to explicitly combine these methods is the proposed model, in which the focus is on reducing background noise. In addition, to better fit the model to the plant disease detection domain and to enhance feature representation, a feature extractor is pre-trained in a self-supervised learning manner using only unlabeled data. In our extensive experiments, it is shown that the proposed approach achieves state-of-the-art performance on widely-used datasets, such as BRACOL (Weakly-unstructured) and PlantVillage (Unstructured), regardless of whether the dataset is weakly-structured or unstructured. [ABSTRACT FROM AUTHOR]

Vertical farms are to be considered the future of agriculture given that they not only use space and resources efficiently but can also consistently produce large yields. Recently, artificial intelligence has been introduced for use in vertical farms to boost crop yields, and crop growth monitoring is an essential example of the type of automation necessary to manage a vertical farm system. Region of interest predictions are generally used to find crop regions from the color images captured by a camera for the monitoring of growth. However, most deep learning-based prediction approaches are associated with performance degradation issues in the event of high crop densities or when different types of crops are grown together. To address this problem, we introduce a novel method, termed pseudo crop mixing, a model training strategy that targets vertical farms. With a small amount of labeled crop data, the proposed method can achieve optimal performance. This is particularly advantageous for crops with a long growth period, and it also reduces the cost of constructing a dataset that must be frequently updated to support the various crops in existing systems. Additionally, the proposed method demonstrates robustness with new data that were not introduced during the learning process. This advantage can be used for vertical farms that can be efficiently installed and operated in a variety of environments, and because no transfer learning was required, the construction time for container-type vertical farms can be reduced. In experiments, we show that the proposed model achieved a performance of 76.9%, which is 12.5% better than the existing method with a dataset obtained from a container-type indoor vertical farm. Our codes and dataset will be available publicly. [ABSTRACT FROM AUTHOR]