Search

With the increasing use of surveillance cameras, face recognition is being studied by many researchers for security purposes. Although high accuracy has been achieved for frontal faces, the existing methods have shown poor performance for occluded and corrupt images. Recently, sparse representation based classification (SRC) has shown the state‐of‐the‐art result in face recognition on corrupt and occluded face images. Several researchers have developed extended SRC methods in the last decade. This paper mainly focuses on SRC and its extended methods of face recognition. SRC methods have been compared on the basis of five issues of face recognition such as linear variation, non‐linear variation, undersampled, pose variation, and low resolution. Detailed analysis of SRC methods for issues of face recognition have been discussed based on experimental results and execution time. Finally, the limitation of SRC methods have been listed to help the researchers to extend the work of existing methods to resolve the unsolved issues. [ABSTRACT FROM AUTHOR]

Visual information is important in final approach and landing phases for an approaching aircraft, it presents supplementary source for navigation system, and provides backup guidance when radio navigation fails, or even supports a complete vision‐based landing. Relative position and attitude can be solved from the runway features in the image. Traditional runway detection methods have high latency and low accuracy, which is unable to satisfy the requirements for a safe landing. This paper proposes a real‐time runway detection model, efficient runway feature extractor (ERFE), based on deep convolutional neural network, generating semantic segmentation and feature lines output. In order to evaluate the model's effectiveness, a benchmark is proposed to calculate the actual error between predicted feature line and ground truth one. A novel runway dataset which is based on pictures from Microsoft Flight Simulator 2020 (FS2020), is also proposed in this paper to train and test the model. The dataset will be released at https://www.kaggle.com/datasets/relufrank/fs2020‐runway‐dataset. ERFE shows excellent performance in FS2020 dataset, it gives satisfactory results even for real runway images excluded from our dataset. [ABSTRACT FROM AUTHOR]

Segmentation is crucial in diagnosing retinal diseases by accurately identifiying retinal vessels. This paper addresses the complexity of segmenting retinal vessels, highlighting the need for precise analysis of blood vessel structures. Despite the progress made by convolutional neural networsks (CNNs) in image segmentation, their limitations in capturing the global structure of retinal vsessels and maintaining segmentation continuity present challenges. To tackle these issues, our proposed network integrates graph convolutional networks (GCNs) and attention mechansims. This allows the model to consider pixel relationships and learn vessel graphical structures, significantly improving segmentation accuracy. Additionally, the attentional feature fusion module, including pixel‐wise and channel‐wise attention mechansims within the U‐Net architecture, refines the model's focus on relevant features. This paper emphasizes the importance of continuty preservation, ensuring an accurate representation of pixel‐level information and structural details during sefmentation. Therefore, our method performs as an effective solution to overcome challenges in retinal vessel segmentation. The proposed method outperformed the state‐of‐the‐art approaches on DRIVE (Digital Retinal Images for Vessel Extraction) and STARE (Structed Analysis of the Retina) datasets with accuracies of 0.12% and 0.14%, respecttively. Importantly, our proposed approach excelled in delineating slender and diminutive blood vessels, crucial for diagnosing vascular‐related diseases. Implementation is accessible on https://github.com/CVLab‐SHUT/VGA‐Net. [ABSTRACT FROM AUTHOR]

As one of the dimensionality reduction techniques of hyperspectral image (HSI), band selection (BS) does not change the spectral characteristics and physical meaning of HSIs, which is beneficial to the identification and analysis of surface objects. Recently, many BS methods for target detection have achieved promising results by making full use of the priori spectral features of the target to be detected. Conversely, anomaly detection separates the anomaly based solely on the statistical distribution difference between anomaly and background without any prior information. Therefore, the development of BS for anomaly detection has lagged far behind that of BS for target detection. To this end, this paper proposes a novel BS algorithm dedicated to anomaly detection tasks, named anomaly‐background separation and particle swarm optimization (PSO)‐based BS. Specifically, an anomaly‐background separation framework (ABSF) is established to predetermine a priori knowledge of anomaly distribution. Then, three band prioritization criteria are constructed with the anomaly‐background constraints generated by ABSF. Finally, PSO is used to find the optimal subset of bands in the solution space. The experiments on two real datasets demonstrate that the proposed method yields better detection results and greater stability compared to other BS methods discussed in this paper. [ABSTRACT FROM AUTHOR]

Cloud removal algorithm is a crucial step of remote sensing image preprocessing. The current mainstream remote sensing image cloud removal algorithms are implemented based on deep learning, and most of them are supervised. A large number of data pairs are required for training to achieve cloud removal. However, real with/without cloud image pairs datasets are difficult to obtain in the real world, and the models obtained by training on synthetic datasets often need to generalize better to natural scenes. And the existing unsupervised thin cloud removal methods based on Cycle‐GAN framework with considerable model complexity and unstable training are not an excellent solution to the problem of lack of paired datasets. Based on this, in this paper, the authors propose an unsupervised remote sensing image thin cloud removal method based on contrastive learning—GAN‐UD. It is a network consisting of a frequency‐spatial attention generator and a discriminator. In addition, the authors introduce local contrastive loss and global content loss to constrain the content of the generated images to ensure that the generated cloud‐free images are consistent with the input cloud images in terms of image content. Experimental results show that the proposed method in this paper can still effectively remove thin clouds from remote sensing images without paired training datasets, outperforms current unsupervised cloud removal methods, and achieves comparable performance to supervised methods. [ABSTRACT FROM AUTHOR]

In this paper, an additive margin network with adaptive feature recalibration, AMNets, for handling a wide range of visual tasks, is proposed. The new AMNets consists of three improvements on convolutional neural networks: (1) squeeze‐and‐excitation mechanism was embedded into the the residual block of single layer to improve the performance of the classification, (2) softmax loss was replaced by the additive margin softmax loss to minimize intra‐class variance and maximize inter‐class variance, and (3) Adam optimizer was exploited to update iteratively the network parameters. Experiments on the Brain Stroke CT Image Dataset show that our additive margin network is quite effective to improve state‐of‐the‐art algorithms. Network algorithms have been extensively used in medical image field to pursuit a more accuracy of disease recognition. This paper proposes AMNets, an additive margin network with adaptive feature recalibration for handling a wide range of visual tasks in medicine. [ABSTRACT FROM AUTHOR]

Mapping high dynamic range (HDR) images to low dynamic range (LDR) display devices while performing enhancement processing is a challenging task. To address the issues of chromatic drift, the imbalance between preserving naturalness and enhancing details during the mapping process, this paper proposed a tone mapping operator (TMO) based on an improved guided filter with multi‐layered processing. Firstly, the operator tackled the problem of insufficient extraction of detail layer information in complex scene images by redefining the formula of the guided filter and introducing adaptive regularization parameters. This enhancement enabled more effective extraction of details compared to traditional fixed‐parameter guided filters. Secondly, the algorithm employed a centre‐surround approach to subdivide and processed the detail layers individually, effectively suppressing halos and artefacts. Thirdly, image entropy was utilized to guide the fusion and enhancement processing of the detail layers, preventing excessive or insufficient enhancement. Finally, this paper proposed an adaptive gamma correction algorithm and a chromatic consistency algorithm to improve overall contrast and hue saturation. The results demonstrate convincing performance in terms of subjective visual evaluation and image quality assessment. [ABSTRACT FROM AUTHOR]

The network structure of digital watermarking algorithm based on deep learning is usually encoder‐noise layer‐decoder. Most of the existing encoders suffer from the problem of insufficient feature extraction, and the introduction of simulated differentiable joint photographic experts group (JPEG) compression in the noise layer cannot ensure the robustness under real JPEG. In this paper, a watermarking algorithm based on multi‐scale auto‐encoder is proposed, which can effectively extract the image feature information by combining with the channel attention mechanism. At the same time, some parameters of decoder and encoder are shared to reduce redundant feature embedding and improve extraction accuracy. This paper also proposes a robust training scheme against JPEG compression, which can guide the model to store the watermark in the low‐frequency region needed for decoding. Experimental results show that the peak signal‐to‐noise ratio (PSNR) of the proposed algorithm is above 48 and the decoding rate is above 99% under JPEG compression with quality factor Q = 50. Moreover, this scheme can effectively promote the combination of noise layer in training. In addition, the proposed algorithm is also robust to other common network noises. [ABSTRACT FROM AUTHOR]

This paper presents a textile defect detection method that utilizes a multi‐proportion spatial attention mechanism and channel memory feature fusion network by addressing the difficulties presented by complicated shapes and large size variations. In particular, a multi‐proportion spatial attention mechanism (MPAM) is introduced, which employs multi‐proportion convolution to improve the backbone network's capacity to detect non‐uniform structural defects. Additionally, the generality and adaptability of the model are enhanced by a multi‐scale spatial pyramid pooling structure (MS‐SPP). Second, a channel attention mechanism‐based memory feature fusion network is developed, which incorporates channel attention to adaptive weight the feature channels, focusing on crucial information channels to efficiently fuse contextual features and enhance the model's memory capacity. Finally, a novel efficient Wise‐IoU (EWIoU) loss function is proposed, which utilizes a dynamic non‐monotonic focusing mechanism to increase the penalty on distance measurement, thus enhancing the model's detection performance. Experiment findings on the ZJU‐Leaper and Tianchi textile datasets reveal that compared to the YOLOv7 baseline, the method in this paper has an increase of 6.5 and 2 percentage points, respectively, and the detection accuracy is better than most existing networks. [ABSTRACT FROM AUTHOR]

In recent years, low‐light image enhancement has become increasingly active. However, in underground mine environments, acquiring high‐quality images is still challenging due to low light, low contrast, and occlusion. To address this problem, this study proposes a low‐light image enhancement method for underground mine based on generative adversarial networks (UM‐GAN), which aims to take full advantage of the ability of GAN to achieve the restoration of details, the reduction of noise, and the improvement of overall image quality. The model proposed in this paper is divided into three main parts. Initially, a generator network adopting an encoder–decoder structure is developed. Subsequently, a novel strategy is introduced to merge information by utilizing inverted greyscale images and low‐light images as inputs. Further image quality enhancement is achieved by incorporating a noise reduction module employing the diffusion model. To ascertain the efficacy of the UM‐GAN method, evaluations are conducted on diverse real‐world and synthetic datasets, juxtaposing the approach against superior methods. Through qualitative and quantitative comparative experiments, the method showcases noteworthy advancements through qualitative and quantitative comparative experiments, substantiating its effectiveness. This research provides new ideas and methods for overcoming image quality problems in underground mine environments and contributes to the development of underground mine image processing. [ABSTRACT FROM AUTHOR]

A 1 millisecond (1‐ms) vision system that guarantees high efficiency and timely response for tomato defect detection is essential for factory automation. Because of various defect appearances, recently many existing researches focus on CNN based defect detection, but few of them attempt to reach high processing speed to adapt to the factorial assembly line. This paper proposes a global to multi‐scale local based parallel architecture with hardwired CNN for tomato defect detection. This architecture breaks down image‐wise detection into pixel‐wise localization and block‐wise classification. The pixel‐wise localization utilizes tomato‐aware information as constraints for localization performance. The block‐wise classification uses a fully pipelined network structure to obtain the classification result for each block as the pixel stream moves through the network. The classification network has a six‐layer lightweight network structure with quantization for hardwired type implementation on FPGA. The experiment results show that the proposed architecture processes 1000 FPS images with 0.9476 ms/frame delay. And for detection performance, this architecture keeps f1−score$f_{1}-score$ at 80.18%, only 1.31% lower than ResNet50 based detection system. [ABSTRACT FROM AUTHOR]

Various types of foreign fibres may be mixed in the planting, transportation, and production processes of cotton, which not only cause equipment to be out of control, but also leads to a decrease in the quality of cotton textile products and economic losses. The machine vision based detection method for cotton foreign fibres is widely used. Based on existing related research, we construct a classification dataset for cotton foreign fibres in practical scenarios, named the CF2113‐10 dataset. The authors design a basic foreign fibre classification network called CottonNet that balances performance and efficiency. The classification accuracy on the validation set reached 94.2%. In order to enhance the high‐level feature extraction ability, this paper improves the feature fusion method of residual networks and proposes CottonNet‐Res, which improves the classification accuracy to 95.1%. Finally, a classification model based on feature difference fitting, CottonNet‐Fusion, is proposed to address the classification problem of foreign fibre images sampled in complex environments. The classification accuracy of foreign fibre images sampled in ordinary scenes has improved to 97.4%, while the images sampled in complex environments maintain an accuracy of 90.3%. [ABSTRACT FROM AUTHOR]

Accurate classification of substation equipment images remains challenging due to various factors such as unexpected illumination, viewing angles, scale variations, shadows, surface contaminants, and different elements sharing similar appearances. This paper presents a novel two‐stage substation equipment classification method based on dual‐scale attention. Leveraging the region proposal technique from Faster‐regions with CNN features (RCNN), the input images are initially decomposed into multiple scales to capture latent features. A dual‐scale attention module is introduced to enhance the precision of feature extraction. Furthermore, a two‐stage network is proposed to address the challenge of classifying closely similar substation equipment. A multi‐layer perceptron performs a coarse classification to categorize the equipment into broad categories. Then, a lightweight classifier is employed for fine‐grained subclassification, further distinguishing equipment within the same broad category. To mitigate the issue of limited training data, a specialized dataset is collected and annotated for the substation equipment classification. Experimental results demonstrate that the proposed method achieves remarkable accuracy, recall, and F1‐score surpassing 0.91, outperforming mainstream approaches in terms of recall and F1 scores. Ablation experiments further validate the significant contributions of both the dual‐scale attention and the two‐stage classification module in improving the overall performance of the classification network. [ABSTRACT FROM AUTHOR]

In recent years, research on infrared and visible image fusion has mainly focused on deep learning‐based approaches, particularly deep neural networks with auto‐encoder architectures. However, these approaches suffer from problems such as insufficient feature extraction capability and inefficient fusion strategies. Therefore, this paper introduces a novel image fusion network to address the limitations of infrared and visible image fusion networks with auto‐encoder architectures. In the designed network, the encoder employs a multi‐branch cascade structure, and these convolution branches with different kernel sizes provide the encoder with an adaptive receptive field to extract multi‐scale features. In addition, the fusion layer incorporates a non‐local attention module that is inspired by the self‐attention mechanism. With its global receptive field, this module is used to build a non‐local attention fusion network, which works together with the l1${l}_1$‐norm spatial fusion strategy to extract, split, filter, and fuse global and local features. Comparative experiments on the TNO and MSRS datasets demonstrate that the proposed method outperforms other state‐of‐the‐art fusion approaches. [ABSTRACT FROM AUTHOR]

In the production of low‐voltage apparatus, assembly quality inspection is of great relevance for ensuring the final quality of the entire product. With the continuous improvement of production efficiency and people's requirements for production quality, traditional manual inspection methods can no longer meet the quality inspection requirements. In this paper, an Attention‐guided Feature‐fusion ConvNeXt Network (AFCN) for the automated visual inspection is proposed. By embedding the attention mechanism of the Coordinate Attention block into the residual channel of the ConvNeXt block, the position‐aware information and features of the low‐voltage apparatus images can be effectively captured to locate the quality problems. Then, an improved attention feature fusion module is adopted to merge the output features at different stages, which introduces a 3D non‐parameter attention SimAM block and adapts output accordingly. Therefore, this model can capture the key information of the feature map in a coordinated way in terms of channel and position, fully integrating multiscale features and obtaining contour texture information and semantic information of the low‐voltage apparatus. Experiments show the proposed approach can effectively classify defective and normal products. [ABSTRACT FROM AUTHOR]

Slug flow processes draw much attention in chemical and pharmaceutical manufacturing thanks to their ability to eliminate downtime costs and batch‐to‐batch variation. Using in‐line video can monitor the current process status and improve the stability of the slug flow. However, there are no effective image processing methods aiming at such videos from chemical experiments due to limited training sample size and the variety of experimental settings. The paper proposes a training‐free method to automatically detect and measure the slugs from in‐line videos. Multiple image features are fused to identify the slug shapes under various lighting conditions, a six‐point model is fitted to achieve better volume estimation, and a consistency score is estimated to quantify the detection uncertainty. The proposed algorithm achieves similar results to manual labeling for various types of slug flow processes, improving the accuracy of slug column estimation by a large margin compared to the existing automatic methods. Finally, using it to monitor the slug flow process's stability and the change of the slug volume in an injection point are demonstrated. The method not only shows that handcrafted image features have the capability for detection and segmentation from chemical experiment images but also paves the road for a training‐based algorithm for the task. [ABSTRACT FROM AUTHOR]

This paper proposes an image encryption algorithm based on combined 1D chaotic maps. First, a permutation technique was applied. It was then reorganized into 1D matrices along the rows and columns respectively, which were then shuffled by computing the substituted position indices to obtain the scrambled image. Subsequently, a method of confusion of the scrambled image was used through another generated data map, combined with random sub‐matrices for diffusion, then resulting in an encrypted image. Finally, the proposed cryptosystem was implemented in a single kernel platform developed using the Nios II Software Build Tools processor for Eclipse. A hardware architecture was designed using the Qsys‐built tool which is available in the Quartus II 13.0sp1 environment. The developed single‐core system was implemented using the Cyclone IV EP4CE6E22C8. Robustness evaluation of the cryptosystem was performed through security analysis tests such as histogram analysis, correlation coefficient, differential analysis, and key space analysis to prove that it is of good quality, efficient, fast, and successfully resisting brute force attacks. The hardware performance analysis was also carried out. Then the cryptosystem is compared with those in the literature both in the hardware and security performance aspects. [ABSTRACT FROM AUTHOR]

In response to the low matching accuracy of stereo matching algorithms in image regions with specular reflection, this paper proposes a multidimensional fusion stereo matching algorithm named MFANet. The algorithm embeds a multispectral attention module into the residual feature extraction network, utilizing two‐dimensional discrete cosine transforms to extract frequency features. In the pyramid pooling module, a coordinated attention mechanism is introduced to capture relevant positional information. In the cost aggregation part, the MFANet algorithm incorporates a three‐dimensional attention mechanism, focusing on the more important semantic information in high‐level features. By combining detailed information from low‐level features, semantic information from high‐level features, and contextual information, the algorithm generates features that are more conducive to disparity prediction. The MFANet algorithm is evaluated on three standard datasets (SceneFlow, KITTI2015, and KITTI2012). Experimental results demonstrate its robustness against specular reflection interference, accurate prediction of disparities in specular reflection pathological regions, and promising application prospects. [ABSTRACT FROM AUTHOR]

In order to balance accuracy and real‐time performance in semantic segmentation, this paper proposes a real‐time semantic segmentation algorithm model based on attention mechanism and multi‐branch feature fusion using Fast convolutional neural network model (Fast‐SCNN). In this method, the spatial detail feature enhancement branch is introduced to enhance spatial detail features firstly. Then, through rational design of fusion module, the feature information of each branch is optimized to achieve better fusion of deep and shallow features. At the end of the feature fusion module, an adaptive feature enhancement focus module is introduced to capture the interdependence between remote pixels. The experimental results show that the proposed algorithm achieves 71.55% segmentation accuracy on Cityscapes dataset, the reasoning speed FPS is 97.6 frames/s, and the number of parameters is 1.39 M, which verifies the effectiveness of the network model constructed by the algorithm. Code is available at https://github.com/ccchhheeennn/model. [ABSTRACT FROM AUTHOR]

In addressing the challenge of ships being prone to occlusion in multi‐target situations during ship target detection, leading to missed and false detections, this paper proposes an enhanced ship detection algorithm for YOLOv7‐tiny. The proposed method incorporates several key modifications. Firstly, it introduces the Convolutional Block Attention Module in the Backbone section of the original model, emphasizing position information while attending to channel features to enhance the network's ability to extract crucial information. Secondly, it replaces standard convolution with GSConv convolution in the Neck section, preserving detailed information and reducing computational load. Subsequently, the lightweight operator Content‐Aware ReAssembly of Features is employed to replace the original nearest‐neighbour interpolation, mitigating the loss of feature information during the up‐sampling process. Finally, the localization loss function, SIOU Loss, is utilized to calculate loss, expedite training convergence, and enhance detection accuracy. The research results indicate that the precision of the improved model is 91.2%, mAP@0.5 is 94.5%, and the F1‐score is 90.7%. These values are 3.7%, 5.5%, and 4.2% higher than those of the original YOLOv7‐tiny model, respectively. The improved model effectively enhances detection accuracy. Additionally, the improved model achieves an FPS of 145.4, meeting real‐time requirements. [ABSTRACT FROM AUTHOR]

Video stabilization plays a pivotal role in enhancing video quality by eliminating unwanted jitter in shaky videos. This paper introduces a novel video stabilization algorithm that leverages low‐rank constraint and trajectory optimization to effectively eliminate undesirable motion and generate stabilized videos. In the proposed algorithm, a low‐rank constraint regularization term is incorporated to enhance the smoothness of motion trajectories. Additionally, a predictive path smoothness term is integrated to ensure the consistency of motion across neighbouring frames. To address the problem of excessive cropping resulting from aggressive smoothing, a flexible local window strategy that emphasizes local motion relationships within the trajectories is introduced. The experimental results show that, compared to other excellent video stabilization algorithms, the proposed algorithm improves the stability metric by approximately 2.3%. Furthermore, in the stabilized videos generated by the algorithm, an approximate improvement of 2.18 dB in average image temporal fidelity and a 5.7% increase in average structural similarity between adjacent frames are achieved. The code that implements the proposed method is publicly accessible at https://github.com/CZS0319/VS_Low‐Rank_Constraint_Trajectory_Optimization. [ABSTRACT FROM AUTHOR]

Person re‐identification represents a pivotal sub‐problem in image retrieval, boasting broad application prospects in fields such as intelligent security and video surveillance. However, most existing person re‐identification methods predominantly focus solely on visual features pertaining to the person targets, thereby disregarding some supporting information closely related to the scene context. In the context of athlete re‐identification during sports event scenes, the athlete bib number is fully considered, an important clue that can provide different athletes' identities, and the traditional visual features of the person and high‐level semantic information of the bib number text are fused. A multi‐source information mutual gain mechanism is designed to improve the accuracy of the person re‐identification task. In the existing only publicly available marathon bib number dataset RBNR, the recognition accuracy of this method is significantly superior to that of the existing person re‐identification method. In addition, this paper constructs and publishes an athlete re‐identification dataset (HNNU‐ReID8000) for mainstream sports events, and the mean average precision (mAP) value of this method reaches 96.1% on this dataset, significantly ahead of existing state‐of‐the‐art person re‐identification methods. The code and the HNNU‐ReID8000 dataset will be released at https://github.com/yanbin‐zhu/zyb_person‐reid. [ABSTRACT FROM AUTHOR]

Most existing multi‐view stereo (MVS) methods fail to consider global context information in the stage of feature extraction and cost aggregation. As transformers have shown remarkable performance on various vision tasks due to their ability to perceive global contextual information, this paper proposes a transformer‐based feature enhancement network (TF‐MVSNet) to facilitate feature representation learning by combining local features (both 2D and 3D) with long‐range contextual information. To reduce memory consumption of feature matching, the cross‐attention mechanism is leveraged to efficiently construct 3D cost volumes under the epipolar constraint. Additionally, a colour‐guided network is designed to refine depth maps at a coarse stage, hence reducing incorrect depth predictions at a fine stage. Extensive experiments were performed on the DTU dataset and Tanks and Temples (T&T) benchmark and results are reported. [ABSTRACT FROM AUTHOR]

Whole brain segmentation from magnetic resonance images (MRI) is crucial in diagnosing brain diseases and analyzing neuroimaging data. Despite advances through deep learning, challenges such as uneven gray distribution and the presence of artifacts still present hurdles in medical image processing. These limitations are often a result of insufficient spatial contextual information and lack of attention to important regions within existing models. To address these issues, this paper presents SSA‐UNet (Squeeze‐and‐Excitation and Self‐Attention UNet), a uniquely designed deep convolutional neural network that integrates spatial constraints by converting three consecutive 2D MRI slices into a single 2.5D image. This facilitates capturing inter‐slice dependencies effectively. Additionally, the newly formulated SSA block, which sequentially incorporates channel attention and Self‐Attention mechanisms, is placed before the decoders in the conventional U‐Net architecture. This enables the network to automatically weight different feature maps and focus more effectively on regions requiring precise segmentation. Rigorous evaluations on LPBA40 and IBSR18 datasets substantiate the remarkable improvements in accuracy and stability achieved by SSA‐UNet. Results indicate Dice coefficients of 98.38% and 97.47%, specificity of 99.69% and 99.57%, and sensitivity of 98.5% and 97.98% for the respective datasets. Compared to other existing models, SSA‐UNet shows significant improvements on both the LPBA40 and IBSR18 datasets. On the LPBA40 dataset, SSA‐UNet's Dice coefficient improved by 0.33% compared to the sub‐optimal model, while on the IBSR18 dataset, the improvement reached 1.78%. These empirical findings demonstrate SSA‐UNet's heightened capability in addressing the long‐standing challenges in MRI‐based whole‐brain segmentation. [ABSTRACT FROM AUTHOR]

Tumour medical image segmentation plays a crucial role in clinical imaging diagnosis. Existing research has achieved good results, enabling the segmentation of three tumour regions in MRI brain tumour images. Existing models have limited focus on the brain tumour areas, and the long‐term dependency of features is weakened as the network depth increases, resulting in blurred edge segmentation of the targets. Additionally, considering the excellent segmentation performance of the Swin Transformer(Swin‐T) network, its network structure and parameters are relatively large. To address these limitations, this paper proposes a brain tumour segmentation framework with deep nuanced reasoning and Swin‐T. It is mainly composed of the backbone hybrid network (BHN) and the deep micro texture extraction module (DMTE). The BHN combines the Swin‐T stage with a new downsampling transition module called dual path feature reasoning (DPFR). The entire network framework is designed to extract global and local features from multi‐modal data, enabling it to capture and analyze deep texture features in multi‐modal images. It provides significant optimization over the Swin‐T network structure. Experimental results on the BraTS dataset demonstrate that the proposed method outperforms other state‐of‐the‐art models in terms of segmentation performance. The corresponding source codes are available at https://github.com/CurbUni/Brain‐Tumor‐Segmentation‐Framework‐with‐Deep‐Nuanced‐Reasoning‐and‐Swin‐T. [ABSTRACT FROM AUTHOR]

In the field of scientific visualization, the upscaling of time‐varying volume is meaningful. It can be used in in situ visualization to help scientists overcome the limitations of I/O speed and storage capacity when analysing and visualizing large‐scale, time‐varying simulation data. This paper proposes self‐attention residual network‐based spatial super‐resolution (SARN‐SSR), a spatial super‐resolution model based on self‐attention residual networks that can generate time‐varying data with temporal coherence. SARN‐SSR consists of two components: a generator and a discriminator. The generator takes the low‐resolution volume sequences as the input and gives the corresponding high‐resolution volume sequences as the output. The discriminator takes both synthesized and real high‐resolution volume sequence as the input and gives a matrix to predict the realness as the output. To verify the validity of SARN‐SSR, four sets of time‐varying volume datasets are applied from scientific simulation. In addition, SARN‐SSR is compared on these datasets, both qualitatively and quantitatively, with two deep learning‐based techniques and one traditional technique. The experimental results show that by using this method, the closest time‐varying data to the ground truth can be obtained. [ABSTRACT FROM AUTHOR]

Pixel‐level labeling of regions of interest in an image is a key step in building a labeled training dataset for supervised deep learning networks of images. However, traditional manual labeling of cancerous regions in digital pathological images by doctors is time‐consuming and inefficient. To address this issue, this paper proposes an automatic labeling method for whole slide images, which combines clustering and edge detection techniques. The proposed method utilizes the multi‐level feature fusion model and the Long‐Short Term Memory network to discriminate the cancerous nature of the whole slide images, thereby improving the classification accuracy of the whole slide images. Subsequently, the automatic labeling of cancerous regions is achieved by integrating a density‐based clustering algorithm and an edge point extraction algorithm, both based on the discriminated results of the cancerous properties of whole slide images. The experimental results demonstrate the effectiveness of the proposed method, which offers an efficient and accurate solution to the challenging task of cancerous region labeling in digital pathological images. [ABSTRACT FROM AUTHOR]

Existing segmentation‐based methods have made considerable progress in arbitrarily shaped text detection due to the advantage of dealing with shape variation. However, there still exist challenges to detecting accurate text instances with dense layouts, inaccurate annotations, and complex backgrounds. Many recent works have focused on improving arbitrary boundary prediction, but it may be difficult to accurately distinguish each instance of dense layouts because their boundary pixels may be mistakenly classified to produce inaccurate results (i.e., adhesive texts) with inaccurate annotation and complex backgrounds. Considering the local and long‐range dependencies, this paper proposes an efficient text detector, namely T‐Skeleton, to obtain more reliable segmentation detections. In the spirit of object skeletonization, we introduce the text instance skeleton highlighting the semantically significant structure (similar to the skeleton of a fish) to explicitly capture the long‐range dependencies of text instances. The key idea of T‐Skeleton is to calibrate the coarse text proposals by embedding text instance skeletons to separate crowd texts accurately and robustly. We further design a channel attention module to enlarge the performance margin between T‐Skeleton and the segmentation baseline. Experimental results on four publicly available datasets show the superiority of T‐Skeleton in handling long and curved texts. [ABSTRACT FROM AUTHOR]

This paper proposes a super‐resolution reconstruction model, SRPGANto improve the visual quality of images based on generative adversarial networks (GANs) by improving the network structures of the generator and the discriminator. In the generator, a dual branch residual block is designed instead of the residual block, including a branch with an attention mechanism and a branch without an attention mechanism, to extract more differentiated features. Normalization methods are explored to avoid unstable training and bath normalization artifacts and use a half instance normalization layer that is more suitable for underlying visual problems compared with traditional batch normalization. In the discriminator, PatchGAN is applied instead of typical GAN to improve the generation of local texture by discriminating each patch rather than the global image. The experimental results on the public datasets demonstrate that the proposed SRPGAN can achieve excellent quantitative evaluation while improving the visual quality of reconstructed images. [ABSTRACT FROM AUTHOR]

Scene text in natural images carries additional semantic information to aid in image classification. Existing methods lack full consideration of the deep understanding of the text and the visual text relationship, which results in the difficult to judge the semantic accuracy and the relevance of the visual text. This paper proposes image classification based on Cross modal Knowledge Learning of Scene Text (CKLST) method. CKLST consists of three stages: cross‐modal scene text recognition, text semantic enhancement, and visual‐text feature alignment. In the first stage, multi‐attention is used to extract features layer by layer, and a self‐mask‐based iterative correction strategy is utilized to improve the scene text recognition accuracy. In the second stage, knowledge features are extracted using external knowledge and are fused with text features to enhance text semantic information. In the third stage, CKLST realizes visual‐text feature alignment across attention mechanisms with a similarity matrix, thus the correlation between images and text can be captured to improve the accuracy of the image classification tasks. On Con‐Text dataset, Crowd Activity dataset, Drink Bottle dataset, and Synth Text dataset, CKLST can perform significantly better than other baselines on fine‐grained image classification, with improvements of 3.54%, 5.37%, 3.28%, and 2.81% over the best baseline in mAP, respectively. [ABSTRACT FROM AUTHOR]

The image‐to‐video (I2V) person re‐identification (Re‐ID) is a cross‐modality pedestrian retrieval task, whose crux is to reduce the large modality discrepancy between images and videos. To this end, this paper proposes to predict the following video frames from a single image. Thus, the I2V person Re‐ID can be transformed to video‐to‐video (V2V) Re‐ID. Considering that predicting video frames from a single image is an ill‐posed problem, this paper proposes two strategies to improve the quality of the predicted videos. First, a pose‐guided video prediction pipeline is proposed. The given single image and pedestrian pose are encoded via image encoder and pose encoder, respectively; then, the image feature and pose feature are concatenated as the input of the video decoder. The authors minimize the difference between the predicted video and true video, and simultaneously minimize the difference between the true pose and predicted pose. Second, the conditional adversarial training strategy is employed to generate high‐quality video frames. Specifically, the discriminator takes the source image as condition and distinguishes whether the input frames are fake or true following frames of the source image. Experimental results demonstrate that the pose‐guided adversarial video prediction can effectively improve accuracy of I2V Re‐ID. [ABSTRACT FROM AUTHOR]

Combining edge devices with intelligent inspection for transmission lines can fulfill the demand for real‐time defect detection in the field. However, there has been limited research on algorithms suitable for edge devices with low computational power and memory, and the existing research primarily focuses on CPU optimization. To address these issues, this paper proposes a real‐time defect detection method for transmission line endpoints based on YOLO‐GSS (YOLOv8 with Mosaic‐9, G‐GhostNet, S‐FPN, and Spatial Intersection over Union (SIoU) modifications). First, the authors improve the input of the YOLOv8 network using Mosaic‐9 to increase the number of input features in the training phase and enhance algorithm robustness. Next, the authors introduce G‐GhostNet and S‐FPN to enhance the backbone and neck sections while improving inference speed and accuracy. Finally, the authors modify the Complete Intersection over Union loss function of YOLOv8 using SIoU to further improve the detection accuracy. Experimental results demonstrate that compared to the original YOLOv8, the proposed method achieves a 5x increase in inference speed on Nvidia Jetson NX edge devices and a 7.7% improvement in accuracy, meeting the real‐time defect detection requirements for transmission line field inspections. [ABSTRACT FROM AUTHOR]

Deep convolutional neural networks based remote sensing change detection has recently shown significant performance improvement. However, small region changes and global‐local features in high‐resolution remote sensing images are not fully explored. This paper introduces a hybrid U‐shaped and transformer network for change detection in high‐resolution remote sensing images. Specifically, a UNet++‐based backbone to facilitate feature learning across different scales. In addition, we introduce a transformer‐based feature fusion module for extracting long‐range dependencies, which can enhance the representation ability of the network. Furthermore, the introduced efficient channel attention mechanism can efficiently calibrate the feature representation and concentrate on more important feature information. Thanks to the above designs, the proposed method enjoys a strong ability to extract local and global features for remote sensing change detection. Extensive experimental results on different remote sensing images show that our method can achieve superior performance in comparison with state‐of‐the‐art change detection methods. [ABSTRACT FROM AUTHOR]

With the growing significance of data privacy protection, Source‐Free Domain Adaptation (SFDA) has gained attention as a research topic that aims to transfer knowledge from a labeled source domain to an unlabeled target domain without accessing source data. However, the absence of source data often leads to model collapse or restricts the performance improvements of SFDA methods, as there is insufficient true‐labeled knowledge for each category. To tackle this, Source‐Free Active Domain Adaptation (SFADA) has emerged as a new task that aims to improve SFDA by selecting a small set of informative target samples labeled by experts. Nevertheless, existing SFADA methods impose a significant burden on human labelers, requiring them to continuously label a substantial number of samples throughout the training period. In this paper, a novel approach is proposed to alleviate the labeling burden in SFADA by only necessitating the labeling of an extremely small number of samples on a one‐time basis. Moreover, considering the inherent sparsity of these selected samples in the target domain, a Self‐adaptive Clustering‐based Active Learning (SCAL) method is proposed that propagates the labels of selected samples to other datapoints within the same cluster. To further enhance the accuracy of SCAL, a self‐adaptive scale search method is devised that automatically determines the optimal clustering scale, using the entropy of the entire target dataset as a guiding criterion. The experimental evaluation presents compelling evidence of our method's supremacy. Specifically, it outstrips previous SFDA methods, delivering state‐of‐the‐art (SOTA) results on standard benchmarks. Remarkably, it accomplishes this with less than 0.5% annotation cost, in stark contrast to the approximate 5% required by earlier techniques. The approach thus not only sets new performance benchmarks but also offers a markedly more practical and cost‐effective solution for SFADA, making it an attractive choice for real‐world applications where labeling resources are limited. [ABSTRACT FROM AUTHOR]

While recent years have witnessed the unprecedented success of deep convolutional neural networks (CNNs) and vision transformers in single‐image super‐resolution (SISR), the degradation assumptions are simple and usually bicubic downsampling. Thus, their performances will drop dramatically when the actual degradation does not match this assumption, and they lack the capability to handle multiple degradations (e.g. Gaussian noise, bicubic downsizing, and salt & pepper noise). To address the issues, in this paper, the authors propose a joint SR model (JIRSR) that can effectively handle multiple degradations in a single model. Specifically, the authors build the parallel Transformer and CNN branches that complement each other through bidirectional feature fusion. Moreover, the authors also adopt a random permutation of different kinds of noise and resizing operations to build the training datasets. Extensive experiments on classical SR, denoising, and multiple degradation removal demonstrate that the authors' JIRSR achieves state‐of‐the‐art (SOTA) performance on public benchmarks. Concretely, the authors' JIRSR outperforms the second‐best model by 0.23 to 0.74 dB for multiple degradations removal and is 0.20 to 0.36 dB higher than the SOTA methods on the Urban100 dataset under the ×4 SR task. [ABSTRACT FROM AUTHOR]

In recent years, the task of maritime emergency rescue has increased, while the cost of time for traditional methods of search and rescue is pretty long with poor effect subject to the constraints of the complex circumstances around the sea, the effective conditions, and the support capability. This paper applies deep learning and proposes a YOLOv5s‐SwinDS algorithm for target detection in distress at sea. Firstly, the backbone network of the YOLOv5s algorithm is replaced by swin transformer, and a multi‐level feature fusion module is introduced to enhance the feature expression ability for maritime targets. Secondly, deformable convolutional networks v2 (DCNv2) is used instead of traditional convolution to improve the recognition capability for irregular targets when the neck network features are output. Finally, the CIoU loss function is replaced with SIoU to reduce the redundant box effectively while accelerating the convergence and regression of the predicted box. Experimenting on the publicly dataset SeaDronesSee, the Precision$Precision$, Recall$Recall$, mAP0.5$mAP_{0.5}$ and mAP0.5−0.95$mAP_{0.5-0.95}$ of YOLOv5s‐SwinDS model are 87.9%, 75.8%, 79.1% and 42.9%, respectively, which get higher results than the original YOLOv5s model, the YOLOv7 series of models, and the YOLOv8 series of models. The experiments verifies that the algorithm has good performance in detecting maritime distress targets. [ABSTRACT FROM AUTHOR]

This paper proposes a new method for hierarchical image segmentation based on the nonsymetry and anti‐packing pattern representation model (NAM) and the hierarchical density‐based spatial clustering of application with noise (HDBSCAN). The proposed framework consists of two phases. In the first phase, a super‐pixel generation algorithm base on NAM is proposed. In the second phase, instead of defining an affinity matrix to merge similar regions using spatial clustering, the distance matrix defined by different region features is directly fitted into an HDBSCAN clustering module in order to merge similar regions efficiently. Similar adjacent regions can be merged into larger ones progressively and form a segmentation dendrogram for image segmentation with the clustering module. The experiments show that the proposed algorithm has a comparable or even better performance compared to the state‐of‐the‐art hierarchical image segmentation algorithms while having much less time and memory consumption. [ABSTRACT FROM AUTHOR]

Computer vision‐based fire detection algorithms have been extensively researched over the past decades as they offer reliable and efficient solutions to early fire detection, as well as economical solutions in outdoor environments. The proposed systems have different levels of complexity; nevertheless, they rely heavily on colour based fire segmentation as the first processing stage using different colour spaces. This paper presents a new flame‐based colour space which accentuates the difference between fire and non‐fire pixel values. The hybrid Artificial Bee Colony‐Teaching Learning‐based Optimisation (ABC‐TLBO) and the k‐medoids clustering algorithm along with a Feature image constructed manually from a wide dataset of fire and non‐fire pixels were used to deduce the optimised colour space conversion matrix. The latter can then be used to transform the RGB pixels from a camera feed into the new Flame‐based colour space for a more efficient fire segmentation. The proposed colour space is capable to separate fire and non‐fire pixels into two intensity classes, whereby the resulting between‐class variance is significantly widened; this maximises the effectiveness of the binary thresholding to separate fire from non‐fire pixels. The experimental results demonstrate that the proposed flame‐based colour space provides a superior average qualitative and quantitative performance on benchmark datasets compared to state‐of‐the‐art colour models; a 20% average increase in F1 score demonstrates a better balance between fire detection and false alarm rates. Moreover, the computation time of the fire detection system is faster by 15.6% in average. The proposed system provides a better implementation of the colour‐based fire segmentation processing stage in vision‐based fire detection systems; it vindicates, in this application context, the superiority of flame‐tuned colour space over conventional ones. [ABSTRACT FROM AUTHOR]

Aircraft coating process has been an important part in manufacturing process of modern aviation products. For coating defect detection, the manual observation with naked eyes is usually utilized, which leads to low production efficiency. In this paper, the authors propose the improved YOLOv5‐OBB with the channel‐spatial attention block (CSAB), feature pyramid non‐local module (FPNM) and structured sparsity slimming criterion (SSSC). The CSAB can pay more attention to effective channel information features from the channel dimension and the target information area from the spatial dimension. The effective non‐local module called FPNM is proposed to further improve the detection accuracy. The authors utilize the oriented bounding boxes (OBB) to reduce redundant background information for coating defect detection. In addition, the SSSC is proposed to achieve network slimming and trade‐off between the efficiency and accuracy. The experimental results on several datasets demonstrate the effectiveness of the authors' scheme, which achieves superior performance. [ABSTRACT FROM AUTHOR]

This paper focuses on the intelligent detection of prohibited items in X‐ray images during the security checking process. An intelligent semantic segmentation model of prohibited items in X‐ray images is proposed based on the attention‐based object localization method. Based on the pre‐trained CNN classification framework, the attention mechanism can map the high‐layer semantic information of objects into the input space, while generating energy saliency maps to locate the prohibited items. In order to make the obtained attention maps discriminative, the lateral and contrastive inhibition strategies are introduced and combined together which can highlight the responses of activated neurons. Under the guidance of attention responses, two traditional image segmentation algorithms are employed to achieve the semantic segmentation results for the prohibited items detection in X‐ray images. The proposed semantic segmentation model relies on weakly supervised learning mechanism, and only depends on the category labels of prohibited items, which greatly avoids the work cost of data semantic annotation. The experimental results based on the public SIXray baseline and the self‐built X‐ray image database demonstrate the proposed method can achieve about 65% IoU localization precise averagely. In addition, comparison experiments were carried out with the state‐of‐the‐arts and ablation experiments to verify the effectiveness of the proposed model. [ABSTRACT FROM AUTHOR]

The low‐light environment is integral to everyday activities but poses significant challenges in object detection. Due to the low brightness, noise, and insufficient illumination of the acquired image, the model's object detection performance is reduced. Opposing recent studies mainly developing using supervised learning models, this paper suggests LIDA‐YOLO, an approach for unsupervised adaptation of low‐illumination object detectors. The model improves the YOLOv3 by using normal illumination images as the source domain and low‐illumination images as the target domain and achieves object detection in low‐illumination images through an unsupervised learning strategy. Specifically, a multi‐scale local feature alignment and global feature alignment module are proposed to align the overall attributes of the image and feature biases such as background, scene, and target layout are thus reduced. The experimental results of LIDA‐YOLO on the ExDark dataset achieved the highest performance mAP score of 56.65% compared to several current state‐of‐the‐art unsupervised domain adaptation object detection methods. Compared to I3Net, the performance improvement is 4.04%, and compared to OSHOT, the performance improvement is 6.5%. LIDA‐YOLO achieves a performance improvement of 2.7% compared to the supervised baseline method YOLOv3. Overall, the suggested LIDA‐YOLO model requires fewer samples and presents a stronger generalization ability than previous works. [ABSTRACT FROM AUTHOR]

Video steganography has the potential to be used to convey illegal information, and video steganalysis is a vital tool to detect the presence of this illicit act. Currently, all the motion vector (MV)‐based video steganalysis algorithms extract feature sets directly from the MVs, but ignoring the embedding operation may perturb the statistical distribution of other video encoding elements, such as the skipped macroblocks (no direct MVs). This paper proposes a novel 11‐dimensional feature set to detect MV‐based video steganography based on the above observation. The proposed feature is extracted based on the skipped macroblocks by recompression calibration. Specifically, the feature consists of two components. The first is the probability distribution of motion vector prediction (MVP) difference, and the second is the probability distribution of partition state transfer. Extensive experiments on different conditions demonstrate that the proposed feature set achieves good detection accuracy, especially in lower embedding capacities. In addition, the loss of detection performance caused by recompression calibration using mismatched quantization parameters (QP) is within the acceptable range, so the proposed method can be used in practical scenarios. [ABSTRACT FROM AUTHOR]

Tuberculosis (TB) is an extremely contagious illness caused by Mycobacterium tuberculosis. Chest tuberculosis classification is conducted based on a deep convolutional neural network architecture. In this research, a pre‐trained network is utilized to demonstrate the advantage of using the oversampling technique on the classification of TB and compare results with recent research that used the same dataset. Therefore, the dataset consists of 3500 uninfected TB cases and 700 infected with TB. This paper circumvents the imbalance by using the oversampling technique in X‐ray TB images to be fed into several pre‐trained networks for TB classification. The oversampling technique is crucial in enhancing the performance of TB classification compared with other pre‐trained models reported here. Inceptionv3 shows a promising result compared to other pre‐trained models; it achieves 99.94% accuracy, 99.88% precision, 100% recall, and 99.94% F1‐Score. [ABSTRACT FROM AUTHOR]

The YOLO series of algorithms have made substantial contributions to the detection of insulator defects in power transmission line operations. However, existing target detection algorithms for the small target detection and low‐quality insulator images encounter difficulties in effectively capturing relevant features, resulting in a higher probability of target loss. To identify and classify defects in the operational state of insulators, an improved YOLOv8 target identification algorithm called DGW‐YOLOv8 is proposed in this paper. The deformable attention backbone of the DGW‐YOLOv8 target identification algorithm is designed by adding the deformable ConvNets v2 module and the global attention mechanism. This addition reduces the feature loss caused by the network feature processing, enhances the sensitivity of the algorithm to small‐scale targets, and reduces the impact caused by the different global positions of the targets. Additionally, to address the problem of low quality of captured images, WIoU v3 is used to replace CIoU in the original YOLOv8 target identification algorithm to optimize the loss function, reduce the degrees of freedom, and improve the network robustness. Experimental results demonstrate that the enhanced YOLOv8 algorithm can achieve an improvement of 2.4% and 5.5% in mAP and mAP50‐95, respectively, compared with the original algorithm. [ABSTRACT FROM AUTHOR]

Inverse halftoning is a technology that converts a binary image into a continuous tone image. Due to the wide application of inverse halftoning, many scholars have proposed several deep convolutional neural networks (DCNN) to optimize their performance. According to the observation, there is still room for improvement in content generation and detail recovery of the inverse halftone images generated by using the existing methods. Therefore, an inverse halftoning method based on supervised DCNN is proposed in this paper. The method consists of two parts: the multi‐level feature extraction model uses the down‐sampling to extract the features from the halftone image and remove the halftone noise dots on flat areas, which is implemented by four convolutional layers; the image reconstruction model uses up‐sampling to reconstruct image information, which is realized by four convolutional layers and two dense residual blocks. At the same time, in order to further recover the details, the down‐sampling feature maps and up‐sampling feature maps of the same size are concatenated by addition layers. Experimental results show that compared with other methods, the inverse halftone images obtained by the proposed network have better results in both subjective and objective evaluations. [ABSTRACT FROM AUTHOR]

The images captured by forest nighttime imaging devices are prone to degradation and noise issues due to environmental constraints. This paper proposes a novel framework based on the self‐calibrating illumination framework to improve image quality. The framework consists of four specific steps: (1) addressing non‐uniform degradation by estimating illuminance components through non‐uniform MaxRGB, (2) extracting rich information using multi‐scale inflationary convolution, (3) analyzing the relationship between different input levels and the initial level and progressively adjusting the luminance components using a channel self‐calibration module to achieve continuous improvement in luminance, and (4) designing a reflectance optimization module that enhances illuminance while suppressing noise through a regularization model. To evaluate the proposed method, a dataset comprising 1000 forest night images is constructed using an image simulation strategy. The effectiveness of this method was validated on both synthetic and real datasets, demonstrating its ability to significantly enhance nighttime forest images. When compared to six other algorithms, this method outperformed them in eight evaluation metrics, including a peak signal‐to‐noise ratio metric of 22.839 and a structural similarity metric of 0.909. The experimental results clearly indicate that this method excels in enhancing image quality and fidelity. [ABSTRACT FROM AUTHOR]

Hazy images suffer from two problems. The low contrast can be enhanced by estimating a transmission layer, and the colour cast can be restored by estimating an airlight. These two variables, together with the albedo layer, are the constitutive elements of a hazy image. The resulting quality of dehazed images is inextricably linked to the accurate estimation of these components. However, it is ill‐posed to decompose these variables from a single image. As such, this paper presents an innovative algorithm intended to facilitate the optimal decomposition of a hazy image. Using the Markov random field model, an optimal framework is established that allows the simultaneous estimation of the three components across the three‐colour channels. To improve the visual quality, three improvements are proposed in the variational solution for the optimal components. The dehazed result is recomposed from the components with the transmission enhanced to circumvent any potential artefacts or information loss. Extensive experiments on natural images corroborate that the proposed algorithm outperforms state‐of‐the‐art dehazing methods, both qualitatively and quantitatively. [ABSTRACT FROM AUTHOR]

Visual surveillance systems have been playing an important role in monitoring and managing at public areas. However, the computational complexity of video compression in these applications is still a great challenge. To meet practical requirements, the authors propose in this paper a low‐complexity surveillance video coding solution in which the most recent Versatile Video Coding (VVC) standard is improved with a novel learning adaptive motion search algorithm. The proposed algorithm is designed based on the temporal motion and spatial texture characteristics of surveillance videos. First, the authors study and define a list of spatial and temporal features which indicates the motion and texture characteristics of surveillance video. These features are used together with a machine learning algorithm to appropriately assign a search range for the VVC motion search. Second, to reduce search points, the authors propose an adaptive Test Zone (TZ) search in which TZ steps are early terminated following the variation of spatial–temporal features. Performance evaluation conducted for a rich set of surveillance videos and relevant benchmarks have shown the superiority of the proposed method, notably with around 33% of encoding time saving when compared with the state‐of‐the art VVC solution and relevant benchmarks while asking for negligible compression loss. [ABSTRACT FROM AUTHOR]

Image inpainting aims to repair the damaged region according to the known content in the damaged image. Recently, image inpainting methods have poor effects on high‐resolution damaged images, and the research on the inpainting of large‐area damaged images is limited. Therefore, this paper proposes an image inpainting method based on Generative Adversarial Networks (GAN) inversion and autoencoder. This work consists of two phases: first, the authors design an autoencoder‐based GAN, which learns the mapping from noise to low‐dimensional feature maps by training a generator, and then converts the generated feature maps into high‐resolution images. Thus, the difficulty of learning the mapping relationship is reduced. Second, the authors adopt the learning‐based GAN inversion to infer the closest latent code. The trained GAN is then used to reconstruct the complete image. Finally, the authors compare their method with other classical methods on the CelebAMask‐HQ, Flickr‐Faces‐HQ, and ImageNet datasets. According to the quantitative comparison, when the mask range is large, in other words, when the image has a large area of damage, the authors' method is superior to the comparison methods. According to the qualitative comparison, the structure of the high‐resolution image inpainted by the authors' method is more reasonable and the texture details are more realistic. [ABSTRACT FROM AUTHOR]

Visible‐infrared person re‐identification (VI‐ReID) aims to recognize images of the same person captured in different modalities. Existing methods mainly focus on learning single‐granularity representations, which have limited discriminability and weak robustness. This paper proposes a novel dual‐granularity feature fusion network for VI‐ReID. Specifically, a dual‐branch module that extracts global and local features and then fuses them to enhance the representative ability is adopted. Furthermore, an identity‐aware modal discrepancy loss that promotes modality alignment by reducing the gap between features from visible and infrared modalities is proposed. Finally, considering the influence of non‐discriminative information in the modal‐shared features of RGB‐IR, a greyscale conversion is introduced to extract modality‐irrelevant discriminative features better. Extensive experiments on the SYSU‐MM01 and RegDB datasets demonstrate the effectiveness of the framework and superiority over state‐of‐the‐art methods. [ABSTRACT FROM AUTHOR]