Search

Recent research has revealed that subtle imperceptible perturbations can deceive well-trained neural network models, leading to inaccurate outcomes. These instances, known as adversarial examples, pose significant threats to the secure application of machine learning techniques in safety-critical systems. In this paper, we delve into the study of one-pixel attacks in deep neural networks, recently reported as a kind of adversarial examples. To identify such one-pixel attacks, most existing methodologies rely on the differential evolution method, which utilizes random selection from the current population to escape local optima. However, the differential evolution technique might waste search time and overlook good solutions if the number of iterations is insufficient. Hence, in this paper, we propose a gradient ascent with momentum approach to efficiently discover good solutions for the one-pixel attack problem. As our method takes a more direct route to the goal compared to existing methods relying on blind random walks, it can effectively identify one-pixel attacks. Our experiments conducted on popular CNNs demonstrate that, in comparison with existing methodologies, our technique can detect one-pixel attacks significantly faster. [ABSTRACT FROM AUTHOR]

Simple Summary: To achieve targeted control of different wood-boring pests and targeted prevention of exotic invasions, it is necessary to classify the species of wood-boring pests. This paper collects feeding vibration signals of wood-boring pests using piezoelectric ceramic sensors and constructs a dataset. By applying attention mechanisms in both the time domain and the frequency domain, we design a novel CNN architecture named Residual Mixed Domain Attention Module Network (RMAMNet). RMAMNet significantly improves the accuracy of wood-boring pest classification, indicating its potential for effective pest monitoring and classification tasks. This study provides a new perspective and technical support for the automatic detection, classification, and early warning of wood-boring pests in forestry. Wood borers, such as the emerald ash borer and holcocerus insularis staudinger, pose a significant threat to forest ecosystems, causing damage to trees and impacting biodiversity. This paper proposes a neural network for detecting and classifying wood borers based on their feeding vibration signals. We utilize piezoelectric ceramic sensors to collect drilling vibration signals and introduce a novel convolutional neural network (CNN) architecture named Residual Mixed Domain Attention Module Network (RMAMNet).The RMAMNet employs both channel-domain attention and time-domain attention mechanisms to enhance the network's capability to learn meaningful features. The proposed system outperforms established networks, such as ResNet and VGG, achieving a recognition accuracy of 95.34% and an F1 score of 0.95. Our findings demonstrate that RMAMNet significantly improves the accuracy of wood borer classification, indicating its potential for effective pest monitoring and classification tasks. This study provides a new perspective and technical support for the automatic detection, classification, and early warning of wood-boring pests in forestry. [ABSTRACT FROM AUTHOR]

In recent years, with the rapid development of deep learning technology, a large number of excellent convolutional neural networks (CNNs) have been proposed, many of which are based on improvements to classical methods. Based on the Inception family of methods, depthwise separable convolution was applied to Xception to achieve lightweighting, and Inception-ResNet introduces residual connections to accelerate model convergence. However, existing improvements for the Inception module often neglect further enhancement of its receptive field, while increasing the receptive field of CNNs has been widely studied and proven to be effective in improving classification performance. Motivated by this fact, three effective expansion modules are proposed in this paper. The first expansion module, Inception expand (Inception-e) module, is proposed to improve the classification accuracy by concatenating more and deeper convolutional branches. To reduce the number of parameters for Inception e, this paper proposes a second expansion module—Equivalent Inception-e (Eception) module, which is equivalent to Inception-e in terms of feature extraction capability, but which suppresses the growth of the parameter quantity brought by the expansion by effectively reducing the redundant convolutional layers; on the basis of Eception, this paper proposes a third expansion module—Lightweight Eception (Lception) module, which crosses depthwise convolution with ordinary convolution to further effectively reduce the number of parameters. The three proposed modules have been validated on the Cifar10 dataset. The experimental results show that all these extensions are effective in improving the classification accuracy of the models, and the most significant effect is the Lception module, where Lception (rank = 4) on the Cifar10 dataset improves the accuracy by 1.5% compared to the baseline model (Inception module A) by using only 0.15 M more parameters. [ABSTRACT FROM AUTHOR]

Since plant diseases occurring during the growth process are a significant factor leading to the decline in both yield and quality, the classification and detection of plant leaf diseases, followed by timely prevention and control measures, are crucial for safeguarding plant productivity and quality. As the traditional convolutional neural network structure cannot effectively recognize similar plant leaf diseases, in order to more accurately identify the diseases on plant leaves, this paper proposes an effective plant disease image recognition method aECA-ResNet34. This method is based on ResNet34, and in the first and the last layers of this network, respectively, we add this paper's improved aECAnet with the symmetric structure. aECA-ResNet34 is compared with different plant disease classification models on the peanut dataset constructed in this paper and the open-source PlantVillage dataset. The experimental results show that the aECA-ResNet34 model proposed in this paper has higher accuracy, better performance, and better robustness. The results show that the aECA-ResNet34 model proposed in this paper is able to recognize diseases of multiple plant leaves very accurately. [ABSTRACT FROM AUTHOR]

The escalating worldwide power demand necessitates innovative solutions to address the emerging power crisis. Grid-synchronized electric vehicles (EVs) have emerged as a promising avenue for mitigating this crisis. The vehicle-to-grid technology is unique advanced smart grid concept by which the exchange of energy is allowed among grid and EV. The integration of EV and grid affects an entire power system causing imbalance in supply–demand, voltage and frequency. To minimize these issues, feasible optimization techniques are introduced in this paper. Lithium-ion batteries are initially charged via smart homes, and convolutional neural networks (CNN) are used to ascertain a battery's state of charge (SOC). A bidirectional SEPIC–zeta converter is employed in this paper by which voltage is either increased or decreased. The gating sequence for the converter is generated by means of adaptive neuro fuzzy inference system which depends on an estimated SOC. If the SOC is greater than 80%, battery is discharged using a SEPIC mode; if the SOC is lower than 80%, battery is charged by grid using the ZETA mode. By using a PI controller, active and reactive power are also controlled. Simulation results using MATLAB showcase the efficacy of the suggested approach. The bidirectional SEPIC–Zeta converter exhibits an impressive efficiency of 96% and a voltage gain ratio of 1:8 when compared to other converters. CNN-based SOC tracking achieves remarkable tracking efficiency of 92.3%, outperforming other tracking methods. The grid current total harmonic distortion is notably curtailed at 2.3%, and a power factor of 0.9 is achieved using PI-based grid synchronization. [ABSTRACT FROM AUTHOR]

Diseases of tomato leaves can seriously damage crop yield and financial rewards. The timely and accurate detection of tomato diseases is a major challenge in agriculture. Hence, the early and accurate diagnosis of tomato diseases is crucial. The emergence of deep learning has dramatically helped in plant disease detection. However, the accuracy of deep learning models largely depends on the quantity and quality of training data. To solve the inter-class imbalance problem and improve the generalization ability of the classification model, this paper proposes a cycle-consistent generative-adversarial-network-based Transformer model to generate diseased tomato leaf images for data augmentation. In addition, this paper uses a Transformer model and densely connected CNN architecture to extract multilevel local features. The Transformer module is utilized to capture global dependencies and contextual information accurately to expand the sensory field of the model. Experiments show that the proposed model achieved 99.45% accuracy on the PlantVillage dataset. The 2018 Artificial Intelligence Challenger dataset and the private dataset attained accuracies of 98.30% and 95.4%, and the proposed classification model achieved a higher accuracy and smaller model size compared to previous deep learning models. The classification model is generalizable and robust and can provide a stable theoretical framework for crop disease prevention and control. [ABSTRACT FROM AUTHOR]

This paper designs a new facial Expression recognition network called a multi‐scale feature Fusion Convolutional neural Network (EFCN). This network is proposed to solve two problems in the facial expression recognition task. First, there are many commonalities between faces of different expression categories, and the recognition task cannot be precisely performed when the commonality is greater than the individuality. Secondly, facial detail features have a significant impact on the final results of expression recognition, while the image detail features extracted by traditional convolutional neural networks are not sufficient. In order to address the above issues, the feature enhancement network (FEN) and the detail information enhancement module (DEM) are designed. The FEN fuses deep and shallow features. Accordingly, the feature map contains richer information, making it easy to identify the samples. The DEM extracts and fuses the features passed by the backbone network with multi‐scale features to enhance the network's ability to extract features from small regions of the face. We validated the proposed method on three datasets, RAF‐DB, CK+, and JAFFE, and achieved 84.50%, 97.86%, and 91.05% accuracy, respectively, and the experimental results showed the effectiveness of the proposed method in this paper. For example, on the JAFFE dataset, the recognition accuracy of this method surpasses the MLT method by 1.87%. [ABSTRACT FROM AUTHOR]

Single image super‐resolution (SISR) has gained significant attention in image processing and computer vision, driven by deep learning‐based models like convolutional neural networks (CNN). Yet, the resource‐intensive nature of these models poses challenges when deploying them on edge devices. To address this issue, resource‐constrained models need to be developed. While recent models like the information distillation network (IDN), the information multi‐distillation network (IMDN), the residual feature distillation network (RFDN), and so on, have attempted to reduce parameters and computational complexity, further optimization remains vital. Therefore, this paper presents an approach to enhancing the efficiency and lightweight nature of the SISR. We introduce a novel lightweight SR model by building upon the RFDN architecture, the winner of the AIM2020 and NTIRE2022 SR challenges. The proposed depthwise channel attention network (DWCAN) model makes some key changes to RFDN. First, it replaces the main residual feature distillation block (RFDB) with a depthwise channel attention block (DWCAB). Additionally, DWCAN includes a shallow residual block (SRB) with depthwise separable convolution (DW) and a channel attention (CA) block. The primary goal of our work is to significantly reduce model parameters, computational operations, inference time, and memory size while maintaining or improving a peak signal‐to‐noise ratio (PSNR) of 29 dB. The experimental results demonstrate the effectiveness of the proposed model. By applying our modifications, we achieve a notable reduction in model complexity, leading to an improved PSNR of 29.07 dB, up from RFDN's 29.04 dB on a diverse 2 K resolution (DIV2K) dataset. This underscores the potential of our lightweight model to balance computational efficiency and SR quality. Additionally, the proposed work is essential for the metaverse for two key reasons: (1) Enhancing visual quality by adding complex details to textures and objects, making the digital world feel more like reality. (2) Ensuring device compatibility across a range of gadgets, from smartphones to VR headsets, optimizing the metaverse experience for all users. In short, a lightweight single image super‐resolution model for image reconstruction is proposed in this paper. [ABSTRACT FROM AUTHOR]

Image semantic segmentation technology is one of the core research contents in the field of computer vision. With the improvement of computer performance and the continuous development of deep learning technology, researchers have more and more enthusiasm to study the actual effect and performance of image semantic segmentation. The results of deep semantic segmentation allow computers to have a more detailed and accurate understanding of images, and have a wide range of application needs in the fields of autonomous driving, intelligent security, medical imaging, remote sensing images, etc. However, the existing image semantic segmentation algorithms have the disadvantages of easy discontinuous results and insufficient prediction accuracy. In this paper, we take deep learning-based image semantic segmentation technology as the research object to explore the improvement of the image semantic segmentation algorithm and its application in road scenarios. First, this paper proposes MCU-Net method based on residual fusion and multi-scale contextual information. MCU-Net uses residual fusion module to deepen the network structure and improve the ability of U-Net to acquire deeper features. Then a top-down and bottom-up path is constructed for feature information between different levels, and the spatial and semantic information contained in shallow and deep features in the network is fully utilized by fusing features from different levels. In addition, an enhanced void space pyramid pooling module is added for feature information between the same levels, which enables the output features to have a larger range of semantic information. Second, this paper proposes the DAMCU-Net method based on attention mechanism and edge detection based on MCU-Net. DAMCU-Net extracts global contextual information by the attention mechanism optimization module, while fusing features using dense jump connections to facilitate the network to recover more spatial detail information during upsampling, and uses the FReLU activation function to improve the segmentation capability of the network for complex targets. For the edge information lost in the feature extraction process, the edge detection branch is added to supplement the feature information of the main path by feature fusion to achieve the optimization of the edge information. [ABSTRACT FROM AUTHOR]

This paper focuses on deep vision sensing-assisted gesture recognition for athletes in dynamic scenes. Although many research attention had been devoted to this field in recent years, most of existing works failed to fully take characteristics of dynamic scenes into consideration. To deal with this challenge, this paper proposes a diffusion convolution neural network-based multiview gesture recognition approach in dynamic scenes. For one thing, the dynamic spatiotemporal slice position selection based on the body mask heatmap is adopted to calculate positions of horizontal and vertical slices. Thus, the dynamic selection of slice positions in two directions can be realized, and then the extraction of bi-directional spatiotemporal slice images can be completed. For another, action sequences through the 3D residual neural network are learned, and the spatiotemporal information among frames are mined through recurrent networks. Through their combination, a multi-view gesture recognition approach for athletes is constructed. In the experiments, two standard datasets UCF101 and HMDB51 are utilized to establish simulation environment. The proposed method can reach the accuracy beyond 95% on the two datasets. Compared with several typical recognition methods, the proposed method shows higher accuracy. [ABSTRACT FROM AUTHOR]

Mobile crowdsensing (MCS) systems rely on the collective contribution of sensor data from numerous mobile devices carried by participants. However, the open and participatory nature of MCS renders these systems vulnerable to adversarial attacks or data poisoning attempts where threat actors can inject malicious data into the system. There is a need for a detection system that mitigates malicious sensor data to maintain the integrity and reliability of the collected information. This paper addresses this issue by proposing an adaptive and robust model for detecting malicious data in MCS scenarios involving sensor data from mobile devices. The proposed model incorporates an adaptive learning mechanism that enables the TCN-based model to continually evolve and adapt to new patterns, enhancing its capability to detect novel malicious data as threats evolve. We also present a comprehensive evaluation of the proposed model's performance using the SherLock datasets, demonstrating its effectiveness in accurately detecting malicious sensor data and mitigating potential threats to the integrity of MCS systems. Comparative analysis with existing models highlights the performance of the proposed TCN-based model in terms of detection accuracy, with an accuracy score of 98%. Through these contributions, the paper aims to advance the state of the art in ensuring the trustworthiness and security of MCS systems, paving the way for the development of more reliable and robust crowdsensing applications. [ABSTRACT FROM AUTHOR]

This paper presents a novel sound event detection (SED) system for rare events occurring in an open environment. Wavelet multiresolution analysis (MRA) is used to decompose the input audio clip of 30 seconds into five levels. Wavelet denoising is then applied on the third and fifth levels of MRA to filter out the background. Significant transitions, which may represent the onset of a rare event, are then estimated in these two levels by combining the peak-finding algorithm with the K-medoids clustering algorithm. The small portions of one-second duration, called 'chunks' are cropped from the input audio signal corresponding to the estimated locations of the significant transitions. Features from these chunks are extracted by the wavelet scattering network (WSN) and are given as input to a support vector machine (SVM) classifier, which classifies them. The proposed SED framework produces an error rate comparable to the SED systems based on convolutional neural network (CNN) architecture. Also, the proposed algorithm is computationally efficient and lightweight as compared to deep learning models, as it has no learnable parameter. It requires only a single epoch of training, which is 5, 10, 200, and 600 times lesser than the models based on CNNs and deep neural networks (DNNs), CNN with long short-term memory (LSTM) network, convolutional recurrent neural network (CRNN), and CNN respectively. The proposed model neither requires concatenation with previous frames for anomaly detection nor any additional training data creation needed for other comparative deep learning models. It needs to check almost 360 times fewer chunks for the presence of rare events than the other baseline systems used for comparison in this paper. All these characteristics make the proposed system suitable for real-time applications on resource-limited devices. [ABSTRACT FROM AUTHOR]

Due to the uncertainty of weather conditions and the nonlinearity of high-dimensional data, as well as the need for a continuous and stable power supply to the power system, traditional regression analysis and time series forecasting methods are no longer able to meet the high accuracy requirements of today's PV power forecasting. To significantly improve the prediction accuracy of short-term PV output power, this paper proposes a short-term PV power forecasting method based on a hybrid model of temporal convolutional networks and gated recurrent units with an efficient channel attention network (TCN-ECANet-GRU) using the generated data of an Australian PV power station as the research object. First, temporal convolutional networks (TCNs) are used as spatial feature extraction layers, and an efficient channel attention network (ECANet) is embedded to enhance the feature capture capability of the convolutional network. Then, the GRU is used to extract the timing information for the final prediction. Finally, based on the experimental validation, the TCN-ECANet-GRU method generally outperformed the other baseline models in all four seasons of the year according to three performance assessment metrics: the normalized root mean square error (RMSE), normalized mean absolute error (MAE) and coefficient of determination (R2). The best RMSE, MAE and R2 reached 0.0195, 0.0128 and 99.72%, respectively, with maximum improvements of 11.32%, 8.57% and 0.38%, respectively, over those of the suboptimal model. Therefore, the model proposed in this paper is effective at improving prediction accuracy. Using the proposed method, this paper concludes with multistep predictions of 3, 6, and 9 steps, which also indicates that the proposed method significantly outperforms the other models. [ABSTRACT FROM AUTHOR]

Using the CRISPR-Cas9 system to perform base substitutions at the target site is a typical technique for genome editing with the potential for applications in gene therapy and agricultural productivity. When the CRISPR-Cas9 system uses guide RNA to direct the Cas9 endonuclease to the target site, it may misdirect it to a potential off-target site, resulting in an unintended genome editing. Although several computational methods have been proposed to predict off-target effects, there is still room for improvement in the off-target effect prediction capability. In this paper, we present an effective approach called CRISPR-M with a new encoding scheme and a novel multi-view deep learning model to predict the sgRNA off-target effects for target sites containing indels and mismatches. CRISPR-M takes advantage of convolutional neural networks and bidirectional long short-term memory recurrent neural networks to construct a three-branch network towards multi-views. Compared with existing methods, CRISPR-M demonstrates significant performance advantages running on real-world datasets. Furthermore, experimental analysis of CRISPR-M under multiple metrics reveals its capability to extract features and validates its superiority on sgRNA off-target effect predictions. Author summary: Genome editing using the CRISPR-Cas9 system, particularly base substitutions directed by guide RNA, holds immense potential for applications in gene therapy and agricultural productivity. However, the risk of unintended off-target effects poses a challenge, as misdirection of the Cas9 endonuclease can lead to unintended genome alterations. While computational methods exist for predicting off-target effects, there remains a need for encoding methods with more representation space and deep learning models with generalization capability and the adaptability. This paper introduces CRISPR-M, an innovative approach addressing the limitations of existing methods in predicting off-target effects, especially for target sites with indels and mismatches. CRISPR-M employs a novel encoding scheme and a multi-view deep learning model, combining convolutional neural networks and bidirectional long short-term memory recurrent neural networks. The three-branch network structure enhances the prediction accuracy by considering multiple perspectives. Compared with previous representative methods, CRISPR-M exhibits remarkable performance advantages when applied to real-world datasets. The experimental evaluation of CRISPR-M, assessed by various metrics such as ROC, PRC, GC content and melting temperature, demonstrates its ability to extract meaningful features and establishes its superiority in predicting off-target effects of sgRNA. [ABSTRACT FROM AUTHOR]

Utilizing multi-modal data, as opposed to only hyperspectral image (HSI), enhances target identification accuracy in remote sensing. Transformers are applied to multi-modal data classification for their long-range dependency but often overlook intrinsic image structure by directly flattening image blocks into vectors. Moreover, as the encoder deepens, unprofitable information negatively impacts classification performance. Therefore, this paper proposes a learnable transformer with an adaptive gating mechanism (AGMLT). Firstly, a spectral–spatial adaptive gating mechanism (SSAGM) is designed to comprehensively extract the local information from images. It mainly contains point depthwise attention (PDWA) and asymmetric depthwise attention (ADWA). The former is for extracting spectral information of HSI, and the latter is for extracting spatial information of HSI and elevation information of LiDAR-derived rasterized digital surface models (LiDAR-DSM). By omitting linear layers, local continuity is maintained. Then, the layer Scale and learnable transition matrix are introduced to the original transformer encoder and self-attention to form the learnable transformer (L-Former). It improves data dynamics and prevents performance degradation as the encoder deepens. Subsequently, learnable cross-attention (LC-Attention) with the learnable transfer matrix is designed to augment the fusion of multi-modal data by enriching feature information. Finally, poly loss, known for its adaptability with multi-modal data, is employed in training the model. Experiments in the paper are conducted on four famous multi-modal datasets: Trento (TR), MUUFL (MU), Augsburg (AU), and Houston2013 (HU). The results show that AGMLT achieves optimal performance over some existing models. [ABSTRACT FROM AUTHOR]

Object detection has made significant strides in recent years, but it remains a challenging task to accurately and quickly identify and detect objects. While humans can easily recognize objects in images or videos regardless of their appearance, computers face difficulties in this task. Object detection plays a crucial role in computer vision and finds applications in various domains such as healthcare, security, agriculture, home automation and more. To address the challenges of object detection, several techniques have been developed including RCNN, Faster RCNN, YOLO and Single Shot Detector (SSD). In this paper, we propose a modified YOLOv5s architecture that aims to improve detection performance. Our modified architecture incorporates the C3Ghost module along with the SPP and SPPF modules in the YOLOv5s backbone network. We also utilize the Adam and Stochastic Gradient Descent (SGD) optimizers. The paper also provides an overview of three major versions of the YOLO object detection model: YOLOv3, YOLOv4 and YOLOv5. We discussed their respective performance analyses. For our evaluation, we collected a database of pig images from the ICAR-National Research Centre on Pig farm. We assessed the performance using four metrics such as Precision (P), Recall (R), F1-score and mAP @ 0.50. The computational results demonstrate that our method YOLOv5s architecture achieves a 0.0414 higher mAP while utilizing less memory space compared to the original YOLOv5s architecture. This research contributes to the advancement of object detection techniques and showcases the potential of our modified YOLOv5s architecture for improved performance in real world applications. [ABSTRACT FROM AUTHOR]

In the stochastic and dynamic edge-cloud collaborative environment, the computing resources of the host are limited, and the resource requirements of computing tasks are random and changeable. Therefore, how to efficiently schedule dynamic tasks and improve system performance becomes challenging. The scheduling algorithm based on deep reinforcement learning optimizes the delay and energy consumption of the system by dynamically interacting with the environment, which can solve the problem of dynamic and changeable environment to a certain extent, but there are still problems such as poor model adaptability, low training efficiency, and unbalanced system load. In this paper, aiming at optimizing the average response time of task scheduling and the average energy consumption of the system, a multi-objective task scheduling model is designed, and a task scheduling policy optimization algorithm based on improved asynchronous advantage actor-critic (A3C) is proposed. The residual convolutional neural network (RCNN) improves the network structure of A3C, using asynchronous multi-threaded training methods to interact with the edge-cloud collaborative environment and capturing the random dynamic characteristics of resources required for computing tasks and heterogeneous edge-cloud hosts resource change characteristics to better adapt to random dynamic environments, and it can quickly updating network parameters, improving training speed, and make full use of host resources to solve system load imbalance problems. Simulation results show that the scheduling algorithm proposed in this paper can effectively reduce task response time and system energy consumption in an edge-cloud collaborative environment. [ABSTRACT FROM AUTHOR]

Underwater pipelines are exposed to harsh environments, including high salinity, multi-modal vortex corrosion, and severe wave interference. Their safety is essential for the development and transportation of marine energy. Therefore, real-time safety monitoring of long-distance energy pipelines is of great strategic importance for ensuring the safety of life and property and energy security. With the rapid development of energy development, the corrosion and leakage mechanisms of natural gas pipelines, as well as their identification and early warning, have become the focus of attention. Optical fiber sensing technology has been applied to various energy safety monitoring fields. However, the mechanism of sound source fluctuations in pipeline leakage and the mutual coupling mechanism between distributed optical fiber sensing technology and leakage sound waves are not yet clear. This paper establishes a model based on sound wave propagation and leakage noise response, derives a quadratic fitting relationship between pipeline pressure fluctuations and leakage orifices and a relationship between leakage noise source standard deviation and orifices, and proposes a complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) permutation entropy underwater natural gas pipeline leakage signal recognition method based on distributed optical fiber acoustic sensing technology. The results of theoretical analysis are verified by experiments. It shows that the signal processing method of CEEMDAN permutation entropy is superior to traditional noise reduction methods, which can better preserve the features of the original signal; the radial basis function (RBF) neural network model can accurately identify four different leakage features with an accuracy of 88.15%, and its recognition stability and generalization ability are superior to convolutional neural network, backpropagation, and random forest. Therefore, the research results of this paper provide a new method for safety monitoring in the application of energy pipeline transportation engineering, and expand the potential application scenarios of distributed acoustic sensing sensor systems and RBF neural networks. [ABSTRACT FROM AUTHOR]

Deep Self-Attention Network (Transformer) is an encoder–decoder architectural model that excels in establishing long-distance dependencies and is first applied in natural language processing. Due to its complementary nature with the inductive bias of convolutional neural network (CNN), Transformer has been gradually applied to medical image processing, including kidney image processing. It has become a hot research topic in recent years. To further explore new ideas and directions in the field of renal image processing, this paper outlines the characteristics of the Transformer network model and summarizes the application of the Transformer-based model in renal image segmentation, classification, detection, electronic medical records, and decision-making systems, and compared with CNN-based renal image processing algorithm, analyzing the advantages and disadvantages of this technique in renal image processing. In addition, this paper gives an outlook on the development trend of Transformer in renal image processing, which provides a valuable reference for a lot of renal image analysis. [ABSTRACT FROM AUTHOR]

This paper realizes infrared image denoising, recognition, and semantic segmentation for complex electrical equipment and proposes a thermal fault diagnosis method that incorporates temperature differences. We introduce a deformable convolution module into the Denoising Convolutional Neural Network (DeDn-CNN) and propose an image denoising algorithm based on this improved network. By replacing Gaussian wrap-around filtering with anisotropic diffusion filtering, we suggest an image enhancement algorithm that employs Weighted Guided Filtering (WGF) with an enhanced Single-Scale Retinex (Ani-SSR) technique to prevent strong edge halos. Furthermore, we propose a refined detection algorithm for electrical equipment that builds upon an improved RetinaNet. This algorithm incorporates a rotating rectangular frame and an attention module, addressing the challenge of precise detection in scenarios where electrical equipment is densely arranged or tilted. We also introduce a thermal fault diagnosis approach that combines temperature differences with DeeplabV3 + semantic segmentation. The improved RetinaNet's recognition results are fed into the DeeplabV3 + model to further segment structures prone to thermal faults. The accuracy of component recognition in this paper achieved 87.23%, 86.54%, and 90.91%, with respective false alarm rates of 7.50%, 8.20%, and 7.89%. We propose a comprehensive method spanning from preprocessing through target recognition to thermal fault diagnosis for infrared images of complex electrical equipment, providing practical insights and robust solutions for future automation of electrical equipment inspections. [ABSTRACT FROM AUTHOR]

Intelligent fault diagnosis utilizing deep learning algorithms is currently a topic of great interest. When developing a new Convolutional Neural Network (CNN) architecture to address machine diagnosis problem, it is common to use a deep model, with many layers, many feature maps, and large kernels. These models are capable of learning complex relationships and can potentially achieve superior performance on test data. However, not only does a large network potentially impose undue computational complexity for training and eventual deployment, it may also lead to more brittleness—where data outside of the curated dataset used in CNN training and evaluation is poorly handled. Accordingly, this paper will investigate a methodical approach for identifying a quasi-optimal CNN architecture to maximize robustness when a model is trained under one set of operating conditions, and deployed under a different set of conditions. Optuna software will be used to optimize a baseline CNN model for robustness to different rotational speeds and bearing Model #'s. To further improve the network generalization capabilities, this paper proposes the addition of white Gaussian noise to the raw vibration training data. Results indicate that the number of trainable weights and associated multiplications in the optimized model were reduced by almost 95% without jeopardizing the network classification accuracy. Additionally, moderate Additive White Gaussian Noise (AWGN) improved the model adaptation capabilities. [ABSTRACT FROM AUTHOR]

For insulated gate bipolar transistor (IGBT) modules using wire bonding as the interconnection method, the main failure mechanism is cracking of the bonded interface. Studying the mechanical properties of the bonded interface is crucial for assessing the reliability of IGBT modules. In this paper, first, shear tests are conducted on the bonded interface to test the bonded interface's strength. Then, finite element–cohesive zone modeling (FE-CZM) is established to describe the mechanical behavior of the bonded interface. A novel machine learning (ML) architecture integrating a convolutional neural network (CNN) and a long short-term memory (LSTM) network is used to identify the shape and parameters of the traction separation law (TSL) of the FE-CZM model accurately and efficiently. The CNN-LSTM architecture not only has excellent feature extraction and sequence-data-processing abilities but can also effectively address the long-term dependency problem. A total of 1800 sets of datasets are obtained based on numerical computations, and the CNN-LSTM architecture is trained with load–displacement (F–δ) curves as input parameters and TSL shapes and parameters as output parameters. The results show that the error rate of the model for TSL shape prediction is only 0.186%. The performance metric's mean absolute percentage error (MAPE) is less than 3.5044% for all the predictions of the TSL parameters. Compared with separate CNN and LSTM architectures, the proposed CNN-LSTM-architecture approach exhibits obvious advantages in recognizing TSL shapes and parameters. A combination of the FE-CZM and ML methods in this paper provides a promising and effective solution for identifying the mechanical parameters of the bonded interfaces of IGBT modules. [ABSTRACT FROM AUTHOR]

Accurate power load prediction is an important guide for power system planning and operation. High‐ or low‐load prediction results will affect the operation of the power system. In recent years, deep learning technology represented by convolution neural network (CNN) and transformer has been proved to be suitable for power load prediction. This paper proposes a new short‐term power load hybrid forecasting model, called channel enhanced attention (CEA) and temporal convolutional network (TCN)‐based transformer comprehensive forecasting model. This method combines the short‐term feature extraction ability of TCN with the long‐term dependent capture ability of transformer for short‐term load forecasting. And the CEA designed in this study is added to improve the prediction accuracy. On the same dataset, the designed model predicts power load mean square errors of 0.056 and 0.146 for the next 24 h and the next week, respectively, which is 0.002 to 0.073 and 0.012 to 0.024 lower than the baseline model. The experimental results show that the hybrid short‐term power load prediction model proposed in this paper is significantly better than the existing methods. The predicted curve is in agreement with the actual charge change, which provides a good guidance for short‐term power load prediction. [ABSTRACT FROM AUTHOR]

Microscopic image analysis technology helps solve the inadvertences of artificial traditional methods in disease, wastewater treatment, and environmental change monitoring analysis. Convolutional neural network (CNN) play an important role in microscopic image analysis. Image segmentation, in which U-Net is increasingly applied in microscopic image segmentation, is a crucial step in detection, tracking, monitoring, feature extraction, modelling, and analysis. This paper comprehensively reviews the development history of U-Net, analyses several research results of various segmentation methods since the emergence of U-Net, and conducts a comprehensive review of related papers. This paper summarised the improved methods of U-Net and then listed the existing significance of image segmentation techniques and their improvements introduced over the years. Finally, focusing on the different improvement strategies of U-Net in different papers, the related work of each application target is reviewed according to detailed technical categories to facilitate future research. Researchers can see the dynamics of the transmission of technological development and keep up with future trends in this interdisciplinary field. [ABSTRACT FROM AUTHOR]

Deep neural networks are extensively used in text mining and Natural Language Processing is to enable computers to understand, analyze, and generate natural language data, such as text or speech, but semantic resources, such as taxonomies and ontologies, are not fully included in deep learning. In this paper, we use Deep Convolutional Neural Network (Deep CNN) to classify research papers using the Computer Science Ontology, an ontology of research areas in the field of computer science. It takes as input the abstract and keywords of a particular research paper and returns the relevant research topic. To evaluate our ontology, we used a gold standard dataset that includes research articles. To further improve text classification results, we propose to design a Deep CNN model. We then used ontology matching to reduce the classes and get better results. Experimental results show that the proposed approach outperforms the one with the highest precision, recall, and F1-score. [ABSTRACT FROM AUTHOR]

Cancelable biometrics serves as an effective countermeasure against various template attacks launched by intruders, safeguarding the biometric system. This paper proposes a cancelable approach with a novel feature extraction technique for iris recognition, known as the hybrid architecture of the convolutional neural network (CNN) and GRU (gated recurrent unit). To provide cancelability to the system, the paper makes use of a random projection technique. The proposed method has the best outcome in terms of accurate identification. The method is validated on two Iris datasets IITD and MMU, which show promising results on the equal error rate (EER) and accuracy. The proposed model provides 0.02 and 0.045 EER for IITD and MMU, respectively, and accuracy 0.98 and 0.933%, for IITD and MMU Iris dataset, respectively, which is very high compared to other methodologies. The proposed hybrid architecture is being used for a cancelable biometric system for the first time based on literature review. The efficiency of the proposed method is high when validated on the datasets. [ABSTRACT FROM AUTHOR]

Since the emergence of big data, the popularity of deep learning models has increased and they are being implemented in a wide range of applications, including people detection and counting in congested environments. Detecting and counting people for human behavior analysis in retail stores is a challenging research problem due to the congested and crowded environment. This paper proposes a deep learning approach for detecting and counting people in the presence of occlusions and illuminance variation in a crowded retail environment, utilizing deep CNNs (DCNNs) for semantic segmentation of top-view depth visual data. Semantic segmentation has been implemented using (DCNNs) in recent years since it is a powerful approach. The objective of this paper is to design a novel architecture that consists of an encoder–decoder architecture. We were motivated to use transfer learning to solve the problem of insufficient training data. We used ResNet50 for the encoder, and we built the decoder part as a novel contribution. Our model was trained and evaluated on the TVHeads dataset and the people counting dataset (PCDS) that are available for research purposes. It consists of depth data of people captured from a top-view RGB-D sensor. The segmentation results indicate high accuracy and demonstrate that the proposed model is robust and accurate. [ABSTRACT FROM AUTHOR]

At present, in end-to-end network combined with deep learning in stereo matching, how to perceive ample image details within an acceptable range of computational cost, so as to improve the final matching accuracy, has become a hot research topic. In this paper, we design a cascaded disparity correction network based on DispNet, which can refine the initial disparity image by combining the process output results in the trunk network. The method proposed in this paper is named ETE–DC–CNN (end to end–disparity correction–convolutional neural network). In the trunk network, the mixed dilated convolution module is employed to extract the features of the original image, and the feature image is constructed into a 3D disparity space volume through depth-separable convolution, after which the initial disparity image can be obtained through 2D encoder–decoder module. In the correction network, the gradient information of the initial feature image is combined to reconstruct the modified matching cost body guided by the initial disparity image and then a smaller encoder–decoder module is trained and processed to make the final result at the sub-pixel level. The algorithm in this paper has been verified in SceneFlow and KITTI 2012/2015 data sets. The method proposed in this article achieves 3.46, 2.12, 1.19, and 0.6 results in the non-occluded area and 4.04, 2.55, 1.58, and 0.7 results in the global area on the Er (> 2 px), Er (> 3 px), Er (> 5 px), and Epe indicators in the KITTI 2012 test set, which are higher than those of the backbone network DispNet. [ABSTRACT FROM AUTHOR]

A major research subject in recent times is Alzheimer's disease (AD) due to the growth and considerable societal impacts on health. So, the detection of AD is essential for medication care. Early detection of AD is critical for effective treatment, and monitoring the time period between normal aging's unavoidable cognitive loss and dementia's more catastrophic degradation is common practice. The deep learning method for early diagnosis and automated categorization of AD has suddenly gained a lot of attention since rapid advancement in the field of GANs approaches has now been used in the clinical research sector. Many recent studies using brain MRI images and convolutional neural networks (CNNs) to identify Alzheimer's disease have yielded promising results. Instead of adequately engaging with the lack of real data, many research papers have focused on prediction. The main purpose of this paper is to do this by generating synthetic MRI images using a series of DCGANs. This paper demonstrates the effectiveness of this concept by cascading DCGANs that imitate different stages of Alzheimer's disease and utilizing SRGANs to enhance the resolution of MRI scans. The purpose of this research is to come forward and tell if an individual might just get Alzheimer's disease. CNN, DCGANs, and SRGANs are used in this paper to present a deep learning-based approach that improves classification and prediction accuracy to 99.7% and also handles the lack of data and the resolution of data. [ABSTRACT FROM AUTHOR]

The early and effective diagnosis of Alzheimer's disease (AD) and mild cognitive impairment (MCI) has received increasing attention in recent years. However, currently available deep learning methods often ignore the contextual spatial information contained in structural MRI images used for early diagnosis and classification of Alzheimer's disease. This may lead us to miss important structural details by failing to adequately capture the potential connections between each slice and its neighboring slices. This lack of contextual information may cause the accuracy of the network model to suffer, which in turn affects its generalization ability and application in real-life scenarios. To explore deeper the connection between spatial context slices, this research is designed to develop a new network model to effectively detect or predict AD by digging into the deeper spatial contextual structural information. In this paper, we design a spatial context network based on 3D convolutional neural network to learn the multi-level structural features of brain MRI images for AD classification. The experimental results show that the model has good stability, accuracy and generalization ability. Our experimental method had a classification accuracy of 92.6% in the AD/CN comparison, 74.9% in the AD/MCI comparison, and 76.3% in the MCI/CN comparison. In addition, this paper demonstrates the effectiveness of the proposed network model through ablation experiments. [ABSTRACT FROM AUTHOR]

Recent technological developments have enabled computers to identify and categorize facial expressions to determine a person's emotional state in an image or a video. This process, called "Facial Expression Recognition (FER)", has become one of the most popular research areas in computer vision. In recent times, deep FER systems have primarily concentrated on addressing two significant challenges: the problem of overfitting due to limited training data availability, and the presence of expression-unrelated variations, including illumination, head pose, image resolution, and identity bias. In this paper, a comprehensive survey is provided on deep FER, encompassing algorithms and datasets that offer insights into these intrinsic problems. Initially, this paper presents a detailed timeline showcasing the evolution of methods and datasets in deep facial expression recognition (FER). This timeline illustrates the progression and development of the techniques and data resources used in FER. Then, a comprehensive review of FER methods is introduced, including the basic principles of FER (components such as preprocessing, feature extraction and classification, and methods, etc.) from the pro-deep learning era (traditional methods using handcrafted features, i.e., SVM and HOG, etc.) to the deep learning era. Moreover, a brief introduction is provided related to the benchmark datasets (there are two categories: controlled environments (lab) and uncontrolled environments (in the wild)) used to evaluate different FER methods and a comparison of different FER models. Existing deep neural networks and related training strategies designed for FER, based on static images and dynamic image sequences, are discussed. The remaining challenges and corresponding opportunities in FER and the future directions for designing robust deep FER systems are also pinpointed. [ABSTRACT FROM AUTHOR]

The purpose of this paper is to investigate the utilization of artificial neural networks (ANNs) in learning models that address the nonlinear anisotropic flow and hysteresis retention behavior of deformable porous materials. Herein, the micro‐geometries of various networks of porous Bentheimer Sandstones subjected to several degrees of strain from the literature are considered. For the generation of the database required for the training, validation, and testing of the machine learning (ML) models, single‐phase and biphasic lattice Boltzmann (LB) simulations are performed. The anisotropic nature of the intrinsic permeability is investigated for the single‐phase LB simulations. Thereafter, the database contains the computed average fluid velocities versus the pressure gradients. In this database, the range of applied fluid pressure gradients includes Darcy as well as non‐Darcy flows. The generated output from the single‐phase flow simulations is implemented in a feed‐forward neural network, representing a path‐independent informed graph‐based model. Concerning the two‐phase LB simulations, the Shan‐Chen multiphase LB model is used to generate the retention curves of the cyclic drying/wetting processes in the deformed porous networks. Consequently, two different ML path‐dependent approaches, that is, 1D convolutional neural network and the recurrent neural network, are used to model the biphasic flow through the deformable porous materials. A comparison in terms of accuracy and speed of training between the two approaches is presented. Conclusively, the outcomes of the papers show the capability of the ML models in representing constitutive relations for permeability and hysteretic retention curves accurately and efficiently. [ABSTRACT FROM AUTHOR]

The demand of sports video recognition simulation is increasing, but the traditional methods have some limitations in dealing with optical problems. Therefore, the purpose of this paper is to improve the effect of image optical processing by using convolutional neural networks. This paper first analyzes the structure of convolutional neural networks commonly used in computer vision applications, and discusses the improved method of convolutional neural networks to better understand and represent human motion in motion videos. Based on the process analysis of sports video recognition results, the concrete steps of image optical processing are completed. The advantages of convolutional neural network in image optical processing are demonstrated by simulation experiments on some sports videos and comparison with traditional methods. The experimental results show that the image optical processing based on convolutional neural network has a high recognition rate and can be used as an effective auxiliary means for sports training. By accurately analyzing and understanding human movements in sports videos, coaches and trainers can provide more effective training programs tailored to the needs of individual athletes. This can lead to improved performance results and better overall results. [ABSTRACT FROM AUTHOR]

This paper addresses the application of a deep convolutional fuzzy system (DCFS) for the fault diagnosis of rolling element bearings. The limitations of the conventional deep convolutional neural network (CNN) are the huge computational load of training the tones of parameters and the lack of interpretability for the corresponding parameters. In this paper, a DCFS-based bearing fault diagnosis method under variable working conditions is proposed. The DCFS on a high dimensional input space is a multilayer connection of many low dimensional fuzzy systems, which can overcome the computational and interpretability problems of the traditional CNN. Moreover, to improve the identification efficiency and diagnosis accuracy, the infinite feature selection (Inf-FS) algorithm is employed to select the most informative fault features. The proposed approach is experimentally demonstrated to be able to identify the different fault types and fault severities of rolling bearings under variable running states. [ABSTRACT FROM AUTHOR]

The aptness of machine learning (ML) to learn from large datasets, discover trends, and make predictions has demonstrated its potential to metamorphose the medical field. Medical data analysis with ML algorithms can improve patient outcomes in terms of both treatment and diagnosis. This paper investigates the numerous possibilities of ML in the medical industries, including radiology, pathology, genomics, and clinical decision‐making. It also goes over the benefits and drawbacks of ML in various sectors as well as the limitations that come with its application. It illustrates the potential advantages of ML, such as better accuracy and efficiency in diagnosis and individualized treatment programs, through a review of previous studies. Lastly, it provides perspectives on prospective advancements and prospects for the discipline. This study also intends to investigate the applications of deep learning (DL) in the medical field. DL algorithms have performed exceptionally satisfactorily in several healthcare‐related fields. The main conclusions of the study are summarized, and their ramifications for the healthcare sector are discussed in this paper's conclusion. This paper intends to contribute to a greater understanding of the prevailing state of the discipline and the possibility for future developments by emphasizing the prospects of these methodologies to alter medical study and clinical practice. [ABSTRACT FROM AUTHOR]

With a large proportion of wind farms connected to the power grid, it brings more pressure on the stable operation of power systems in shorter time scales. Efficient and accurate scheduling, operation control and decision making require high time resolution power forecasting algorithms with higher accuracy and real-time performance. In this paper, we innovatively propose a high temporal resolution wind power forecasting method based on a light convolutional architecture—DC_LCNN. The method starts from the source data and novelly designs the dual-channel data input mode to provide different combinations of feature data for the model, thus improving the upper limit of the learning ability of the whole model. The dual-channel convolutional neural network (CNN) structure extracts different spatial and temporal constraints of the input features. The light global maximum pooling method replaces the flat operation combined with the fully connected (FC) forecasting method in the traditional CNN, extracts the most significant features of the global method, and directly performs data downscaling at the same time, which significantly improves the forecasting accuracy and efficiency of the model. In this paper, the experiments are carried out on the 1 s resolution data of the actual wind field, and the single-step forecasting task with 1 s ahead of time and the multi-step forecasting task with 1~10 s ahead of time are executed, respectively. Comparing the experimental results with the classical deep learning models in the current field, the proposed model shows absolute accuracy advantages on both forecasting tasks. This also shows that the light architecture design based on simple deep learning models is also a good solution in performing high time resolution wind power forecasting tasks. [ABSTRACT FROM AUTHOR]

Under the premise of ensuring the safe and stable operation of a wind–thermal–storage power system, this paper proposes an optimization model aimed at improving its overall economic efficiency and effectively reducing the peak-to-valley load difference. The model transforms the multi-objective optimization problem to solve a feasible interval of weight coefficients. We introduce a novel fusion model, where a Convolutional Neural Network (CNN) is melded with a Long Short-Term Memory Network (LSTM) to form the target network structure. Additionally, for datasets with limited samples, we incorporate a Self-Attention Mechanism (SAM) into the Model-Agnostic Meta-Learning (MAML). Ultimately, we build an MAML-SAM-CNN-LSTM network model to solve the interval of weight coefficients. An arithmetic validation of a modified IEEE 30-node system demonstrates that the MAML-SAM-CNN-LSTM network proposed in this paper can adeptly solve the feasible intervals of weight coefficients in the optimization model of the wind-thermal storage system. This is achieved under the constraints of the specified wind-thermal storage power system operation indexes. The evaluation indexes of the network model, including its accuracy, precision, recall, and F1 score, all exceed 98.72%, 98.57%, 98.30%, and 98.57%, respectively. This denotes a superior performance compared to the other three network models, offering an effective reference for optimizing decision-making and facilitating the enhanced realization of multi-objective, on-demand scheduling in the wind-thermal storage power system. [ABSTRACT FROM AUTHOR]

In this paper, an additive margin network with adaptive feature recalibration, AMNets, for handling a wide range of visual tasks, is proposed. The new AMNets consists of three improvements on convolutional neural networks: (1) squeeze‐and‐excitation mechanism was embedded into the the residual block of single layer to improve the performance of the classification, (2) softmax loss was replaced by the additive margin softmax loss to minimize intra‐class variance and maximize inter‐class variance, and (3) Adam optimizer was exploited to update iteratively the network parameters. Experiments on the Brain Stroke CT Image Dataset show that our additive margin network is quite effective to improve state‐of‐the‐art algorithms. Network algorithms have been extensively used in medical image field to pursuit a more accuracy of disease recognition. This paper proposes AMNets, an additive margin network with adaptive feature recalibration for handling a wide range of visual tasks in medicine. [ABSTRACT FROM AUTHOR]

Aiming at the sound source localization of mechanical faults in a strong reverberation scenario with multiple sound sources, this paper investigates a mechanical fault source localization method using the U-net deep convolutional neural network. The method utilizes the SRP-PHAT algorithm to calculate the response power spectra of the collected multichannel fault signals. Through the utilization of the U-net neural network, the response power spectra containing spurious peaks are transformed into "clean" estimated source distribution maps. By employing interpolation search, the estimated source distribution maps are processed to obtain location estimations for multiple fault sources. To validate the effectiveness of the proposed method, this paper constructs an experimental dataset using mechanical fault data from electromechanical equipment relays and conducts sound source localization experiments. The experimental results show that the U-net network under 0.2 s/0.5 s/0.7 s reverberation time can effectively eliminate spurious peak interference in the response power spectrum. As the signal-to-noise ratio decreases, it can still distinguish the sound sources with a distance of 0.2 m. In the context of multifault source localization, the method is capable of simultaneously locating the positions of four fault sources, with an average localization error of less than 0.02 m. The method in this paper effectively eliminates spurious peaks in the response power spectra under conditions of multisource strong reverberation. It accurately locates multiple mechanical fault sources, thereby significantly enhancing the efficiency of mechanical fault detection. [ABSTRACT FROM AUTHOR]

Accurate prediction of sea level height is critically important for the government in assessing sea level risk in coastal areas. However, due to the nonlinear, time-varying and highly uncertain characteristics of sea level change data, sea level prediction is challenging. To improve the accuracy of sea level prediction, this paper uses a new swarm intelligence algorithm named the sparrow search algorithm (SSA), which can imitate the foraging behavior and antipredation behavior of sparrows, to determine optimal solutions. To avoid the algorithm falling into a local optimal situation, this paper integrates the sine–cosine algorithm and the Cauchy variation strategy into the SSA to obtain an algorithm named the SCSSA. The SCSSA is used to optimize the parameter values of the CNN-BiLSTM (convolutional neural network combined with bidirectional long short-term memory neural network) model; finally, a combined neural network model (named SCSSA-CNN-BiLSTM) is proposed. In this paper, the time series data of seven tidal stations located in coastal China are used for experimental analysis. First, the SCSSA-CNN-BiLSTM model is compared with the CNN-BiLSTM model to predict the time series data of SHANWEI Station. With respect to the training and test sets of data, the SCSSA-CNN-BiLSTM model outperforms the other models on all the evaluation metrics. In addition, the remaining six tide station datasets and five neural network models, including the SCSSA-CNN-BiLSTM model, are used to further study the performance of the proposed prediction model. Four evaluation indices including the root mean squared error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE) and coefficient of determination (R2) are adopted. For six stations, the RMSE, MAE, MAPE and R2 of SCSSA-CNN-BiLSTM model are ranged from 20.9217 ~ 27.8427 mm, 9.4770 ~ 17.8603 mm, 0.1322% ~ 0.2482% and 0.9119 ~ 0.9759, respectively. The experimental analysis results show that the SCSSA-CNN-BiLSTM model makes effective predictions at all stations, and the prediction performance is better than that of the other models. Even though the combination of SCSSA algorithm may increase the complexity of the model, indeed the proposed model is a new prediction method with good accuracy and robustness for predicting sea level change. [ABSTRACT FROM AUTHOR]

Over the past decade, the use of biometrics in security systems and other applications has grown in popularity. ECG signals in particular are attracting increased attention due to their characteristics, which are required for a trustworthy identification system. The majority of ECG-based person identification systems are evaluated without considering the health-state of the individuals. Few person identification systems consider person-by-person health-state annotation. This paper proposes a person identification system considering the health-state annotated ECG signals where each person's beats overlap among variant arrhythmia classes. This overlapping between the normal class and other arrhythmia classes grants the ability to isolate normal beats in the train set from the Arrhythmic beats in the test set. Therefore, this paper investigates the effect of arrhythmic heartbeats on biometric recognition. An effective lightweight CNN based on depth-wise separable convolution (DWSC) is proposed to enhance the performance of person identification for several common arrhythmia types using the MITBIH dataset. The proposed methodology has been tested on nine arrhythmia types and presents how different types of arrhythmia affect ECG-based biometric systems differently. The experimental results show excellent recognition performance (99.28%) on normal heartbeats and (93.81%) on arrhythmic heartbeats, outperforming other models in terms of mean accuracy. [ABSTRACT FROM AUTHOR]

Power transformers play a critical role in the performance of power systems. This equipment is costly due to significant copper and iron prices and manufacturing costs. Therefore, maintenance and protection of such equipment is essential. Despite its robust performance, maloperation of differential protection (DP) in transformers may cause operational challenges to power system operators. The differential relay may operate incorrectly after the transformer energization leads to an inrush current (IC) and the relay identifies the event as an internal fault, and consequently issues the trip command. The other case of maloperation includes, but not limited to, a moment when the current transformer saturates due to an external fault. In this paper, a novel approach for DP is proposed, that is based on signal processing methods. In this paper, variational mode decomposition (VMD) and the deep neural network are implemented by using the convolutional neural network (CNN) and bi‐directional long short‐term memory (BiLSTM) models. The VMD decomposes differential current signal (DCS) to intrinsic mode functions with corresponding narrow‐band property frequency spectrums, which provides more detailed information about signal characteristics in different frequency bands. At the next stage, an effective feature for the BiLSTM is extracted by the CNN with the convolutional layers to classify events and proper discrimination. Extensive simulations on a 500 MVA transformer in MATLAB demonstrate the effectiveness of the proposed protection approach to differentiate ICs from internal and external faults with 99.8% accuracy in less than 1/8th of a power cycle. [ABSTRACT FROM AUTHOR]

A skeletal pose estimation method, named RVRU-Pose, is proposed to estimate the skeletal pose of vulnerable road users based on distributed non-coherent mmWave radar. In view of the limitation that existing methods for skeletal pose estimation are only applicable to small scenes, this paper proposes a strategy that combines radar intensity heatmaps and coordinate heatmaps as input to a deep learning network. In addition, we design a multi-resolution data augmentation and training method suitable for radar to achieve target pose estimation for remote and multi-target application scenarios. Experimental results show that RVRU-Pose can achieve better than 2 cm average localization accuracy for different subjects in different scenarios, which is superior in terms of accuracy and time compared to existing state-of-the-art methods for human skeletal pose estimation with radar. As an essential performance parameter of radar, the impact of angular resolution on the estimation accuracy of a skeletal pose is quantitatively analyzed and evaluated in this paper. Finally, RVRU-Pose has also been extended to the task of estimating the skeletal pose of a cyclist, reflecting the strong scalability of the proposed method. [ABSTRACT FROM AUTHOR]

This paper discusses optimizing desktop image quality and bandwidth consumption in remote IoT GUI desktop scenarios. Remote desktop tools, which are crucial for work efficiency, typically employ image compression techniques to manage bandwidth. Although JPEG is widely used for its efficiency in eliminating redundancy, it can introduce quality loss with increased compression. Recently, deep learning-based compression techniques have emerged, challenging traditional methods like JPEG. This study introduces an optimized RFB (Remote Frame Buffer) protocol based on a convolutional neural network (CNN) image compression algorithm, focusing on human visual perception in desktop image processing. The improved RFB protocol proposed in this paper, compared to the unoptimized RFB protocol, can save 30–80% of bandwidth consumption and enhances remote desktop image quality, as evidenced by improved PSNR and MS-SSIM values between the remote desktop image and the original image, thus providing superior desktop image transmission quality. [ABSTRACT FROM AUTHOR]

Stress has emerged as a major concern in modern society, significantly impacting human health and well-being. Statistical evidence underscores the extensive social influence of stress, especially in terms of work-related stress and associated healthcare costs. This paper addresses the critical need for accurate stress detection, emphasising its far-reaching effects on health and social dynamics. Focusing on remote stress monitoring, it proposes an efficient deep learning approach for stress detection from facial videos. In contrast to the research on wearable devices, this paper proposes novel Hybrid Deep Learning (DL) networks for stress detection based on remote photoplethysmography (rPPG), employing (Long Short-Term Memory (LSTM), Gated Recurrent Units (GRU), 1D Convolutional Neural Network (1D-CNN)) models with hyperparameter optimisation and augmentation techniques to enhance performance. The proposed approach yields a substantial improvement in accuracy and efficiency in stress detection, achieving up to 95.83% accuracy with the UBFC-Phys dataset while maintaining excellent computational efficiency. The experimental results demonstrate the effectiveness of the proposed Hybrid DL models for rPPG-based-stress detection. [ABSTRACT FROM AUTHOR]

In this paper, a fusion model based on convolution and self-attention with multi-subimage input model (CNN-SA-MS) is proposed to estimate significant wave height (SWH) from shipborne X-band radar images. The model takes multiple radar subimages as input simultaneously, which not only improves the accuracy of SWH inversion by including more information, but also avoids the restriction of selecting a single subimage in the upwind direction and dependence on external devices for wind data provision. Based on the characteristics of radar images and computational efficiency considerations, this paper selects three radar subimages as the input for the model. The comparison data from buoys and ECMWF are used for training and testing. After averaging the results of 64 radar images, the root mean square error (RMSE) and correlation coefficient (CC) of the CNN-SA-MS model are 0.197 m and 0.903, respectively. The results show that the CNN-SA-MS model improves the accuracy and stability of SWH estimation compared to single-subimage CNN regression model. For the two time periods with significant discrepancies between radar data and ECMWF predictions, we introduce satellite altimeter information as a source of reference for evaluation. The resulting analysis indicates that the significant wave height estimates generated by CNN-SA-MS model are more reliable. [ABSTRACT FROM AUTHOR]