Search

We present in this paper the state of the art and an analysis of recent research work and achievements performed in the domain of AI-based and vision-based systems for helping blind and visually impaired people (BVIP). We start by highlighting the recent and tremendous importance that AI has acquired following the use of convolutional neural networks (CNN) and their ability to solve image classification tasks efficiently. After that, we also note that VIP have high expectations about AI-based systems as a possible way to ease the perception of their environment and to improve their everyday life. Then, we set the scope of our survey: we concentrate our investigations on the use of CNN or related methods in a vision-based system for helping BVIP. We analyze the existing surveys, and we study the current work (a selection of 30 case studies) using several dimensions such as acquired data, learned models, and human–computer interfaces. We compare the different approaches, and conclude by analyzing future trends in this domain. [ABSTRACT FROM AUTHOR]

This study compares the performance of graph convolutional neural network (GCN) models with conventional natural language processing (NLP) models for classifying scientific literature related to radio frequency electromagnetic field (RF-EMF). Specifically, the study examines two GCN models: BertGCN and the citation-based GCN. The study concludes that the model achieves consistently good performance when the input text is long enough, based on the attention mechanism of BERT. When the input sequence is short, the composition parameter  λ , which combines output values of the two subnetworks of BertGCN, plays a crucial role in achieving high classification accuracy. As the value of  λ  increases, the classification accuracy also increases. The study also proposes and tests a simplified variant of BertGCN, revealing performance differences among the models under two different data conditions by the existence of keywords. This study has two main contributions: (1) the implementation and testing of a variant of BertGCN and citation-based GCN for document classification tasks related to radio frequency electromagnetic fields publications, and (2) the confirmation of the impact of model conditions, such as the existence of keywords and input sequence length, in the original BertGCN. Although this study focused on a specific domain, our approaches have broader implications that extend beyond scientific publications to general text classification. [ABSTRACT FROM AUTHOR]

This document discusses the recent advancements in decision support systems (DSSs) for disease detection and diagnosis. The combination of biomedical studies and information technology has led to the development of accessible and accurate solutions that can improve patient survival rates. The document highlights several research papers that cover a wide range of topics, including multiple sclerosis detection, neurodegenerative disease detection, breast lesion classification, COVID-19 mortality prediction, melanoma diagnosis, and prediction of second primary skin cancer. The adoption of efficient DSSs can aid clinical assessment, reduce misdiagnosis, and facilitate evidence-based decision-making. However, challenges such as validation, training, and user interface design need to be addressed for widespread application of DSSs in clinical practice. The document concludes by emphasizing the importance of future studies and developments in overcoming limitations and expanding the use of DSSs in different contexts. [Extracted from the article]

Rockfall movement is a significant hazard for infrastructure located in mountainous regions, and Paper [[9]] presents a numerical investigation on the relationship between damping and coefficient of restitution (COR) in rockfall movement. Geotechnical engineering is a complex field that deals with various hazards that can impact soil, rock, and other geologic materials. [Extracted from the article]

Long Short-Term Memory (LSTM)-Based Dog Activity Detection Using Accelerometer and Gyroscope. The third paper, authored by Jeong et al. [[14]], introduced a fall detection system that combines a simple threshold method (STM) and LSTM, creating the STM-LSTM-based fall detection system. With rapid advancements in artificial intelligence (AI), the Internet of Things (IOTs), and communication networks, the future of information and communication engineering (ICE) promises remarkable opportunities and challenges. 10.3390/app12199801 18 Zhang M., Wang C., Zhu W., Shen Y. An Intelligent DOA Estimation Error Calibration Method Based on Transfer Learning. [Extracted from the article]

This paper [[7]] addresses the challenges Intrusion Detection Systems (IDS) face in the Internet of Things (IoT) context due to IoT data's high dimensionality and diversity. The Internet of Things (IoT) has become an increasingly popular technology in recent years, enabling interconnectivity and communication between devices and systems. As a result, there is a growing need for advanced data analysis techniques and artificial intelligence (AI) methods to process, analyze, and extract valuable insights from IoT data. The proposed technique for tracking a moving object of interest in a noisy video using a modified simplest color balance algorithm and a binarization algorithm proved to be effective in building training data for machine learning. [Extracted from the article]

Video deepfake detection has emerged as a critical field within the broader domain of digital technologies driven by the rapid proliferation of AI-generated media and the increasing threat of its misuse for deception and misinformation. The integration of Convolutional Neural Network (CNN) with Long Short-Term Memory (LSTM) has proven to be a promising approach for improving video deepfake detection, achieving near-perfect accuracy. CNNs enable the effective extraction of spatial features from video frames, such as facial textures and lighting, while LSTM analyses temporal patterns, detecting inconsistencies over time. This hybrid model enhances the ability to detect deepfakes by combining spatial and temporal analysis. However, the existing research lacks systematic evaluations that comprehensively assess their effectiveness and optimal configurations. Therefore, this paper provides a comprehensive review of video deepfake detection techniques utilising hybrid CNN-LSTM models. It systematically investigates state-of-the-art techniques, highlighting common feature extraction approaches and widely used datasets for training and testing. This paper also evaluates model performance across different datasets, identifies key factors influencing detection accuracy, and explores how CNN-LSTM models can be optimised. It also compares CNN-LSTM models with non-LSTM approaches, addresses implementation challenges, and proposes solutions for them. Lastly, open issues and future research directions of video deepfake detection using CNN-LSTM will be discussed. This paper provides valuable insights for researchers and cyber security professionals by reviewing CNN-LSTM models for video deepfake detection contributing to the advancement of robust and effective deepfake detection systems. [ABSTRACT FROM AUTHOR]

Featured Application: The model proposed in this paper can help stock investors to get high returns on newly listed stocks. Most previous stock investing methods were unable to predict newly listed stocks because they did not have historical data on newly listed stocks. In this paper, we use the Q-learning algorithm based on a convolutional neural network and add sentiment analysis to establish a prediction method for Chinese stock investment tasks. There are 118 companies that are ranked in the Chinese top 150 list for two consecutive years in both 2022 and 2023. We collected all comments under the stock bar of these 118 stocks for each day from 1 January 2022 to 1 July 2024, totaling nearly 10 million comments. There are 90 stocks left after the preprocessing of 118 stocks. We use these 90 stocks as the dataset. The stock's closing price, volume, and comment text data are fed together to the agent, and the trained agent outputs investment behaviors that maximize future returns. We apply the trained model to two test sets that are completely different from the training set and compare it to several other methods. Our proposed method called SADQN-S obtains results of 1.1229 and 1.1054 on the two test sets. SADQN-S obtained higher final total assets than the other methods on both test sets. This shows that our model can help stock investors earn high returns on newly listed stocks. [ABSTRACT FROM AUTHOR]

The fifth IEEE International Conference on Applied System Innovation 2019 (IEEE ICASI 2019, https://2019.icasi-conf.net/), which was held in Fukuoka, Japan, on April 11-15, 2019, provided a unified communication platform for a wide range of topics. Technological innovation by mechanical engineering includes information technology (IT)-based intelligent mechanical systems, mechanics and design innovations, and applied materials in nanoscience and nanotechnology. The first technique is an algorithm for dynamic FCU temperature setting, which enables the FCU temperature to be set in accordance with changes in the outdoor temperature to satisfy the indoor thermal comfort of occupants. 10.3390/app9142792 9 Lin C.M., Liu H.Y., Tseng K.Y., Lin S.F. Heating, Ventilation, and Air Conditioning System Optimization Control Strategy Involving Fan Coil Unit Temperature Control. [Extracted from the article]

The rapid advancement of autonomous vehicle technology has brought into focus the critical need for enhanced road safety systems, particularly in the areas of road damage detection and surface classification. This paper explores these two essential components, highlighting their importance in autonomous driving. In the domain of road damage detection, this study explores a range of deep learning methods, particularly focusing on one-stage and two-stage detectors. These methodologies, including notable ones like YOLO and SSD for one-stage detection and Faster R-CNN for two-stage detection, are critically analyzed for their efficacy in identifying various road damages under diverse conditions. The review provides insights into their comparative advantages, balancing between real-time processing and accuracy in damage localization. For road surface classification, the paper investigates the classification techniques based on both environmental conditions and material road composition. It highlights the role of different convolutional neural network architectures and innovations at the neural level in enhancing classification accuracy under varying road and weather conditions. The main finding of this work is that it offers a comprehensive overview of the current state of the art, showcasing significant strides in utilizing deep learning for road analysis in autonomous vehicle systems. The study concludes by underscoring the importance of continued research in these areas to further refine and improve the safety and efficiency of autonomous driving. [ABSTRACT FROM AUTHOR]

To solve the problem of the Morlet wavelet transform not satisfying wavelet admissibility conditions, which results in fuzzy and aliasing time–frequency image features, this paper proposes an improved Morlet wavelet. The scale parameter is the wavelet's dominant frequency parameter. It largely satisfies the admissibility conditions and effectively improves the fuzzy aliasing effect of time–frequency image features. To further improve feature learning, this paper proposes a combined Morlet wavelet and residual network. The experimental results show that the accuracy of the proposed method is 10%, 4.5%, and 3% higher than that of LeNets, CNNs, and ResNets under varying load and noise disturbance levels, respectively. [ABSTRACT FROM AUTHOR]

Intelligent image and optical information processing have paved the way for the recent epoch of new intelligence and information era. This Special Issue focuses on the intelligent processing of images and optical information acquired by various imaging methods. Optimization and Clustering The theoretical aspects of optimization and clustering are emphasized in the last two papers. On the paper entitled 'An Effective Optimization Method for Machine Learning Based on ADAM', Dokkyun Yi, Jaehyun Ahn, and Sangmin Ji [[20]] proposed a novel optimization method for non-convex cost functions to make machine learning more efficient. [Extracted from the article]

In the rapidly evolving field of cybersecurity, the integration of multi-source, heterogeneous, and fragmented data into a coherent knowledge graph has garnered considerable attention. Such a graph elucidates semantic interconnections, thereby facilitating sophisticated analytical decision support. Central to the construction of a cybersecurity knowledge graph is Named Entity Recognition (NER), a critical technology that converts unstructured text into structured data. The efficacy of NER is pivotal, as it directly influences the integrity of the knowledge graph. The task of NER in cybersecurity, particularly within the Chinese linguistic context, presents distinct challenges. Chinese text lacks explicit space delimiters and features complex contextual dependencies, exacerbating the difficulty in discerning and categorizing named entities. These linguistic characteristics contribute to errors in word segmentation and semantic ambiguities, impeding NER accuracy. This paper introduces a novel NER methodology tailored for the Chinese cybersecurity corpus, termed CSBERT-IDCNN-BiLSTM-CRF. This approach harnesses Iterative Dilated Convolutional Neural Networks (IDCNN) for extracting local features, and Bi-directional Long Short-Term Memory networks (BiLSTM) for contextual understanding. It incorporates CSBERT, a pre-trained model adept at processing few-shot data, to derive input feature representations. The process culminates with Conditional Random Fields (CRF) for precise sequence labeling. To compensate for the scarcity of publicly accessible Chinese cybersecurity datasets, this paper synthesizes a bespoke dataset, authenticated by data from the China National Vulnerability Database, processed via the YEDDA annotation tool. Empirical analysis affirms that the proposed CSBERT-IDCNN-BiLSTM-CRF model surpasses existing Chinese NER frameworks, with an F1-score of 87.30% and a precision rate of 85.89%. This marks a significant advancement in the accurate identification of cybersecurity entities in Chinese text, reflecting the model's robust capability to address the unique challenges presented by the language's structural intricacies. [ABSTRACT FROM AUTHOR]

Intelligent image and optical information processing have paved the way for the recent epoch of new intelligence and information. Three-Dimensional Imaging Advances in three-dimensional imaging have enabled the capture and reconstruction of three-dimensional information. This Special Issue focuses on the intelligent processing of images and optical information such as object detection and classification and three-dimensional imaging. [Extracted from the article]

This study combines the present stage of the node classification problem with the fact that there is frequent noise in the graph structure of the graph convolution calculation, which can lead to the omission of some of the actual edge relations between nodes and the appearance of numerous isolated nodes. In this paper, we propose the graph neural network model ENode-GAT for improving the accuracy of small sample node classification using the method of external referencing of similar word nodes, combined with Graph Convolutional Neural Network (GCN), Graph Attention Network (GAT), and the early stop algorithm. In order to demonstrate the applicability of the model, this paper employs two distinct types of node datasets for its investigations. The first is the Cora dataset, which is widely used in node classification at this time, and the second is a small-sample Stock dataset created by Eastern Fortune's stock prospectus of the Science and Technology Board (STB). The experimental results demonstrate that the ENode-GAT model proposed in this paper obtains 85.1% classification accuracy on the Cora dataset and 85.3% classification accuracy on the Stock dataset, with certain classification advantages. It also verifies the future applicability of the model to the fields of stock classification, tender document classification, news classification, and government announcement classification, among others. [ABSTRACT FROM AUTHOR]

Every part of society relies on energy systems due to the growing population and the constant demand for energy. Because of the high energy demands of transportation, industry, and daily life, energy systems are crucial to every part of society. Electrical transmission lines are a crucial component of the electrical power system. Therefore, in order to determine the power system's protection plan and increase its reliability, it is critical to foresee and classify fault types. With this motivation, the main goal of this paper is to design a deep network model to classify faults in transmission lines based on real, generated, and publicly available datasets. A deep learning architecture that was based on a one-dimensional convolutional neural network (CNN) was utilized in this study. Accuracy, specificity, recall, precision, F1 score, ROC curves, and AUC were employed as performance criteria for the suggested model. Not only synthetic but also real data were used in this study. It has been seen that the created model can be used successfully for both real data and synthetic data. In order to measure the robustness of the network, it was tested with three different datasets consisting of real, generated, and publicly available datasets. In the paper, 1D CNN, one of the machine learning methods, was used on three different power systems, and it was observed that the machine learning method was successful in all three power systems. [ABSTRACT FROM AUTHOR]

The prediction of rock bursts is of paramount importance in ensuring the safety of coal mine production. In order to enhance the precision of rock burst prediction, this paper utilizes a working face of the Gengcun Coal Mine as a case study. The paper employs a three-year microseismic monitoring data set from the working face and employs a sensitivity analysis to identify three monitoring indicators with a higher correlation with rock bursts: daily total energy, daily maximum energy, and daily frequency. Three subsets are created from the 10-day monitoring data: daily frequency, daily maximum energy, and daily total energy. The impact risk score of the next day is assessed as the sample label by the expert assessment system. Sample input and sample label define the data set. The long short-term memory (LSTM) neural network is employed to extract the features of time series. The Bayesian optimization algorithm is introduced to optimize the model, and the Bayesian optimization–long short-term memory (BO-LSTM) combination model is established. The prediction effect of the BO-LSTM model is compared with that of the gated recurrent unit (GRU) and the convolutional neural network (1DCNN). The results demonstrate that the BO-LSTM combined model has a practical application value because the four evaluation indexes of the model are mean absolute error (MAE), mean absolute percentage error (MAPE), variance accounted for (VAF), and mean squared error (MSE) of 0.026272, 0.226405, 0.870296, and 0.001102, respectively. These values are better than those of the other two single models. The rock explosion prediction model can make use of the research findings as a guide. [ABSTRACT FROM AUTHOR]

Due to the high detection efficiency of the airborne time-domain electromagnetic method, it can quickly collect electromagnetic response data for large area-wide regions, but it also brings great challenges to the inversion interpretation of the data because there are numerous survey data that need to be inverted. Conventional optimal inversion and fast imaging methods still take a long time to obtain conductivity and depth information, which affect the efficiency of real-time data interpretation. In this paper, we present a deep learning inversion method that can be used to solve the fast inversion problem of airborne time-domain electromagnetic data; the method uses a one-dimensional convolutional neural network. The network structure consists of two parts containing different numbers of convolutional and pooling layers. The training sample dataset was generated via two ways of constructing geoelectric models through forward modelling. To check the effectiveness of our deep learning inversion strategy, we tested it on synthetic data and two types of survey data. The experimental results show that this inversion method is effective and that it can be applied to airborne time-domain electromagnetic data collected using different observation systems. The proposed inversion method can obtain better inversion results for both simple and complex stratigraphic structures and requires significantly less computation time compared to conventional optimal inversion methods. [ABSTRACT FROM AUTHOR]

The real-time monitoring and evaluation of water quality provides a scientific basis for water resource management and promotes regional sustainable development. This study established a database using Landsat-8 satellite data and water quality data from the Ningxia Yellow River basin in China, spanning 2021 to 2023, and this paper proposes a custom residual convolutional neural network model with a hybrid attention mechanism, referred to as PCWA-ResCNN. The accuracy of the model in predicting turbidity, permanganate, ammonia nitrogen, and dissolved oxygen concentration was more than 95%. Compared to convolutional neural networks and long short-term memory models, this model performed better in predicting water quality parameters with significantly improved prediction performance. In terms of spatial distribution, the pollution degree in the middle reaches of the basin is relatively serious. However, the overall water quality is good, being mainly Class I and Class II water quality. The hybrid model established in this paper can better capture the complex nonlinear relationship between the observed values and the surface water reflectance, showing strong robustness. This model can be used for the water quality monitoring of complex inland rivers and lakes, and it can also provide effective support for relevant government departments to formulate scientific and reasonable water quality management policies. [ABSTRACT FROM AUTHOR]

Featured Application: This work provides a systematic way to produce a defect-free atom array of neutral atom platforms for quantum information processing. This paper aims to present an approach to address the atom rearrangement problem by developing Convolutional Neural Network (CNN) models. These models predict the coordinates for atom movements while ensuring collision-free transitions and filling all vacancies in the target array. The process begins with designing a cost function for the assignment problem that incorporates constraints to prevent collisions and guarantee vacancy filling. We then build and train CNN models using datasets for three different grid sizes: 10 × 10 ,   13 × 13 ,   and   21 × 21 . Our models achieve high accuracy in predicting atom positions, with individual position accuracies of 99.63%, 98.93%, and 97.24%, respectively, for the aforementioned grid sizes. Despite limitations in training larger models due to hardware constraints, our approach demonstrates significant improvements in speed and accuracy. The final section of the paper presents detailed accuracy results and calculation times for each model, highlighting the potential of CNN-based methods in optimizing atom rearrangement processes. [ABSTRACT FROM AUTHOR]

Drone area coverage primarily involves using unmanned aerial vehicles (UAVs) for extensive monitoring, surveying, communication, and other tasks over specific regions. The significance and value of this technology are multifaceted. Firstly, UAVs can rapidly and efficiently reach remote or inaccessible areas to perform tasks such as terrain mapping, disaster monitoring, or search and rescue, significantly enhancing response speed and execution efficiency. Secondly, drone area coverage in agricultural monitoring, forestry conservation, and urban planning offers high-precision data support, aiding scientists and decision-makers in making more accurate judgments and decisions. Additionally, drones can serve as temporary communication base stations in areas with poor communication, ensuring the transfer of crucial information. Drone area coverage technology is vital in improving work efficiency, reducing costs, and strengthening decision support. This paper aims to solve the optimization problem of multi-UAV area coverage flight path planning to enhance system efficiency and task execution capability. For multi-center optimization problems, a region decomposition method based on the Voronoi graph is designed, transforming the multi-UAV area coverage issue into the single-UAV area coverage problem, greatly simplifying the complexity and computational process. For the single-UAV area coverage problem and its corresponding area, this paper contrives a convolutional neural network with the channel and spatial attention mechanism (CSAM) to enhance feature fusion capability, enabling the model to focus on core features for solving single-UAV path selection and ultimately generating the optimal path. Simulation results demonstrate that the proposed method achieves excellent performance. [ABSTRACT FROM AUTHOR]

This document is the closing editorial for a special issue of the journal Applied Sciences on computer vision and pattern recognition based on deep learning. The issue includes 31 papers covering various topics such as image and video processing, object detection, object and scene recognition, visual application technologies, classification, segmentation, compression, and more. Each paper explores different methods and techniques to improve the performance and accuracy of deep learning models in these areas. The document provides a brief summary of each paper, highlighting their contributions and findings. [Extracted from the article]

Monitoring the condition of the grinding wheel in real-time during the grinding process is crucial as it directly impacts the precision and quality of the workpiece. Deep learning technology plays a vital role in analyzing the changes in sensor signals and identifying grinding wheel wear during the grinding process. Therefore, this paper innovatively proposes a grinding wheel wear recognition method based on Variational Mode Decomposition (VMD) denoising and Aquila Optimizer—Convolutional Neural Network—Long Short-Term Memory (AO-CNN-LSTM). The paper utilizes Acoustic Emission (AE) signals generated during grinding to identify the condition of the grinding wheel. To address noise interference, the study introduces the VMD algorithm for denoising the sample dataset, enhancing the effectiveness of neural network training. Subsequently, the dataset is fed into the designed Convolutional Neural Network—Long Short-Term Memory (CNN-LSTM) structure with AO-optimized parameters. Experimental results demonstrate that this method achieves high accuracy and performance. [ABSTRACT FROM AUTHOR]

Current research on scene text recognition primarily focuses on languages with abundant linguistic resources, such as English and Chinese. In contrast, there is relatively limited research dedicated to low-resource languages. Advanced methods for scene text recognition often employ Transformer-based architectures. However, the performance of Transformer architectures is suboptimal when dealing with low-resource datasets. This paper proposes a Collaborative Encoding Method for Scene Text Recognition in the low-resource Uyghur language. The encoding framework comprises three main modules: the Filter module, the Dual-Branch Feature Extraction module, and the Dynamic Fusion module. The Filter module, consisting of a series of upsampling and downsampling operations, performs coarse-grained filtering on input images to reduce the impact of scene noise on the model, thereby obtaining more accurate feature information. The Dual-Branch Feature Extraction module adopts a parallel structure combining Transformer encoding and Convolutional Neural Network (CNN) encoding to capture local and global information. The Dynamic Fusion module employs an attention mechanism to dynamically merge the feature information obtained from the Transformer and CNN branches. To address the scarcity of real data for natural scene Uyghur text recognition, this paper conducted two rounds of data augmentation on a dataset of 7267 real images, resulting in 254,345 and 3,052,140 scene images, respectively. This process partially mitigated the issue of insufficient Uyghur language data, making low-resource scene text recognition research feasible. Experimental results demonstrate that the proposed collaborative encoding approach achieves outstanding performance. Compared to baseline methods, our collaborative encoding approach improves accuracy by 14.1%. [ABSTRACT FROM AUTHOR]

Road detection technology is an important part of the automatic driving environment perception system. With the development of technology, the situations that automatic driving needs to consider will become broader and more complex. This paper contributes a lightweight convolutional neural network model, incorporating novel convolution and parallel pooling modules, an improved network activation function, and comprehensive training and verification with multiple datasets. The proposed model achieves high accuracy in detecting drivable areas in complex autonomous driving situations while significantly improving real-time performance. In addition, we collect data in the field and create small datasets as reference datasets for testing algorithms. This paper designs relevant experimental scenarios based on the datasets and experimental platforms and conducts simulations and real-world vehicle experiments to verify the effectiveness and stability of the algorithm models and technical solutions. The method achieves an MIoU of 90.19 and a single batch time of 340 ms with a batch size of 8, which substantially reduces the runtime relative to a typical deep network structure like ResNet50. [ABSTRACT FROM AUTHOR]

Accurate expression interpretation occupies a huge proportion of human-to-human communication. The control of expressions can facilitate more convenient communication between people. Expression recognition technology has also been transformed from relatively mature laboratory-controlled research to natural scenes research. In this paper, we design a multi-channel attention network based on channel weighting for expression analysis in natural scenes. The network mainly consists of three parts: Multi-branch expression recognition feature extraction network, which combines residual network ResNet18 and ConvNeXt network ideas to improve feature extraction and uses adaptive feature fusion to build a complete network; Adaptive Channel Weighting, which designs adaptive weights in the auxiliary network for feature extraction, performs channel weighting, and highlights key information areas; and Attention module, which designs and modifies the spatial attention mechanism and increases the proportion of feature information to accelerate the acquisition of important expression feature information areas. The experimental results show that the proposed method achieves better recognition efficiency than existing algorithms on the dataset FER2013 under uncontrolled conditions, reaching 73.81%, and also achieves good recognition accuracy of 89.65% and 85.24% on the Oulu_CASIA and RAF-DB datasets, respectively. [ABSTRACT FROM AUTHOR]

Relation extraction is an important task in natural language processing. It plays an integral role in intelligent question-and-answer systems, semantic search, and knowledge graph work. For this task, previous studies have demonstrated the effectiveness of convolutional neural networks (CNNs), recurrent neural networks (RNNs), and long short-term memory networks (LSTMs) in relational classification tasks. Recently, due to the superior performance of the pre-trained model BERT, BERT has become a feature extraction module for many relational classification models, and good results have been achieved in work related to BERT. However, most of such work uses the deepest levels of features. The important role of shallow-level information in the relational classification task is ignored. Based on the above problems, a relationship classification network FA-RCNet (fusion-attention relationship classification network) with feature fusion and attention mechanism is proposed in this paper. FA-RCNet fuses shallow-level features with deep-level features, and augments entity features and global features by the attention module so that the feature vector can perform the relational classification task more perfectly. In addition, the model in this paper achieves advanced results on both the SemEval-2010 Task 8 dataset and the KBP37 dataset compared to previously published models. [ABSTRACT FROM AUTHOR]

With the proliferation of the Internet, network complexities for both commercial and state organizations have significantly increased, leading to more sophisticated and harder-to-detect network attacks. This evolution poses substantial challenges for intrusion detection systems, threatening the cybersecurity of organizations and national infrastructure alike. Although numerous deep learning techniques such as convolutional neural networks (CNNs), recurrent neural networks (RNNs), and graph neural networks (GNNs) have been applied to detect various network attacks, they face limitations due to the lack of standardized input data, affecting model accuracy and performance. This paper proposes a novel preprocessing method for flow data from network intrusion detection systems (NIDSs), enhancing the efficacy of a graph neural network model in malicious flow detection. Our approach initializes graph nodes with data derived from flow features and constructs graph edges through the analysis of IP relationships within the system. Additionally, we propose a new graph model based on the combination of the graph neural network (GCN) model and SAGEConv, a variant of the GraphSAGE model. The proposed model leverages the strengths while addressing the limitations encountered by the previous models. Evaluations on two IDS datasets, CICIDS-2017 and UNSW-NB15, demonstrate that our model outperforms existing methods, offering a significant advancement in the detection of network threats. This work not only addresses a critical gap in the standardization of input data for deep learning models in cybersecurity but also proposes a scalable solution for improving the intrusion detection accuracy. [ABSTRACT FROM AUTHOR]

Network-security situation prediction is a crucial aspect in the field of network security. It is primarily achieved through monitoring network behavior and identifying potential threats to prevent and respond to network attacks. In order to enhance the accuracy of situation prediction, this paper proposes a method that combines a convolutional neural network (CNN) and a gated recurrent unit (GRU), while also incorporating an attention mechanism. The model can simultaneously handle the spatial and temporal features of network behavior and optimize the weight allocation of features through the attention mechanism. Firstly, the CNN's powerful feature extraction ability is utilized to extract the spatial features of the network behavior. Secondly, time-series features of network behavior are processed through the GRU layer. Finally, to enhance the model's performance further, we introduce attention mechanisms, which can dynamically adjust the importance of different features based on the current context information; this enables the model to focus more on critical information for accurate predictions. The experimental results show that the network-security situation prediction method, which combines a CNN and a GRU and introduces an attention mechanism, performs well in terms of the fitting effect and can effectively enhance the accuracy of situation prediction. [ABSTRACT FROM AUTHOR]

Facial expression recognition has wide application prospects in many occasions. Due to the complexity and variability of facial expressions, facial expression recognition has become a very challenging research topic. This paper proposes a Vision Transformer expression recognition method based on hybrid local attention (HLA-ViT). The network adopts a dual-stream structure. One stream extracts the hybrid local features and the other stream extracts the global contextual features. These two streams constitute a global–local fusion attention. The hybrid local attention module is proposed to enhance the network's robustness to face occlusion and head pose variations. The convolutional neural network is combined with the hybrid local attention module to obtain feature maps with local prominent information. Robust features are then captured by the ViT from the global perspective of the visual sequence context. Finally, the decision-level fusion mechanism fuses the expression features with local prominent information, adding complementary information to enhance the network's recognition performance and robustness against interference factors such as occlusion and head posture changes in natural scenes. Extensive experiments demonstrate that our HLA-ViT network achieves an excellent performance with 90.45% on RAF-DB, 90.13% on FERPlus, and 65.07% on AffectNet. [ABSTRACT FROM AUTHOR]

Detecting instruments in a music signal is often used in database indexing, song annotation, and creating applications for musicians and music producers. Therefore, effective methods that automatically solve this issue need to be created. In this paper, the mentioned task is solved using mel-frequency cepstral coefficients (MFCC) and various architectures of artificial neural networks. The authors' contribution to the development of automatic instrument detection covers the methods used, particularly the neural network architectures and the voting committees created. All these methods were evaluated, and the results are presented and discussed in the paper. The proposed automatic instrument detection methods show that the best classification quality was obtained for an extensive model, which is the so-called committee of voting classifiers. [ABSTRACT FROM AUTHOR]

The vibration signals collected by acceleration sensors are interspersed with noise interference, which increases the difficulty of fault diagnosis for rolling bearings. For this reason, a rolling bearing fault diagnosis method based on complete ensemble empirical model decomposition with adaptive noise (CEEMDAN) and improved convolutional neural network (CNN) is proposed. Firstly, the original vibration signal is decomposed into a series of intrinsic modal function (IMF) components using the CEEMDAN algorithm, the components are filtered according to the correlation coefficients and the signals are reconstructed. Secondly, the reconstructed signals are converted into a two-dimensional grey-scale map and input into a convolutional neural network to extract the features. Lastly, the features are inputted into a support vector machine (SVM) with the optimised parameters of the grey wolf optimiser (GWO) to perform the identification and classification. The experimental results show that the rolling bearing fault diagnosis method based on CEEMDAN and CNN-SVM proposed in this paper can significantly reduce the noise interference, and its average fault diagnosis accuracy is as high as 99.25%. Therefore, it is feasible to apply it in the field of rolling bearing fault diagnosis. [ABSTRACT FROM AUTHOR]

Facial expression recognition plays an increasingly important role in daily life, and it is used in several areas of human–computer interaction, such as robotics, assisted driving, and intelligent tutoring systems. However, the current mainstream methods are based on the whole face, and do not consider the existence of expression asymmetry between the left and right half-face. Hence, the accuracy of facial expression recognition needs to be improved. In this paper, we propose a half-face self-attention weighted approach called HSAW. Using statistical analysis and computer vision techniques, we found that the left half-face contains richer expression features than the right half-face. Specifically, we employed a self-attention mechanism to assign different weights to the left and right halves of the face. These weights are combined with convolutional neural network features for improved facial expression recognition. Furthermore, to attack the presence of uncertain categories in the dataset, we introduce adaptive re-labeling module, which can improve the recognition accuracy. Extensive experiments conducted on the FER2013 and RAF datasets have verified the effectiveness of the proposed method, which utilizes fewer parameters. [ABSTRACT FROM AUTHOR]

This paper presents a novel use of a bio-inspired retina model as a scene preprocessing stage for the recognition of letters and numbers on Chilean vehicle license plates. The goal is to improve the effectiveness and ease of pattern recognition. Inspired by the responses of mammalian retinas, this retinal model reproduces both the natural adjustment of contrast and the enhancement of object contours by parvocellular cells. Among other contributions, this paper provides an in-depth exploration of the architecture, advantages, and limitations of the model; investigates the tuning parameters of the model; and evaluates its performance when integrating a convolutional neural network and a spiking neural network into an optical character recognition (OCR) algorithm, using 40 different genuine license plate images as a case study and for testing. The results obtained demonstrate the reduction of error rates in character recognition based on convolutional neural networks (CNNs), spiking neural networks (SNNs), and OCR. It is concluded that this bio-inspired retina model offers a wide spectrum of potential applications to further explore, including motion detection, pattern recognition, and improvement of dynamic range in images, among others. [ABSTRACT FROM AUTHOR]

Automatic Container Code Recognition (ACCR) is critical for enhancing the efficiency of container terminals. However, existing ACCR methods frequently fail to achieve satisfactory performance in complex environments at port gates. In this paper, we propose an approach for accurate, fast, and compact container code recognition by utilizing YOLOv4 for container region localization and Deeplabv3+ for character recognition. To enhance the recognition speed and accuracy of YOLOv4 and Deeplabv3+, and to facilitate their deployment at gate entrances, we introduce several improvements. First, we optimize the feature-extraction process of YOLOv4 and Deeplabv3+ to reduce their computational complexity. Second, we enhance the multi-scale recognition and loss functions of YOLOv4 to improve the accuracy and speed of container region localization. Furthermore, we adjust the dilated convolution rates of the ASPP module in Deeplabv3+. Finally, we replace two upsampling structures in the decoder of Deeplabv3+ with transposed convolution upsampling and sub-pixel convolution upsampling. Experimental results on our custom dataset demonstrate that our proposed method, C-YOLOv4, achieves a container region localization accuracy of 99.76% at a speed of 56.7 frames per second (FPS), while C-Deeplabv3+ achieves an average pixel classification accuracy (MPA) of 99.88% and an FPS of 11.4. The overall recognition success rate and recognition speed of our approach are 99.51% and 2.3 ms per frame, respectively. Moreover, C-YOLOv4 and C-Deeplabv3+ outperform existing methods in complex scenarios. [ABSTRACT FROM AUTHOR]

As an advanced detection technique, electrical resistive tomography (ERT) has been applied to detect the solid–liquid two-phase flow velocity based on available ERT measurements. The flow velocity computation by ERT must depend on the relative algorithms, including both the cross-correlation (CC) principle and convolutional neural networks (CNNs). However, these two types of algorithms have poor accuracy and generalization under complex measuring conditions and various flow patterns. To address this issue, in this paper, a hybrid network is proposed that combines a CNN with a reproducing kernel-based support vector machine (RKSVM) technique. The features hidden in ERT measurements are extracted using the CNN, and then the flow velocity is computed by the RKSVM in a high-dimensional feature space. According to the ERT measurements in an actual experimental platform, the results show that the hybrid network has higher accuracy and generalization ability for flow velocity computation compared with the existing CC, RKSVM, and CNN methods. [ABSTRACT FROM AUTHOR]

Existing deep learning-based seismic signal denoising methods primarily operate in the time domain. Those methods are ineffective when noise overlaps with the seismic signal in the time domain. Time–frequency domain-based deep learning methods are relatively rare and usually employ single loss function, resulting in suboptimal performance on low SNR signals and potential damage to P wave. This paper proposes a method based on generative adversarial networks (GANs). Compared to convolutional neural networks, the discriminator in GANs helps retain more true signal details by judging denoising performance. Additionally, an attention mechanism is introduced to fully extract signal features, and a perceptual loss is employed to evaluate the difference between the denoised result and the target's high-level features. Experimental results show that this method can effectively improve SNR and ensure that the denoised result is close to the true signal. Furthermore, by comparing DeepDenoiser and ARDU, it is proven that the proposed method achieves better denoising performance, especially for low SNR signals, while causing less damage to the seismic signals. [ABSTRACT FROM AUTHOR]

Facial expression recognition (FER) plays a crucial role in understanding human emotions and is becoming increasingly relevant in educational contexts, where personalized and empathetic interactions are essential. The problems with existing approaches are typically solved using a single deep learning method, which is not robust with complex datasets, such as FER data, which have a characteristic imbalance and multi-class labels. In this research paper, an innovative approach to FER using a homogeneous ensemble convolutional neural network, called HoE-CNN, is presented for future online learning education. This paper aims to transfer the knowledge of models and FER classification using ensembled homogeneous conventional neural network architectures. FER is challenging to research because there are many real-world applications to consider, such as adaptive user interfaces, games, education, and robot integration. HoE-CNN is used to improve the classification performance on an FER dataset, encompassing seven main multi-classes (Angry, Disgust, Fear, Happy, Sad, Surprise, Neutral). The experiment shows that the proposed framework, which uses an ensemble of deep learning models, performs better than a single deep learning model. In summary, the proposed model will increase the efficiency of FER classification results and solve FER2013 at a accuracy of 75.51%, addressing both imbalanced datasets and multi-class classification to transfer the application of the model to online learning applications. [ABSTRACT FROM AUTHOR]

The steel industry is typical process manufacturing, and the quality and cost of the products can be improved by efficient operation of equipment. This paper proposes an efficient diagnosis and monitoring method for the gearbox, which is a key piece of mechanical equipment in steel manufacturing. In particular, an equipment maintenance plan for stable operation is essential. Therefore, equipment monitoring and diagnosis to prevent unplanned plant shutdowns are important to operate the equipment efficiently and economically. Most plant data collected on-site have no precise information about equipment malfunctions. Therefore, it is difficult to directly apply supervised learning algorithms to diagnose and monitor the equipment with the operational data collected. The purpose of this paper is to propose a pseudo-label method to enable supervised learning for equipment data without labels. Pseudo-normal (PN) and pseudo-abnormal (PA) vibration datasets are defined and labeled to apply classification analysis algorithms to unlabeled equipment data. To find an anomalous state in the equipment based on vibration data, the initial PN vibration dataset is compared with a PA vibration dataset collected over time, and the equipment is monitored for potential failure. Continuous wavelet transform (CWT) is applied to the vibration signals collected to obtain an image dataset, which is then entered into a convolutional neural network (an image classifier) to determine classification accuracy and detect equipment abnormalities. As a result of Steps 1 to 4, abnormal signals have already been detected in the dataset, and alarms and warnings have already been generated. The classification accuracy was over 0.95 at d = 4 , confirming quantitatively that the status of the equipment had changed significantly. In this way, a catastrophic failure can be avoided by performing a detailed equipment inspection in advance. Lastly, a catastrophic failure occurred in Step 9, and the classification accuracy ranged from 0.95 to 1.0. It was possible to prevent secondary equipment damage, such as motors connected to gearboxes, by identifying catastrophic failures promptly. This case study shows that the proposed procedure gives good results in detecting operation abnormalities of key unit equipment. In the conclusion, further promising topics are discussed. [ABSTRACT FROM AUTHOR]

Featured Application: In this paper, the vibration data of CWRU motor bearings is used as the original data to simulate the real working conditions of motor bearings in the working environment of hydrogen station by simulating the noise signal of hydrogen station. Then, the BOA-ResNet18 model is used to diagnose the faults of the added noise signals, and the accuracy of the fault diagnosis is very high, and the experimental results show that this model can be applied in the fault diagnosis of hydrogen station equipment under the working conditions of hydrogen station. The harsh working environment of hydrogen refueling stations often causes equipment failure and is vulnerable to mechanical noise during monitoring. This limits the accuracy of equipment monitoring, ultimately decreasing efficiency. To address this issue, this paper presents a motor bearing vibration signal diagnosis method that employs a Bayesian optimization (BOA) residual neural network (ResNet). The industrial noise signal of the hydrogenation station is simulated and then combined with the motor bearing signal. The resulting one-dimensional bearing signal is processed and transformed into a two-dimensional signal using Fast Fourier Transform (FFT). Afterwards, the signal is segmented using the sliding window translation method to enhance the data volume. After comparing signal feature extraction and classification results from various convolutional neural network models, ResNet18 yields the best classification accuracy, achieving a training accuracy of 89.50% with the shortest computation time. Afterwards, the hyperparameters of ResNet18 such as InitialLearnRate, Momentum, and L2Regularization Parameter are optimized using the Bayesian optimization algorithm. The experiment findings demonstrate a diagnostic accuracy of 99.31% for the original signal model, while the accuracy for the bearing signal, with simulated industrial noise from the hydrogenation station, can reach over 92%. [ABSTRACT FROM AUTHOR]

This paper proposes a fabric defect detection algorithm based on the SA-Pix2pix network and transfer learning to address the issue of insufficient accuracy in detecting complex pattern fabric defects in scenarios with limited sample data. Its primary contribution lies in treating defects as disruptions to the fabric's texture. It leverages a generative adversarial network to reconstruct defective images, restoring them to images of normal fabric texture. Subsequently, the reconstituted images are subjected to dissimilarity calculations against defective images, leading to image segmentation for the purpose of defect detection. This approach addresses the issues of poor defect image reconstruction accuracy due to the limited ability of remote dependency modeling within the generator's convolutional neural network. It also tackles deficiencies in the generative adversarial network's loss function in handling image details. To enhance the structure and loss function of the generative adversarial network, it introduces self-attention mechanisms, L1 loss, and an improved structural loss, thus mitigating the problems of low defect image reconstruction accuracy and insufficient image detail handling by the network. To counteract the issue of declining model training accuracy in the face of sparse complex fabric defect samples, a channel-wise domain transfer learning approach is introduced. This approach constrains the training of the target network through feature distribution, thereby overcoming the problem of target network overfitting caused by limited sample data. The study employs three methods to experimentally compare and investigate five distinct complex pattern fabric defects. The results demonstrate that, when compared to two other defect detection methods, the approach advocated in this paper exhibits superior detection accuracy in scenarios with limited sample data. [ABSTRACT FROM AUTHOR]

Object detection remains a pivotal aspect of remote sensing image analysis, and recent strides in Earth observation technology coupled with convolutional neural networks (CNNs) have propelled the field forward. Despite advancements, challenges persist, especially in detecting objects across diverse scales and pinpointing small-sized targets. This paper introduces YOLO-SE, a novel YOLOv8-based network that innovatively addresses these challenges. First, the introduction of a lightweight convolution SEConv in lieu of standard convolutions reduces the network's parameter count, thereby expediting the detection process. To tackle multi-scale object detection, the paper proposes the SEF module, an enhancement based on SEConv. Second, an ingenious Efficient Multi-Scale Attention (EMA) mechanism is integrated into the network, forming the SPPFE module. This addition augments the network's feature extraction capabilities, adeptly handling challenges in multi-scale object detection. Furthermore, a dedicated prediction head for tiny object detection is incorporated, and the original detection head is replaced by a transformer prediction head. To address adverse gradients stemming from low-quality instances in the target detection training dataset, the paper introduces the Wise-IoU bounding box loss function. YOLO-SE showcases remarkable performance, achieving an average precision at IoU threshold 0.5 (AP50) of 86.5% on the optical remote sensing dataset SIMD. This represents a noteworthy 2.1% improvement over YOLOv8 and YOLO-SE outperforms the state-of-the-art model by 0.91%. In further validation, experiments on the NWPU VHR-10 dataset demonstrated YOLO-SE's superiority with an accuracy of 94.9%, surpassing that of YOLOv8 by 2.6%. The proposed advancements position YOLO-SE as a compelling solution in the realm of deep learning-based remote sensing image object detection. [ABSTRACT FROM AUTHOR]

Significant water loss caused by pipeline leaks emphasizes the importance of effective pipeline leak detection and localization techniques to minimize water wastage. All of the state-of-the-art approaches use deep learning (DL) for leak detection and cross-correlation for leak localization. The existing methods' complexity is very high, as they detect and localize the leak using two different architectures. This paper aims to present an independent architecture with a single sensor for detecting and localizing leaks with enhanced performance. The proposed approach combines a novel EMD with an optimal mode selector, an MFCC, and a two-dimensional convolutional neural network (2DCNN). The suggested technique uses acousto-optic sensor data from a real-time water pipeline setup in UTAR, Malaysia. The collected data are noisy, redundant, and a one-dimensional time series. So, the data must be denoised and prepared before being fed to the 2DCNN for detection and localization. The proposed novel EMD with an optimal mode selector denoises the one-dimensional time series data and identifies the desired IMF. The desired IMF is passed to the MFCC and then to 2DCNN to detect and localize the leak. The assessment criteria employed in this study are prediction accuracy, precision, recall, F-score, and R-squared. The existing MFCC helps validate the proposed method's leak detection-only credibility. This paper also implements EMD variants to show the novel EMD's importance with the optimal mode selector algorithm. The reliability of the proposed novel EMD with an optimal mode selector, an MFCC, and a 2DCNN is cross-verified with cross-correlation. The findings demonstrate that the novel EMD with an optimal mode selector, an MFCC, and a 2DCNN surpasses the alternative leak detection-only methods and leak detection and localization methods. The proposed leak detection method gives 99.99% accuracy across all the metrics. The proposed leak detection and localization method's prediction accuracy is 99.54%, precision is 98.92%, recall is 98.86%, F-score is 98.89%, and R-square is 99.09%. [ABSTRACT FROM AUTHOR]

During the long-term operation of thyristor converter valves, the saturable reactor vibration (mainly caused by magnetostriction) will lead to core looseness faults. In order to accurately evaluate the fault degradation degree, this paper proposes a vibration signal recognition model for iron core looseness based on synchrosqueezed wavelet transforms and a convolutional neural network. Firstly, vibration experiments are conducted on saturable reactors to obtain signals under different core looseness degrees. Then, the spectrogram features of vibration signals are extracted using synchrosqueezed wavelet transform. Finally, based on the high-dimensional learning ability of convolutional neural networks, the fault characteristics of the spectrogram are mined to accurately identify the core looseness degree. The research results indicate that the model in the paper has higher recognition accuracy than some other methods, which provides convenience for the monitoring and maintenance of saturable reactors. [ABSTRACT FROM AUTHOR]

At CRYPTO 2019, Gohr proposed the neural differential distinguisher using the residual network structure in convolutional neural networks on round-reduced Speck32/64. In this paper, we construct a 7-round differential neural distinguisher for Speck32/64, which results in better than Gohr's work. The details are as follows. Firstly, a new data format  (C _ r , C _ r ′ , d _ l , C l , C r , C l ′ , C r ′)  is proposed for the input data of the differential neural distinguisher, which can help the distinguisher to identify the features of the previous round of ciphertexts in the Speck algorithm. Secondly, this paper modifies the convolution layer of the residual block in the residual network, inspired by the Inception module in GoogLeNet. For Speck32/64, the experiments show that the accuracy of the 7-round differential neural distinguisher is  97.13 % , which is better than the accuracy of Gohr's distinguisher of  9.1 %  and also higher than the currently known accuracy of  89.63 % . The experiments also show that the data format and neural network in this paper can improve the accuracy of the distinguisher by  2.38 %  and  2.1 % , respectively. Finally, to demonstrate the effectiveness of the distinguisher in this paper, a key recovery attack is performed on 8-rounds of Speck32/64. The results show that the success rate of recovering the correct key is  92 % , with no more than two incorrect bits. Finally, this paper briefly discussed the effect of the number of ciphertext pairs in a sample on the training results of the differential neural distinguisher. When the total number of ciphertext pairs is kept constant, the accuracy of the distinguisher increases with s, but it also leads to the occurrence of overfitting. [ABSTRACT FROM AUTHOR]

Surface transportation has evolved through technology advancements using parallel knowledge areas such as machine learning (ML). However, the transportation industry has not yet taken full advantage of ML. To evaluate this gap, we utilized a literature review approach to locate, categorize, and synthesize the principal concepts of research papers regarding surface transportation systems using ML algorithms, and we then decomposed them into their fundamental elements. We explored more than 100 articles, literature review papers, and books. The results show that 74% of the papers concentrate on forecasting, while multilayer perceptions, long short-term memory, random forest, supporting vector machine, XGBoost, and deep convolutional neural networks are the most preferred ML algorithms. However, sophisticated ML algorithms have been minimally used. The root-cause analysis revealed a lack of effective collaboration between the ML and transportation experts, resulting in the most accessible transportation applications being used as a case study to test or enhance a given ML algorithm and not necessarily to enhance a mobility or safety issue. Additionally, the transportation community does not define transportation issues clearly and does not provide publicly available transportation datasets. The transportation sector must offer an open-source platform to showcase the sector's concerns and build spatiotemporal datasets for ML experts to accelerate technology advancements. [ABSTRACT FROM AUTHOR]

Chinese medical texts contain a large number of medically named entities. Automatic recognition of these medical entities from medical texts is the key to developing medical informatics. In the field of Chinese medical information extraction, annotated Chinese medical text data are very few. In the named entity recognition task, there is insufficient labeled data, which leads to low model recognition performance. Therefore, this paper proposes a Chinese medical entity recognition model based on multi-neural network fusion and the improved Tri-Training algorithm. The model performs semi-supervised learning by improving the Tri-Training algorithm. According to the characteristics of the medical entity recognition task and medical data, the method in this paper is improved in terms of the division of the initial sub-training set, the construction of the base classifier, and the integration of the learning voting method. In addition, this paper also proposes a multi-neural network fusion entity recognition model for base classifier construction. The model learns feature information jointly by combining Iterated Dilated Convolutional Neural Network (IDCNN) and BiLSTM. Through experimental verification, the model proposed in this paper outperforms other models and improves the performance of the Chinese medical entity recognition model by incorporating and improving the semi-supervised learning algorithm. [ABSTRACT FROM AUTHOR]

Transformers are models that implement a mechanism of self-attention, individually weighting the importance of each part of the input data. Their use in image classification tasks is still somewhat limited since researchers have so far chosen Convolutional Neural Networks for image classification and transformers were more targeted to Natural Language Processing (NLP) tasks. Therefore, this paper presents a literature review that shows the differences between Vision Transformers (ViT) and Convolutional Neural Networks. The state of the art that used the two architectures for image classification was reviewed and an attempt was made to understand what factors may influence the performance of the two deep learning architectures based on the datasets used, image size, number of target classes (for the classification problems), hardware, and evaluated architectures and top results. The objective of this work is to identify which of the architectures is the best for image classification and under what conditions. This paper also describes the importance of the Multi-Head Attention mechanism for improving the performance of ViT in image classification. [ABSTRACT FROM AUTHOR]

Accurate short-term load forecasting is the key to ensuring smooth and efficient power system operation and power market dispatch planning. However, the nonlinear, non-stationary, and time series nature of load sequences makes load forecasting difficult. To address these problems, this paper proposes a short-term load forecasting method (EPT-VMD-TCN-TPA) based on the hybrid decomposition of load sequences, which combines ensemble patch transform (EPT), variational modal decomposition (VMD), a temporal convolutional network (TCN), and a temporal pattern attention mechanism (TPA). In which, the trend component (Tr(t)) and the residual fluctuation component (Re(t)) of the load series are extracted using EPT, and then the Re(t) component is decomposed into intrinsic modal function components (IMFs) of different frequencies using VMD. The Tr(t) and IMFs components of the fused meteorological data are predicted separately by the TCN-TPA prediction model, and finally, the prediction results of each component are reconstructed and superimposed to obtain the final predicted value of the load. In addition, experiments after reconstructing each IMF component according to the fuzzy entropy (FE) values are discussed in this paper. To evaluate the performance of the proposed method in this paper, we used datasets from two Areas of the 9th Mathematical Modeling Contest in China. The experimental results show that the predictive precision of the EPT-VMD-TCN-TPA model outperforms other comparative models. More specifically, the experimental results of the EPT-VMD-TCN-TPA method had a MAPE of 1.25% and 1.58% on Area 1 and Area 2 test sets, respectively. [ABSTRACT FROM AUTHOR]