Search

Herein, the challenge of accurately classifying the manufacturing origin of printing paper, including continent, country, and specific product, was addressed. One-dimensional convolutional neural network (1D CNN) models trained on infrared (IR) spectrum data acquired from printing paper samples were used for the task. The preprocessing of the IR spectra through a second-derivative transformation and the restriction of the spectral range to 1800 to 1200 cm-1 improved the classification performance of the model. The outcomes were highly promising. Models trained on second-derivative IR spectra in the 1800 to 1200-cm-1 range exhibited perfect classification for the manufacturing continent and country, with an impressive F1 score of 0.980 for product classification. Notably, the developed 1D CNN model outperformed traditional machine learning classifiers, such as support vector machines and feed-forward neural networks. In addition, the application of data point attribution enhanced the transparency of the decision-making process of the model, offering insights into the spectral patterns that affect classification. This study makes a considerable contribution to printing paper classification, with potential implications for accurate origin identification in various fields. [ABSTRACT FROM AUTHOR]

The use of Artificial Intelligence (AI) to preserve and promote cultural heritage has experienced significant growth in recent years. Among the various areas of cultural heritage, numismatics have emerged as a particularly promising field where we can develop AI solutions. Numismatics refers to the study of coins, tokens, paper money, and medals, which play a critical role in understanding human history and culture. However, there are still limited resources available to help researchers and collectors in the identification of coins. This is due to the vast number of coins in circulation, which presents a significant challenge in developing smart tools for classification tasks. This paper aims to provide a contribution to this setting. In particular, we start by creating a new dataset called EURO-Coin, which consists of images showing the side of coins with reliefs and is designed to facilitate the training and testing of AI models for euro coin classification. Then, we propose two approaches that leverage Convolutional Neural Networks and self-attention layers to classify the country and value of the coins. In our experiments, we obtain an accuracy of 86.9% for country classification and an accuracy of 96.4% for value classification. Finally, we conduct an ablation study to evaluate the impact of the preprocessing activities and attention layers in our approaches. [ABSTRACT FROM AUTHOR]

Since deep low‐frequency tremors are considered to be associated with large earthquakes that occur adjacently on the same subducting plate interface, it is important to investigate tremors that occurred before the establishment of modern seismograph networks such as the High Sensitivity Seismograph Network (Hi‐net). We propose a deep‐learning solution to detect evidence of tremors in scanned images of paper seismogram records from over 50 years ago. In this study, we fine‐tuned a convolutional neural network (CNN) based on the Residual Network, which was pre‐trained using images of synthetic waveforms from our previous study, using a data set comprised of images generated from real seismic data recorded digitally by Hi‐net to facilitate a supervised analysis. The fine‐tuned CNN was able to predict the presence or absence of tremors in the Hi‐net images with an accuracy of 98.64%. Gradient‐weighted Class Activation Mapping heatmaps created to visualize model predictions indicated that the CNN's ability to detect tremors is not degraded by the presence of teleseisms. Once validated using the Hi‐net images, the CNN was applied to paper seismograms recorded from 1966 to 1977 at the Kumano observatory in southwest Japan, operated by Earthquake Research Institute, The University of Tokyo. The CNN showed potential for detecting tremors in scanned images of paper seismogram records from the past, facilitating downstream tasks such as the creation of new tremor catalogs. However, further training using an augmented data set to control for variables such as inconsistent plotting pen thickness is required to develop a universally applicable model. Plain Language Summary: In 2002, deep low‐frequency tremors, which periodically occur with much smaller amplitudes and longer durations than common earthquakes, were discovered owing to the establishment of dense seismic arrays in Japan. These tremors are considered to be associated with megathrust earthquakes because they occur in deeper regions of plate boundaries compared with common earthquakes. Investigating tremors that occurred before the establishment of dense seismic arrays is important since megathrust earthquakes recur on intervals of 100–200 years, and digital records from modern seismic arrays cover only a fraction of that time. In this study, we developed a convolutional neural network based on the Residual Network (ResNet) that extracts tremors from images of waveforms recorded more than 50 years ago, when seismometers drew waveforms directly on drum‐rolled paper using a pen. The proposed ResNet, which was trained on seismogram images generated from synthetic waveforms and real data recorded digitally by modern seismic arrays, was applied to scanned images of paper seismograms recorded from 1966 to 1977 at an observatory in southwest Japan. A list of tremors was successfully obtained; however, further training using data that accounts for variables such as inconsistent plotting pen thickness is required to develop a universally applicable model. Key Points: Convolutional neural network model for detection of deep low‐frequency tremors from seismogram images is proposedThe model trained with seismogram images converted from real seismic data successfully detects tremorsThe detection performances of the trained model for the paper records at the Kumano observatory in southwest Japan are discussed [ABSTRACT FROM AUTHOR]

This paper presents a convolutional neural network (CNN) to classify between the conventionally and organically cultivated Memecik varieties of green olives. The image forming method called the rising paper chromatography is utilized in preparing the images of Memecik varieties of green olives for CNN. In the rising chromatography method, 20, 30, and 40% sample concentrations were determined as the suitable concentrations for both organic and conventional olives. The concentrations of AgNO3 and FeSO4 were determined as 0.25, 0.5, 0.75 and 1% for both conventional and organic samples. The visual differences used for differentiation of different types of Memecik green olives are usually determined according to the regional color differences, the vivid color occurrence, the width and the frequency of bowl occurrence, the thin line, and the picks at drop zone by the expert assessors. The testing results in this study verified the effectiveness of the CNN methodology in differentiating between the organically and conventionally cultivated Memecik green olives. The newly designed neural network achieved 100% accuracy. Furthermore, this high accuracy achieved by CNN might suggest that it can be effectively used in place of the expert assessors. [ABSTRACT FROM AUTHOR]

Brain–computer interfacing (BCI) research, fueled by deep learning, integrates insights from diverse domains. A notable focus is on steady-state visual evoked potential (SSVEP) in BCI applications, requiring in-depth assessment through deep learning. EEG research frequently employs SSVEPs, which are regarded as normal brain responses to visual stimuli, particularly in investigations of visual perception and attention. This paper tries to give an in-depth analysis of the implications of deep learning for SSVEP-adapted BCI. A systematic search across four stable databases (Web of Science, PubMed, ScienceDirect, and IEEE) was developed to assemble a vast reservoir of relevant theoretical and scientific knowledge. A comprehensive search yielded 177 papers that appeared between 2010 and 2023. Thence a strict screening method from predetermined inclusion criteria finally generated 39 records. These selected works were the basis of the study, presenting alternate views, obstacles, limitations and interesting ideas. By providing a systematic presentation of the material, it has made a key scholarly contribution. It focuses on the technical aspects of SSVEP-based BCI, EEG technologies and complex applications of deep learning technology in these areas. The study delivers more penetrating reporting on the latest deep learning pattern recognition techniques than its predecessors, together with progress in data acquisition and recording means suitable for SSVEP-based BCI devices. Especially in the realms of deep learning technology orchestration, pattern recognition techniques, and EEG data collection, it has effectively closed four important research gaps. To increase the accessibility of this critical material, the results of the study take the form of easy-to-read tables just generated. Applying deep learning techniques in SSVEP-based BCI applications, as the research shows, also has its downsides. The study concludes that a radical framework will be presented which, includes intelligent decision-making tools for evaluation and benchmarking. Rather than just finding a comparable or similar analogy, this framework is intended to help guide future research and pragmatic applications, and to determine which SSVEP-based BCI applications have succeeded at responsibility for what they set out with. [ABSTRACT FROM AUTHOR]

Blockchain technology has unlocked the doors of building decentralized applications, where security plays a vital role. Any transaction ever created in a blockchain is recorded permanently. With the increasing usage of social media modalities today, many non-reputable sources create and publish fake and luring news. Due to the easy availability of the internet and excessive use of social media, fake news can spread like a flash. It causes the need to eliminate fake news posted on social media platforms. The main motive of the paper is to develop an ensemble model that assists in the automated identification of fake news. This paper addresses the identified gaps in detecting multi-modal fake news. We propose Fake News Network (FNNet) as a novel secure blockchain-based deep learning model to detect fake news. It uses blockchain and deep learning to assure data integrity and learn data representations, respectively. The proposed model consists of four layers: the node layer, the deep learning layer, the blockchain layer, and the network layer. This is an ensemble deep-learning model that leverages Bi-LSTM and CNN models, where the Bi-LSTM model captures the sequential data in both directions, and CNN captures the hidden features. We use Pheme, CrisisLexT6, and ISOT datasets to train the model. FNNet achieves an average accuracy of 86.93%, 92.22%, and 98.53% on Pheme, CrisisLexT9, and ISOT datasets, respectively. Our results show that the proposed model is robust and applicable to real-time datasets and social media networks to detect fake news effectively. [ABSTRACT FROM AUTHOR]

Forest fire is a severe natural disaster, which leads to the destruction of forest ecology. At present, fire detection technology represented by convolutional neural network is widely used in forest resource protection, which can realize rapid analysis. However, in forest flame and smoke detection tasks, due to continuous expansion of the target range, a better detection effect cannot be achieved. This paper proposes an improved YOLOX method for multi-scale forest fire detection. This method proposes a novel feature pyramid model to reduce the information loss of high-level forest fire feature maps and enhance the representation ability of feature pyramids. Moreover, the method applies a small object data augmentation strategy to enrich the forest fire dataset, making it more suitable for the actual forest fire scene. According to the experimental results, the mAP of the model proposed in this paper reaches 79.64%, which is about 4.89% higher than the baseline network YOLOX. The method improves the accuracy of forest fire detection, reduces false alarms, and is suitable for real scenarios of forest fires. [ABSTRACT FROM AUTHOR]

Due to the harsh working environments of certain bridges, the bridge structural health monitoring systems (SHMs) are prone to error warning because of anomaly data. Therefore, it is of great significance to accurately classify and locate the anomaly data for effectively addressing these issues. This paper proposes a method for classifying and locating anomaly data utilizing one-dimensional monitoring data based on convolutional neural networks. Compared to previous research reliant on visual features, the proposed method has lower computational costs. By incorporating the anomaly data localization network, manual localization operations for data restoration are replaced. The analysis in this paper is based on monitoring data from a large-span cable-stayed bridge, along with artificially generated anomaly data. The two neural network frameworks proposed in this paper are trained and validated, showcasing precise classification and localization of anomaly data. Furthermore, the paper discusses the impact of common errors in labeling data categories and locating training samples in practical operations. The results demonstrate that even in the presence of noticeable yet non-extreme labeling errors in the training set, the proposed method still achieves accurate classification and localization, highlighting its robustness. [ABSTRACT FROM AUTHOR]

Accurate power load forecasting can provide crucial insights for power system scheduling and energy planning. In this paper, to address the problem of low accuracy of power load prediction, we propose a method that combines secondary data cleaning and adaptive variational mode decomposition (VMD), convolutional neural networks (CNN), bi-directional long short-term memory (BILSTM), and adding attention mechanism (AM). The Inner Mongolia electricity load data were first cleaned use the K-means algorithm, and then further refined with the density-based spatial clustering of applications with the noise (DBSCAN) algorithm. Subsequently, the parameters of the VMD algorithm were optimized using a multi-strategy Cubic-T dung beetle optimization algorithm (CTDBO), after which the VMD algorithm was employed to decompose the twice-cleaned load sequences into a number of intrinsic mode functions (IMFs) with different frequencies. These IMFs were then used as inputs to the CNN-BILSTM-Attention model. In this model, a CNN is used for feature extraction, BILSTM for extracting information from the load sequence, and AM for assigning different weights to different features to optimize the prediction results. It is proved experimentally that the model proposed in this paper achieves the highest prediction accuracy and robustness compared to other models and exhibits high stability across different time periods. [ABSTRACT FROM AUTHOR]

Tool condition monitoring technology is an indispensable part of intelligent manufacturing. Most current research focuses on complex signal processing techniques or advanced deep learning algorithms to improve prediction performance without fully leveraging the end-to-end advantages of deep learning. The challenge lies in transforming multi-sensor raw data into input data suitable for direct model feeding, all while minimizing data scale and preserving sufficient temporal interpretation of tool wear. However, there is no clear reference standard for this so far. In light of this, this paper innovatively explores the processing methods that transform raw data into input data for deep learning models, a process known as an input paradigm. This paper introduces three new input paradigms: the downsampling paradigm, the periodic paradigm, and the subsequence paradigm. Then an improved hybrid model that combines a convolutional neural network (CNN) and bidirectional long short-term memory (BiLSTM) was employed to validate the model's performance. The subsequence paradigm demonstrated considerable superiority in prediction results based on the PHM2010 dataset, as the newly generated time series maintained the integrity of the raw data. Further investigation revealed that, with 120 subsequences and the temporal indicator being the maximum value, the model's mean absolute error (MAE) and root mean square error (RMSE) were the lowest after threefold cross-validation, outperforming several classical and contemporary methods. The methods explored in this paper provide references for designing input data for deep learning models, helping to enhance the end-to-end potential of deep learning models, and promoting the industrial deployment and practical application of tool condition monitoring systems. [ABSTRACT FROM AUTHOR]

As a vital component of mining hoisting equipment, mining wire rope (MWR) is critical in the operation of the mine. Once damaged, it is very easy to cause the loss of life and property. Therefore, it is meaningful to identify the damage to MWR, especially the weak damage identification. This paper proposes a method based on continuous wavelet transform (CWT) and convolutional neural network (CNN) model for MWR damage degree identification. Firstly, the MWR signals with different damage degrees were acquired. Secondly, CWT and data augmentation were performed on the original signals to obtain a time-frequency image dataset of MWR damage degree. Then, a deep learning (DL) model is built for identification and compared with traditional machine learning and some classical CNN models. The results show that the model proposed in this paper is better than the traditional machine learning models. It has the highest accuracy of 91.58% in MWR damage degree identification with classical CNN models. The method focuses on the weak damage of MWR and combines CWT with CNN model to meet the requirements of accuracy and efficiency, detecting the early damage as soon as possible and ensuring intelligent, safe and stable operation in the mining industry. [ABSTRACT FROM AUTHOR]

Understanding road conditions is essential for implementing effective road safety measures and driving solutions. Road situations encompass the day-to-day conditions of roads, including the presence of vehicles and pedestrians. Surveillance cameras strategically placed along streets have been instrumental in monitoring road situations and providing valuable information on pedestrians, moving vehicles, and objects within road environments. However, these video data and information are stored in large volumes, making analysis tedious and time-consuming. Deep learning models are increasingly utilized to monitor vehicles and identify and evaluate road and driving comfort situations. However, the current neural network model requires the recognition of situations using time-series video data. In this paper, we introduced a multi-directional detection model for road situations to uphold high accuracy. Deep learning methods often integrate long short-term memory (LSTM) into long-term recurrent network architectures. This approach effectively combines recurrent neural networks to capture temporal dependencies and convolutional neural networks (CNNs) to extract features from extensive video data. In our proposed method, we form a multi-directional long-term recurrent convolutional network approach with two groups equipped with CNN and two layers of LSTM. Additionally, we compare road situation recognition using convolutional neural networks, long short-term networks, and long-term recurrent convolutional networks. The paper presents a method for detecting and recognizing multi-directional road contexts using a modified LRCN. After balancing the dataset through data augmentation, the number of video files increased, resulting in our model achieving 91% accuracy, a significant improvement from the original dataset. [ABSTRACT FROM AUTHOR]

The aim of image inpainting is to fill in damaged areas according to certain rules based on information about the adjacent positions of missing areas and the overall structure of the image, a technique that plays a key role in various tasks in computer vision. With the rapid development of deep learning, researchers have combined it with image inpainting and achieved excellent performance. To gain insight into the techniques involved, this paper summarizes the latest research advances in the field of image inpainting. Firstly, existing classical image inpainting methods are reviewed, and traditional image inpainting methods and their advantages and disadvantages are introduced. Secondly, three classical network models are outlined, and the image inpainting methods are classified into single-stage, multi-stage and a priori condition-guided approaches according to different network types and model structures. Representative algorithms among them are selected and their important technical improvement ideas are analyzed and summarized. Then, the common datasets commonly used in image inpainting tasks and the evaluation metrics used to evaluate inpainting results are introduced. The paper presents a comprehensive summary of the various algorithms in terms of network models and inpainting methods, and selects representative algorithms for quantitative and qualitative comparative analysis. Finally, the future development trends and research directions have prospected, and the current problems of image inpainting are summarized. [ABSTRACT FROM AUTHOR]

Purpose: This paper aims to improve the manufacturability of additive manufacturing (AM) for topology-optimized (TO) structures. Enhancement of manufacturability focuses on modifying geometric constraints and classifying the building orientation (BO) of AM parts to reduce stresses and support structures (SSs). To this end, artificial intelligence (AI) networks are being developed to automate design for additive manufacturing (DfAM). Design/methodology/approach: This study considers three geometric constraints for their correction by convolutional autoencoders (CAEs) and transfer learning (TL). Furthermore, BOs of AM parts are classified using generative adversarial (GAN) and classification networks to reduce the SS. To verify the results, finite element analysis (FEA) is performed to compare the stresses of modified components with the original ones. Moreover, one sample is produced by the laser-based powder bed fusion (LB-PBF) in the BO predicted by the AI to observe its SSs. Findings: CAE and TL resulted in promoting the manufacturability of TO components. FEA demonstrated that enhancing manufacturability leads to a 50% reduction in stresses. Additionally, training GAN and pre-training the ResNet-18 resulted in 80%, 95% and 96% accuracy for training, validation and testing. The production of a sample with LB-PBF demonstrated that the predicted BO by ResNet-18 does not require SSs. Originality/value: This paper provides an automatic platform for DfAM of TO parts. Consequently, complex TO parts can be designed most feasibly and manufactured by AM technologies with minimal material usage, residual stresses and distortions. [ABSTRACT FROM AUTHOR]

BACKGROUND: With the continuous improvement and progress of artificial intelligence technology in the treatment of spinal deformity, a large number of studies have been invested in this field, but the main research status, hot spots and development trends are still unclear. OBJECTIVE: To visually analyze the literature related to artificial intelligence in the field of spinal deformities by using bibliometrics, identify the research hotspots and shortcomings in this field, and provide references for future research. METHODS: The core database of Web of Science was used to search the articles related to artificial intelligence in the field of spinal deformities published from inception to 2023. The data were visually analyzed by Citespace 5.6.R5 and VOSviewer 1.6.19. RESULTS AND CONCLUSION: (1) A total of 165 papers were included, and the number of papers published in this field showed a fluctuating upward trend. The author with the largest number of articles is Lafage V, and the country with the largest number of articles is China. (2) Keyword analysis results show that adolescent scoliosis, deep learning, classification, precision and robot are the main keywords. (3) The in-depth analysis results of co-cited and highly cited articles show that artificial intelligence has three hotspots in the field of spinal deformities, including the use of U-shaped architecture (a mature mode of deep learning convolutional neural networks) to automatically measure imaging parameters (Cobb angle and accurate segmentation of paraspinal muscles), multiview correlation network architecture (i.e., spine curvature assessment framework), and robot-guided spinal surgery. (4) In the field of artificial intelligence treatment of spinal malformations, the mechanism research such as genomics is very weak. In the future, unsupervised hierarchical clustering and other machine learning techniques can be used to study the basic mechanism of susceptibility genes in the field of spinal deformities by genome-wide association analysis and other genomics research methods. [ABSTRACT FROM AUTHOR]

The precision of short-term photovoltaic power forecasts is of utmost importance for the planning and operation of the electrical grid system. To enhance the precision of short-term output power prediction in photovoltaic systems, this paper proposes a method integrating K-means clustering: an improved snake optimization algorithm with a convolutional neural network–bidirectional long short-term memory network to predict short-term photovoltaic power. Firstly, K-means clustering is utilized to categorize weather scenarios into three categories: sunny, cloudy, and rainy. The Pearson correlation coefficient method is then utilized to determine the inputs of the model. Secondly, the snake optimization algorithm is improved by introducing Tent chaotic mapping, lens imaging backward learning, and an optimal individual adaptive perturbation strategy to enhance its optimization ability. Then, the multi-strategy improved snake optimization algorithm is employed to optimize the parameters of the convolutional neural network–bidirectional long short-term memory network model, thereby augmenting the predictive precision of the model. Finally, the model established in this paper is utilized to forecast photovoltaic power in diverse weather scenarios. The simulation findings indicate that the regression coefficients of this method can reach 0.99216, 0.95772, and 0.93163 on sunny, cloudy, and rainy days, which has better prediction precision and adaptability under various weather conditions. [ABSTRACT FROM AUTHOR]

The traditional method for retrieving cloud optical thickness (COT) is carried out through a Look-Up Table (LUT). Researchers must make a series of idealized assumptions and conduct extensive observations and record features in this scenario, consuming considerable resources. The emergence of deep learning effectively addresses the shortcomings of the traditional approach. In this paper, we first propose a daytime (SOZA < 70°) COT retrieval algorithm based on FY-4A AGRI. We establish and train a Convolutional Neural Network (CNN) model for COT retrieval, CM4CR, with the CALIPSO's COT product spatially and temporally synchronized as the ground truth. Then, a deep learning method extended from video prediction models is adopted to predict COT values based on the retrieval results obtained from CM4CR. The COT prediction model (CPM) consists of an encoder, a predictor, and a decoder. On this basis, we further incorporated a time embedding module to enhance the model's ability to learn from irregular time intervals in the input COT sequence. During the training phase, we employed Charbonnier Loss and Edge Loss to enhance the model's capability to represent COT details. Experiments indicate that our CM4CR outperforms existing COT retrieval methods, with predictions showing better performance across several metrics than other benchmark prediction models. Additionally, this paper also investigates the impact of different lengths of COT input sequences and the time intervals between adjacent frames of COT on prediction performance. [ABSTRACT FROM AUTHOR]

This paper introduces a novel one-dimensional convolutional neural network that utilizes clinical data to accurately detect choledocholithiasis, where gallstones obstruct the common bile duct. Swift and precise detection of this condition is critical to preventing severe complications, such as biliary colic, jaundice, and pancreatitis. This cutting-edge model was rigorously compared with other machine learning methods commonly used in similar problems, such as logistic regression, linear discriminant analysis, and a state-of-the-art random forest, using a dataset derived from endoscopic retrograde cholangiopancreatography scans performed at Olive View–University of California, Los Angeles Medical Center. The one-dimensional convolutional neural network model demonstrated exceptional performance, achieving 90.77% accuracy and 92.86% specificity, with an area under the curve of 0.9270. While the paper acknowledges potential areas for improvement, it emphasizes the effectiveness of the one-dimensional convolutional neural network architecture. The results suggest that this one-dimensional convolutional neural network approach could serve as a plausible alternative to endoscopic retrograde cholangiopancreatography, considering its disadvantages, such as the need for specialized equipment and skilled personnel and the risk of postoperative complications. The potential of the one-dimensional convolutional neural network model to significantly advance the clinical diagnosis of this gallstone-related condition is notable, offering a less invasive, potentially safer, and more accessible alternative. [ABSTRACT FROM AUTHOR]

Radio frequency interference (RFI) significantly hampers the target detection performance of frequency-modulated continuous-wave radar. To address the problem and maintain the target echo signal, this paper proposes a priori assumption on the interference component nature in the radar received signal, as well as a method for interference estimation and mitigation via time–frequency analysis. The solution employs Fourier synchrosqueezed transform to implement the radar's beat signal transformation from time domain to time–frequency domain, thus converting the interference mitigation to the task of time–frequency distribution image restoration. The solution proposes the use of image processing based on the dual-tree complex wavelet transform and combines it with the spatial domain-based approach, thereby establishing a dual-domain fusion interference filter for time–frequency distribution images. This paper also presents a convolutional neural network model of structurally improved UNet++, which serves as the interference estimator. The proposed solution demonstrated its capability against various forms of RFI through the simulation experiment and showed a superior interference mitigation performance over other CNN model-based approaches. [ABSTRACT FROM AUTHOR]

The safety and robustness of convolutional neural networks (CNNs) have raised increasing concerns, especially in safety-critical areas, such as medical applications. Although CNNs are efficient in image classification, their predictions are often sensitive to minor, for human observers, invisible modifications of the image. Thus, a modified, corrupted image can be visually equal to the legitimate image for humans but fool the CNN and make a wrong prediction. Such modified images are called adversarial images throughout this paper. A popular method to generate adversarial images is backpropagating the loss gradient to modify the input image. Usually, only the direction of the gradient and a given step size were used to determine the perturbations (FGSM, fast gradient sign method), or the FGSM is applied multiple times to craft stronger perturbations that change the model classification (i-FGSM). On the contrary, if the step size is too large, the minimum perturbation of the image may be missed during the gradient search. To seek exact and minimal input images for a classification change, in this paper, we suggest starting the FGSM with a small step size and adapting the step size with iterations. A few decay algorithms were taken from the literature for comparison with a novel approach based on an index tracking the loss status. In total, three tracking functions were applied for comparison. The experiments show our loss adaptive decay algorithms could find adversaries with more than a 90% success rate while generating fewer perturbations to fool the CNNs. [ABSTRACT FROM AUTHOR]

The existing change detection methods are difficult to balance local features and global features, and the boundary between change objects and backgrounds is blurred, so this paper proposed a remote sensing image building change detection method based on local-global feature coupling and boundary guidance. In the encoding stage, the method adopted parallel convolutional neural network and Transformer to extract the local features and global representation of remote sensing images, respectively. At different scales, the local-global feature coupling module fused local features and global feature representation to enhance the expression ability of image features. In addition, it introduced the boundary guidance branch to obtain the prior boundary information of the change objects, so that its guide change map can highlight the structural characteristics of the building and promote the accurate boundary location. This paper conducted experiments on the LEVIR-CD and WHU datasets, resulting in F1-score of 91.25% and 91.27%, IoU of 83.90% and 83.95%, respectively. The experimental results show that the method has a great improvement in the detection accuracy and good generalization ability. [ABSTRACT FROM AUTHOR]

A pipeline is critical in conveying water, oil, gas, petrochemicals, and slurry. As the pipeline ages and corrodes, it becomes susceptible to deterioration, resulting in wastage and hazardous damages depending on the material it transports. To mitigate these risks, implementing a suitable monitoring system becomes essential, enabling the early identification of damage and minimizing waste and the potential for hazardous incidents. The pipeline monitoring system can be exterior, visual/biological, and computational. This paper surveys state-of-the-art approaches and also performs experimental analyses with a few methods in signal/data-driven approaches within computational methods. More precisely, signal processing-based leak localization methods, artificial intelligence-based leak detection methods, and combined approaches are given. This paper implements five signal processing-based methods and 17 artificial intelligence-based methods. This implementation helps to compare and understand the significance of appropriate noise removal and feature extraction. The data for this analysis is collected using acousto-optic sensors from an experimental setup. After implementation, the highest observed leak localization accuracy is 99.14% with the wavelet packet adaptive independent component analysis-based generalized cross correlation, and the highest leak detection accuracy is 98.32% with the one-dimensional convolutional neural network. [ABSTRACT FROM AUTHOR]

With explosive growth of industrial big data, workshop scheduling faces problems such as high complexity, multi-dimensionality and low stability. Recent years, the wide application of deep learning provides new idea for scheduling problem. In this paper, a hybrid deep convolution network and differential evolution algorithm is proposed to solve the non-permutation flow shop scheduling problem with the goal of minimizing total completion time. Mining relationship between job attributes and process priority by deep convolutional network is core idea of this method. In this paper, differential evolution algorithm is used to obtain the data set for deep learning, and neighborhood search algorithm is used to optimize scheduling solution. Additionally, a method combining k-means algorithm and data statistics is proposed, which provides a reasonable way for priority division. The experimental results show that this method can greatly improve scheduling efficiency. [ABSTRACT FROM AUTHOR]

In the field of structural health monitoring, vibration-based damage identification remains a formidable challenge. Key to this challenge is the establishment of a reliable association between observed vibration characteristics and the actual state of structural damage (e.g. stiffness reduction). This association not only accurately indicates the presence of damage, but also the location and severity of the damage. To solve this complex pattern identification problem, a large number of approaches, including deep learning, have emerged in recent years. In this paper, we propose a new structural damage identification method that utilizes the vibration information of the structure and a convolutional neural network based on Alex NET improvement. The method consists of calculating the acceleration response power spectral density of damaged and undamaged structures under impact loading separately, and then making a difference between the two power spectral data, and subsequently introducing these power spectral difference data into the convolutional neural network for training. The use of power spectral density analysis as a preprocessing step converts the time-domain signals into frequency-domain signals, and this conversion allows the convolutional neural network to capture and learn from the specific frequency characteristics of the data, thus facilitating the learning process of the neural network model. In this paper, the effectiveness of the method is critically evaluated through numerical simulation and experimental validation, and 3% and 5% noise are added to the numerical study to test the robustness of the method. During the convolution neural network training process, the optimal training mean squared error (MSE) is 5 × 10−6 in the case of no noise addition; the optimal training MSE is 1.3 × 10−5 in the case of noise addition. Both the results of simulations and experiments confirm the high accuracy and good robustness of the method in localizing structural damage. [ABSTRACT FROM AUTHOR]

In order to explore the application of neural networks in the intelligent protection of digital music copyrights, this paper initially investigates the key aspects of digital music-related supply chain management (SCM). Subsequently, this paper introduces a fuzzy, comprehensive evaluation-based method for authenticating digital music infringement. Furthermore, it employs a convolutional neural network to analyze digital music's source components. Within this context, an attention mechanism and an adaptive gate model are meticulously designed. Moreover, a selective adaptive cascade is implemented to optimize the structure of the multi-resolution coder–decoder. Through fuzzy authentication, it becomes feasible to accurately and reliably track and verify copyright information pertaining to digital music, thus providing an effective protective mechanism for the digital music industry. Experimental results reveal that in comparison with the SHN-4 series models, the network model embedded with the channel space (CS) attention module achieves improvements of up to 0.04 dB in terms of performance metrics for human voice and accompaniment sources. Furthermore, it outperforms these models by up to 0.19 dB in music source separation metrics. The incorporation of the adaptive attention mechanism profoundly enhances the model's performance in audio source separation tasks, benefiting both vocal and accompaniment sources. This improvement is evident in the form of a 0.44 SDR enhancement for vocal sources and a 0.18 SDR enhancement for accompaniment sources. Additionally, the proposed two-stage music separation-gate self-attention model surpasses the two-stage music separation-gate model in metrics associated with human voice and accompaniment sources. This outcome convincingly underscores the enhanced effectiveness achieved by integrating CS, self-attention, and adaptive connection in network performance, as well as the adaptive gate structure for music copyright protection. This approach heightens the model's autonomous selectivity, minimizes outliers, stabilizes waveform characteristics, and significantly contributes to the safeguarding of digital content. [ABSTRACT FROM AUTHOR]

Recently, with the emergence of many image editing tools (photoshop, Topaz studio, etc.), the authenticity of images has been severely challenged. However, the performance of some existing traditional feature extraction methods and detection methods based on convolutional neural network (CNN) is poor, and the information provided by the features extracted from the network is limited and single. In this paper, an end-to-end ringed residual U-Net is proposed to detect image splicing forgery by blending features of non-natural regions. Some regions with significant differences from the image background are defined as non-natural regions(such as the irregular border at the splicing of images). In this paper, a feature enhancement module for non-natural regions is constructed, which the image through the pooling of four different scales, and these features are then combined with the original image and input to the backbone network for processing, aiming to highlight regions of the image that differ significantly from the background. Therefore, after adding the feature enhancement module for non-natural regions to the end-to-end ring residual U-Net, more attention will be paid to the tampering regions in the feature extraction stage, image manipulation detection and localization will also become more accurate. Compared with some mainstream methods, this method achieves better performance on the three standard datasets(CASIA2.0, NIST2016, COLUMBIA). In addition, it has excellent robustness under JPEG compression attack and noise corruption attack. [ABSTRACT FROM AUTHOR]

Since plant diseases occurring during the growth process are a significant factor leading to the decline in both yield and quality, the classification and detection of plant leaf diseases, followed by timely prevention and control measures, are crucial for safeguarding plant productivity and quality. As the traditional convolutional neural network structure cannot effectively recognize similar plant leaf diseases, in order to more accurately identify the diseases on plant leaves, this paper proposes an effective plant disease image recognition method aECA-ResNet34. This method is based on ResNet34, and in the first and the last layers of this network, respectively, we add this paper's improved aECAnet with the symmetric structure. aECA-ResNet34 is compared with different plant disease classification models on the peanut dataset constructed in this paper and the open-source PlantVillage dataset. The experimental results show that the aECA-ResNet34 model proposed in this paper has higher accuracy, better performance, and better robustness. The results show that the aECA-ResNet34 model proposed in this paper is able to recognize diseases of multiple plant leaves very accurately. [ABSTRACT FROM AUTHOR]

The increasing availability of hydrological and physiographic spatiotemporal data has boosted machine learning's role in rapid flood mapping. Yet, data scarcity, especially high-resolution DEMs, challenges regions with limited access. This paper examines how DEM type and resolution affect flood prediction accuracy, utilizing a cutting-edge deep learning (DL) method called 1D convolutional neural network (CNN). It utilizes synthetic hydrographs as training input and water depth data obtained from LISFLOOD-FP, a 2D hydrodynamic model, as target data. This study investigates digital surface models (DSMs) and digital terrain models (DTMs) derived from a 1 m LIDAR-based DTM, with resolutions from 15 to 30 m. The methodology is applied and assessed in a established benchmark, city of Carlisle, UK. The models' performance is then evaluated and compared against an observed flood event using RMSE, Bias, and Fit indices. Leveraging the insights gained from this region, the paper discusses the applicability of the methodology to address the challenges encountered in a data-scarce flood-prone region, exemplified by Pakistan. Results indicated that utilizing a 30 m DTM outperformed a 30 m DSM in terms of flood depth prediction accuracy by about 21% during the flood peak stage, highlighting the superior performance of DTM at lower resolutions. Increasing the resolution of DTM to 15 m resulted in a minimum 50% increase in RMSE and a 20% increase in fit index across all flood stages. The findings emphasize that while a coarser resolution DEM may impact the accuracy of machine learning models, it remains a viable option for rapid flood prediction. However, even a slight improvement in data resolution in data-scarce regions would provide significant added value, ultimately enhancing flood risk management. [ABSTRACT FROM AUTHOR]

Advancements in Machine Learning (ML) and Computer Vision have led to notable improvements in the detection of breast cancer. However, the accuracy of the classifier is limited due to imbalanced datasets that cause overfitting. Thus, additional images are needed to improve the classifier's performance. Generative Adversarial Networks (GAN) are used for image augmentation. Still, its limitations, such as the random use of different types of GAN, can lead to a too-good discriminator, causing generator training to fail due to vanishing gradients. Therefore, selecting the appropriate GAN model for the given scenario is crucial for optimal performance. This paper proposes a novel Smart Generative Adversarial Network (Smart GAN) architecture to develop an efficient and computational classification model for a limited imbalanced dataset. Smart GAN uses a three-fold approach. Different types of GAN augment the dataset in the first phase of experimental work, and their evaluation metrics are calculated. In the second phase, the metric scores are used as rewards for the Reinforcement learning model (Q-learning approach). The best augmentation is chosen based on the best Q-values for each metric score. It compares three different Convolutional Neural Networks (CNN) and selects the best-suited network to classify the augmented datasets. The proposed Smart GAN architecture outperforms other existing approaches by giving a better accuracy of 89.62% and 89.91% on Mammographic Image Analysis Society (MIAS) and Digital Database for Screening Mammography (DDSM) augmented datasets, respectively, representing an approximately 10% increment in detection rate compared to non-augmented datasets. [ABSTRACT FROM AUTHOR]

The accurate health status evaluation of lithium-ion batteries is crucial for preemptive identification of potential battery failures and averting hazardous incidents, given its essential role in indicating the extent of battery degradation. The challenge in determining the State of Health (SOH) arises from the absence of a precise and standardized definition, as well as the difficulty in measuring essential input variables. Therefore, this paper utilizes current and voltage data during the charge and discharge process as direct inputs for SOH estimation and proposes a deep learning-based lithium-ion battery SOH estimation approach. Specifically, it leverages Bayesian optimized Convolutional Neural Network (CNN) within a data-driven framework. Experimental results demonstrate that the proposed deep learning method achieves a Mean Absolute Error (MAE) of 1% and a Maximum Error (MAX) below 4% in estimation accuracy, highlighting its enhanced precision and robustness. [ABSTRACT FROM AUTHOR]

Multivariate time series have more complex and high‐dimensional characteristics, which makes it difficult to analyze and predict the data accurately. In this paper, a new multivariate time series prediction method is proposed. This method is a generative adversarial networks (GAN) method based on Fourier transform and bi‐directional gated recurrent unit (Bi‐GRU). First, the Fourier transform is utilized to extend the data features, which helps the GAN to better learn the distributional features of the original data. Second, in order to guide the model to fully learn the distribution of the original time series data, Bi‐GRU is introduced as the generator of GAN. To solve the problems of mode collapse and gradient vanishing that exist in GAN, Wasserstein distance is used as the loss function of GAN. Finally, the proposed method is used for the prediction of air quality, stock price and RMB exchange rate. The experimental results show that the model can effectively predict the trend of the time series compared with the other nine baseline models. It significantly improves the accuracy and flexibility of multivariate time series forecasting and provides new ideas and methods for accurate time series forecasting in industrial, financial and environmental fields. [ABSTRACT FROM AUTHOR]

Convolutional neural network (CNN) is one of the well-known deep learning algorithms that uses convolutional filters to extract the features in the images. The most important issue when training CNN is the overfitting which prevents the model from generalization to unseen data. This paper addressed this issue by proposing a novel hybrid approach that uses bees algorithm (BA) to optimize the regularization parameter and weight regularization factor to adjust the regularization value in each convolutional layer and fully connected layer resulting in a hybrid algorithm called bees algorithm regularized convolutional neural network (BA-RCNN). It was applied to three different datasets for classification or predictions purposes and showed an improvement in the validation and testing accuracy leading to a lower difference with the training accuracy which means the overfitting is reduced comparing to the original CNN. Applying the BA-RCNN algorithm to 'Cifar10DataDir' improved the validation accuracy from 80.34% for the original CNN to 82.80% for the hybrid BA-RCNN algorithm, in the electrocardiogram the improvement was from 87.80 to 90.47% and both datasets were used for classification. Furthermore, the hybrid BA-RCNN algorithm was applied to predict the porosity percentage based on artificial porosity images and the results showed that the validation accuracy was improved from 81.67% for the original CNN to 87.33% for the hybrid BA-RCNN algorithm. [ABSTRACT FROM AUTHOR]

This paper presents ConvStabNet, a convolutional neural network designed to predict optimal stabilization parameters for each cell in the Streamline Upwind Petrov Galerkin (SUPG) stabilization scheme. ConvStabNet employs a shared parameter approach, allowing the network to understand the relationships between cell characteristics and their corresponding stabilization parameters while efficiently handling the parameter space. Comparative analyses with state-of-the-art neural network solvers based on variational formulations highlight the superior performance of ConvStabNet. To improve the accuracy of SUPG in solving partial differential equations (PDEs) with interior and boundary layers, ConvStabNet incorporates a loss function that combines a strong residual component with a cross-wind derivative term. The findings confirm ConvStabNet as a promising method for accurately predicting stabilization parameters in SUPG, thereby marking it as an advancement over neural network-based PDE solvers. [ABSTRACT FROM AUTHOR]

Convolutional neural networks (CNNs) are now often used in deep learning and computer vision applications. Its convolutional layer accounts for most calculations and should be computed fast in a local edge device. Field‐programmable gate arrays (FPGAs) have been adequately explored as promising hardware accelerators for CNNs due to their high performance, energy efficiency, and reconfigurability. This paper developed an efficient FPGA‐based 16‐bit fixed‐point hardware accelerator unit for deep learning applications on the 32‐bit low‐memory edge device (PYNQ‐Z2 board). Additionally, singular value decomposition is applied to the fully connected layer for dimensionality reduction of weight parameters. The accelerator unit was designed for all five layers and employed eight processing elements in convolution layers 1 and 2 for parallel computations. In addition, array partitioning, loop unrolling, and pipelining are the techniques used to increase the speed of calculations. The AXI‐Lite interface was also used to communicate between IP and other blocks. Moreover, the design is tested with grayscale image classification on MNIST handwritten digit dataset and color image classification on the Tumor dataset. The experimental results show that the proposed accelerator unit implementation performs faster than the software‐based implementation. Its inference speed is 89.03% more than INTEL 3‐core CPU, 86.12% higher than Haswell 2‐core CPU, and 82.45% more than NVIDIA Tesla K80 GPU. Furthermore, the throughput of the proposed design is 4.33GOP/s, which is better than the conventional CNN accelerator architectures. [ABSTRACT FROM AUTHOR]

Aspect-based sentiment analysis (ABSA) aims to analyze the emotional color contained in sentences or documents in more detail by classifying and evaluating different aspects and emotions in the text. However, the current research methods cannot effectively analyze the relationship between aspect words and context and extract grammatical information about sentences. Additionally, the extracted syntactic information is insufficient, and the combination of syntactic and semantic information is inefficient, leaving the model unable to correctly determine aspects' emotional orientations. This paper proposes an aspect-level sentiment analysis based on Fusion Graph Double Convolutional Neural Networks (FGD-GCN) to address these issues. Firstly, FGD-GCN proposes a multi-feature extraction module. Using BERT and bidirectional long-short-term memory models, this module extracts the hidden context between words. In addition, the positional attention module is used to capture important features in sentences, reducing noise and bias. Then, a semantic enhancement module is proposed, which fuses attention-focused information and feature information extracted from graphs to emphasize aspect words and context, and uses CNN model to classify on feature vectors. According to experiment results on three benchmark datasets, the model outperforms previous GCN methods for context-based aspect-level sentiment analysis. [ABSTRACT FROM AUTHOR]

A key study area throughout the medical sector for image processing and analysis is medical image segmentation. The diagnosis and treatment strategies of doctors may have a solid foundation owing to accurate and effective medical image segmentation. Conventional approaches in this field rely on manual feature extraction, which makes segmentation complex, costs doctors’ time and energy, and involves a subjective evaluation that is readily susceptible to diagnostic errors. Researchers have applied convolutional neural network-based deep learning techniques to the segmentation of medical images as a result of their impressive advancements and successes in the field of computer vision. The research described here uses the U-Net network’s outstanding feature learning capabilities and end-to-end processing mode for lung CT image segmentation via fully convolutional network (FCN) research. However, focusing on valuable, crucial information aspects in the U-Net network is challenging. This study employed multilevel attention mechanisms on the basis of U-Net networks to enhance the model’s accuracy in lung CT image segmentation. These mechanisms were inspired by attention mechanisms. By improving the segmentation accuracy and optimizing the segmentation effect, the new model embeds a self-attention module in front of each upsampling layer in the U-Net model. This module provides more detailed information by stitching the self-attention module of the original image and then suppresses irrelevant and redundant information by using the effect of feature extraction of the upsampling layer. Several additional comparative experiments were conducted on the 2019nCoVR dataset. The outcomes demonstrate the efficacy of the optimized model described in this paper and its application results in improved segmentation effects in lung CT images. Additionally, the new model has distinct advantages over existing approaches that are typical of medical image segmentation, which represent its higher level of lung CT image segmentation. [ABSTRACT FROM AUTHOR]

Deep learning models have demonstrated potential in Condition-Based Monitoring (CBM) for rotating machinery, such as induction motors (IMs). However, their performance is significantly influenced by the size of the training dataset and the way signals are presented to the model. When trained on segmented signals over a fixed period, the model's accuracy can decline when tested on signals that differ from the training interval or are randomly sampled. Conversely, models utilizing data augmentation techniques exhibit better generalization to unseen conditions. This paper highlights the bias introduced by traditional training methods towards specific periodic waveform sampling and proposes a new method to augment phase current signals during training using a shifting window technique. This approach is considered as a practical approach for motor current augmentation and is shown to enhance classification accuracy and improved generalization when compared to existing techniques. [ABSTRACT FROM AUTHOR]

Magnetic field is one of the basic data for constructing a transformer digital twin. The finite element transient simulation takes a long time and cannot meet the real-time requirements of a digital twin. According to the nonlinear characteristics of the core and the timing characteristics of the magnetic field, this paper proposes a fast calculation method of the spatial magnetic field of the transformer, considering the nonlinear characteristics of the core. Firstly, based on the geometric and electrical parameters of the single-phase double-winding test transformer, the corresponding finite element simulation model is built. Secondly, the key parameters of the finite element model are parametrically scanned to obtain the nonlinear working condition data set of the test transformer. Finally, a deep learning network integrating a convolutional neural network (CNN) and a long short-term memory network (LSTM) is built to train the mapping relationship between winding voltage, current, and the spatial magnetic field so as to realize the rapid calculation of the transformer magnetic field. The results show that the calculation time of the deep learning model is greatly shortened compared with the finite element model, and the model calculation results are consistent with the experimental measurement results. [ABSTRACT FROM AUTHOR]

This paper introduces a novel convolutional neural network (CNN) architecture tailored for state of charge (SoC) estimation in battery management systems (BMS), accompanied by an advanced optimization technique to enhance training efficiency. The proposed CNN architecture comprises multiple one-dimensional convolutional (Conv1D) layers followed by batch normalization and one-dimensional max-pooling (MaxPooling1D) layers, culminating in dense layers for regression-based SoC prediction. To improve training effectiveness, we introduce an advanced dynamic k-decay learning rate scheduling method. This technique dynamically adjusts the learning rate during training, responding to changes in validation loss to fine-tune the training process. Experimental validation was conducted on various drive cycles, including the dynamic stress test (DST), Federal Urban Driving Schedule (FUDS), Urban Dynamometer Driving Schedule (UDDS), United States 2006 Supplemental Federal Test Procedure (US06), and Worldwide Harmonized Light Vehicles Test Cycle (WLTC), spanning four temperature conditions (−5 °C, 5 °C, 25 °C, 45 °C). Notably, the test error of DST and US06 drive cycles, the CNN with optimization achieved a mean absolute error (MAE) of 0.0091 and 0.0080, respectively at 25 °C, and a root mean square error (RMSE) of 0.013 and 0.0095, respectively. In contrast, the baseline CNN without optimization yielded higher MAE and RMSE values of 0.011 and 0.014, respectively, on the same drive cycles. Additionally, training time with the optimization technique was significantly reduced, with a recorded time of 324.14 s compared to 648.59 s for the CNN without optimization at room temperature. These results demonstrate the effectiveness of the proposed CNN architecture combined with advanced dynamic learning rate scheduling in accurately predicting SoC across various battery types and drive cycles. The optimization technique not only improves prediction accuracy but also substantially reduces training time, highlighting its potential for enhancing battery management systems in electric vehicle applications. [ABSTRACT FROM AUTHOR]

Photovoltaic (PV) microgrids comprise a multitude of small PV power stations distributed across a specific geographical area in a decentralized manner. Computational services for forecasting the output power of power stations are crucial for optimizing resource deployment. This paper proposes a deep-learning-based architecture for short-term prediction of PV power. Firstly, in order to make full use of the spatial information between different power stations, a spatio–temporal feature fusion method is proposed. This method is capable of exploiting both the power information of neighboring power stations with strong correlations and meteorological information with the PV feature data of the target power station. By using a multiscale convolutional neural network–long short-term memory (CNN-LSTM) network model, it is capable of generating a PV feature dataset containing spatio–temporal attributes that expand the data source and enhance the feature constraints. It is capable of predicting the output power sequences of power stations in PV microgrids with high model generalization and responsiveness. To validate the effectiveness of the proposed framework, an extensive numerical analysis is also conducted based on a real-world PV dataset. [ABSTRACT FROM AUTHOR]

Falls among the elderly are a common and serious health risk that can lead to physical injuries and other complications. To promptly detect and respond to fall events, radar-based fall detection systems have gained widespread attention. In this paper, a deep learning model is proposed based on the frequency spectrum of radar signals, called the convolutional bidirectional long short-term memory (CB-LSTM) model. The introduction of the CB-LSTM model enables the fall detection system to capture both temporal sequential and spatial features simultaneously, thereby enhancing the accuracy and reliability of the detection. Extensive comparison experiments demonstrate that our model achieves an accuracy of 98.83% in detecting falls, surpassing other relevant methods currently available. In summary, this study provides effective technical support using the frequency spectrum and deep learning methods to monitor falls among the elderly through the design and experimental validation of a radar-based fall detection system, which has great potential for improving quality of life for the elderly and providing timely rescue measures. [ABSTRACT FROM AUTHOR]

With the rapid advancement of the Internet of Things, network security has garnered increasing attention from researchers. Applying deep learning (DL) has significantly enhanced the performance of Network Intrusion Detection Systems (NIDSs). However, due to its complexity and "black box" problem, deploying DL-based NIDS models in practical scenarios poses several challenges, including model interpretability and being lightweight. Feature selection (FS) in DL models plays a crucial role in minimizing model parameters and decreasing computational overheads while enhancing NIDS performance. Hence, selecting effective features remains a pivotal concern for NIDSs. In light of this, this paper proposes an interpretable feature selection method for encrypted traffic intrusion detection based on SHAP and causality principles. This approach utilizes the results of model interpretation for feature selection to reduce feature count while ensuring model reliability. We evaluate and validate our proposed method on two public network traffic datasets, CICIDS2017 and NSL-KDD, employing both a CNN and a random forest (RF). Experimental results demonstrate superior performance achieved by our proposed method. [ABSTRACT FROM AUTHOR]

Convolutional neural networks (CNNs) and graph convolutional networks (GCNs) have made considerable advances in hyperspectral image (HSI) classification. However, most CNN-based methods learn features at a single-scale in HSI data, which may be insufficient for multi-scale feature extraction in complex data scenes. To learn the relations among samples in non-grid data, GCNs are employed and combined with CNNs to process HSIs. Nevertheless, most methods based on CNN-GCN may overlook the integration of pixel-wise spectral signatures. In this paper, we propose a pyramid cascaded convolutional neural network with graph convolution (PCCGC) for hyperspectral image classification. It mainly comprises CNN-based and GCN-based subnetworks. Specifically, in the CNN-based subnetwork, a pyramid residual cascaded module and a pyramid convolution cascaded module are employed to extract multiscale spectral and spatial features separately, which can enhance the robustness of the proposed model. Furthermore, an adaptive feature-weighted fusion strategy is utilized to adaptively fuse multiscale spectral and spatial features. In the GCN-based subnetwork, a band selection network (BSNet) is used to learn the spectral signatures in the HSI using nonlinear inter-band dependencies. Then, the spectral-enhanced GCN module is utilized to extract and enhance the important features in the spectral matrix. Subsequently, a mutual-cooperative attention mechanism is constructed to align the spectral signatures between BSNet-based matrix with the spectral-enhanced GCN-based matrix for spectral signature integration. Abundant experiments performed on four widely used real HSI datasets show that our model achieves higher classification accuracy than the fourteen other comparative methods, which shows the superior classification performance of PCCGC over the state-of-the-art methods. [ABSTRACT FROM AUTHOR]

The vision transformer (ViT) has demonstrated performance comparable to that of convolutional neural networks (CNN) in the hyperspectral image classification domain. This is achieved by transforming images into sequence data and mining global spectral-spatial information to establish remote dependencies. Nevertheless, both the ViT and CNNs have their own limitations. For instance, a CNN is constrained by the extent of its receptive field, which prevents it from fully exploiting global spatial-spectral features. Conversely, the ViT is prone to excessive distraction during the feature extraction process. To be able to overcome the problem of insufficient feature information extraction caused using by a single paradigm, this paper proposes an MLP-mixer and a graph convolutional enhanced transformer (MGCET), whose network consists of a spatial-spectral extraction block (SSEB), an MLP-mixer, and a graph convolutional enhanced transformer (GCET). First, spatial-spectral features are extracted using SSEB, and then local spatial-spectral features are fused with global spatial-spectral features by the MLP-mixer. Finally, graph convolution is embedded in multi-head self-attention (MHSA) to mine spatial relationships and similarity between pixels, which further improves the modeling capability of the model. Correlation experiments were conducted on four different HSI datasets. The MGEET algorithm achieved overall accuracies (OAs) of 95.45%, 97.57%, 98.05%, and 98.52% on these datasets. [ABSTRACT FROM AUTHOR]

Simple Summary: Accurate identification of individual Amur tigers is vital for their conservation, as it helps us understand their population and distribution. Existing identification methods often fall short in accuracy, and our study focuses on creating a more accurate method for identifying individual Amur tigers using advanced deep learning techniques. We improved an existing neural network model called InceptionResNetV2 by adding features like dropout layers and dual-attention mechanisms to better capture the unique stripe patterns of each tiger and reduce errors during training. We tested our model on a large dataset of tiger images and found it to be highly effective, achieving an average recognition accuracy of over 95% for different body parts, with left stripes reaching the highest 99.37%. This method significantly outperforms previous models and provides a reliable tool for wildlife researchers and conservationists to monitor and protect Amur tigers. By improving the ability to track individual tigers, our research offers practical benefits for preserving this endangered species and enhancing wildlife management practices globally. Accurate and intelligent identification of rare and endangered individuals of flagship wildlife species, such as Amur tiger (Panthera tigris altaica), is crucial for understanding population structure and distribution, thereby facilitating targeted conservation measures. However, many mathematical modeling methods, including deep learning models, often yield unsatisfactory results. This paper proposes an individual recognition method for Amur tigers based on an improved InceptionResNetV2 model. Initially, the YOLOv5 model is employed to automatically detect and segment facial, left stripe, and right stripe areas from images of 107 individual Amur tigers, achieving a high average classification accuracy of 97.3%. By introducing a dropout layer and a dual-attention mechanism, we enhance the InceptionResNetV2 model to better capture the stripe features of individual tigers at various granularities and reduce overfitting during training. Experimental results demonstrate that our model outperforms other classic models, offering optimal recognition accuracy and ideal loss changes. The average recognition accuracy for different body part features is 95.36%, with left stripes achieving a peak accuracy of 99.37%. These results highlight the model's excellent recognition capabilities. Our research provides a valuable and practical approach to the individual identification of rare and endangered animals, offering significant potential for improving conservation efforts. [ABSTRACT FROM AUTHOR]

Smart agriculture has shifted the paradigm by integrating advanced technologies, particularly weed management. This paper introduces an innovative approach to weed control by applying a Wavelet-based Convolution Neural Network (WCNN). In the era of precision agriculture, our study explores the integration of WCNN into real-world scenarios, emphasizing its adaptability to diverse environmental conditions. Utilizing the spatial-frequency analysis features of wavelets and convolutional neural networks, the WCNN model is the most effective at finding weeds, classifying them, and managing them specifically in agricultural fields in real-time. This research contributes to the scientific discourse on smart agriculture and addresses the challenges of invasive weeds, presenting a sustainable solution for optimizing resource utilization. Our investigation includes a detailed exploration of WCNN’s adaptive learning mechanisms and dynamic adjustment to changing agricultural landscapes. The model seamlessly integrates with existing smart farming infrastructure, showcasing a substantial reduction in manual intervention and a simultaneous increase in agricultural productivity. We incorporate fog computing and resource optimization into our framework, enhancing the efficiency of onboard data processing. To evaluate the real-world efficacy of WCNN, we conducted comprehensive experiments in texture classification and image labelling using two distinct datasets: the plant seedling and soybean weed datasets. Results demonstrate the superior performance of WCNN, achieving higher accuracy in training and test scenarios with significantly fewer parameters than traditional CNNs. For the soybean weed dataset, WCNN achieved remarkable accuracy in the training (0.9970) and testing (0.9987) phases, with correspondingly low losses of 0.0109 and 0.0048. The WCNN model demonstrated high accuracy during training (0.9739) and testing (0.9902), with minimal losses of 0.0898 and 0.0239 in the plant seedling dataset. [ABSTRACT FROM AUTHOR]

Underwater segmentation technology achieves effective monitoring of fish biological information through accurate identification of fish species and precise estimation of their quantities. It serves as an effective approach to enhance the informatization level of aquaculture and promote intelligent management in fisheries. However, the complex and diverse underwater environment, coupled with poor visibility, results in blurry and lower-quality underwater fish images. The current image segmentation methods, when applied to fish segmentation, exhibit low accuracy and inadequate generalization capabilities. This paper proposes an image segmentation model based on Atrous Spatial Pyramid Pooling (ASPP) to address these challenges. The model aims to improve fish feature extraction and enhance the segmentation precision of fish images in complex underwater environments, thereby enhancing the accuracy and generalization capabilities of existing fish segmentation models. First, a multiscale feature extraction module (triangular atrous spatial pyramid multifeature fusion) based on dilated convolutional spatial pyramid pooling, which enhances the extraction of high-level semantic features of images through the triangular combination of multilayer dilated convolutional pyramid pooling and the adaptive channel attention module, is proposed. Second, a spatial attention module based on strip pooling (atrous strip pooling) is proposed, which further expands the receptive field of the attention mechanism by combining different expansion rates, enhances the correlations between pixels, and effectively captures spatial information. Finally, a decoder module based on multilayer semantic feature fusion is proposed. Through the processing and fusion of medium-, low-, and high-level semantic features, the model understands image content and performs accurate pixel-level segmentation. The proposed model is evaluated using a VOC-compliant dataset created from underwater fish images and validated against public and specific underwater fish datasets. The results demonstrate the successful application of the feature extraction and feature fusion modules in underwater fish image segmentation, achieving an average Intersection over Union (MIoU) of 85.49% in segmentation tasks. Compared to conventional segmentation models, the proposed model shows significant improvements, with an average increase of 3.8% in MIoU and 2.5% in balanced F-score (F1-score). The accurate segmentation of underwater fish images and extraction of vital biological information by this model provide a solid foundation for intelligent monitoring, including fish length measurement, weight estimation, and analysis of growth and health status. Moreover, the model offers a scientific framework for decision-making in aquaculture, driving advancements in precision and intelligent management practices in the field. [ABSTRACT FROM AUTHOR]

Accurate and reliable medium- and long-term load forecasting is crucial for the rational planning and operation of power systems. However, existing methods often struggle to accurately extract and capture long-term dependencies in load data, leading to poor predictive accuracy. Therefore, this paper proposes a medium- and long-term residential load forecasting method based on FEDformer, aiming to capture long-term temporal dependencies of load data in the frequency domain while considering factors such as electricity prices and temperature, ultimately improving the accuracy of medium- and long-term load forecasting. The proposed model employs Discrete Cosine Transform (DCT) for frequency domain transformation of time-series data to address the Gibbs phenomenon caused by the use of Discrete Fourier Transform (DFT) in FEDformer. Additionally, causal convolution and attention mechanisms are applied in the frequency domain to enhance the model's capability to capture long-term dependencies. The model is evaluated using real-world load data from power systems, and experimental results demonstrate that the proposed model effectively learns the temporal and nonlinear characteristics of load data. Compared to other baseline models, DCTformer improves prediction accuracy by 37.5% in terms of MSE, 26.9% in terms of MAE, and 26.24% in terms of RMSE. [ABSTRACT FROM AUTHOR]

Low-light images are prevalent in intelligent monitoring and many other applications, with low brightness hindering further processing. Although low-light image enhancement can reduce the influence of such problems, current methods often involve a complex network structure or many iterations, which are not conducive to their efficiency. This paper proposes a Zero-Reference Camera Response Network using a camera response model to achieve efficient enhancement for arbitrary low-light images. A double-layer parameter-generating network with a streamlined structure is established to extract the exposure ratio K from the radiation map, which is obtained by inverting the input through a camera response function. Then, K is used as the parameter of a brightness transformation function for one transformation on the low-light image to realize enhancement. In addition, a contrast-preserving brightness loss and an edge-preserving smoothness loss are designed without the requirement for references from the dataset. Both can further retain some key information in the inputs to improve precision. The enhancement is simplified and can reach more than twice the speed of similar methods. Extensive experiments on several LLIE datasets and the DARK FACE face detection dataset fully demonstrate our method's advantages, both subjectively and objectively. [ABSTRACT FROM AUTHOR]

In this paper, artificial intelligence (AI) technology is applied to the electromagnetic imaging of anisotropic objects. Advances in magnetic anomaly sensing systems and electromagnetic imaging use electromagnetic principles to detect and characterize subsurface or hidden objects. We use measured multifrequency scattered fields to calculate the initial dielectric constant distribution of anisotropic objects through the backpropagation scheme (BPS). Later, the estimated multifrequency permittivity distribution is input to a convolutional neural network (CNN) for the adaptive moment estimation (ADAM) method to reconstruct a more accurate image. In the meantime, we also improve the definition of loss function in the CNN. Numerical results show that the improved loss function unifying the structural similarity index measure (SSIM) and root mean square error (RMSE) can effectively enhance image quality. In our simulation environment, noise interference is considered for both TE (transverse electric) and TM (transverse magnetic) waves to reconstruct anisotropic scatterers. Lastly, we conclude that multifrequency reconstructions are more stable and precise than single-frequency reconstructions. [ABSTRACT FROM AUTHOR]