Search

Featured Application: The model proposed in this paper can help stock investors to get high returns on newly listed stocks. Most previous stock investing methods were unable to predict newly listed stocks because they did not have historical data on newly listed stocks. In this paper, we use the Q-learning algorithm based on a convolutional neural network and add sentiment analysis to establish a prediction method for Chinese stock investment tasks. There are 118 companies that are ranked in the Chinese top 150 list for two consecutive years in both 2022 and 2023. We collected all comments under the stock bar of these 118 stocks for each day from 1 January 2022 to 1 July 2024, totaling nearly 10 million comments. There are 90 stocks left after the preprocessing of 118 stocks. We use these 90 stocks as the dataset. The stock's closing price, volume, and comment text data are fed together to the agent, and the trained agent outputs investment behaviors that maximize future returns. We apply the trained model to two test sets that are completely different from the training set and compare it to several other methods. Our proposed method called SADQN-S obtains results of 1.1229 and 1.1054 on the two test sets. SADQN-S obtained higher final total assets than the other methods on both test sets. This shows that our model can help stock investors earn high returns on newly listed stocks. [ABSTRACT FROM AUTHOR]

Due to the high detection efficiency of the airborne time-domain electromagnetic method, it can quickly collect electromagnetic response data for large area-wide regions, but it also brings great challenges to the inversion interpretation of the data because there are numerous survey data that need to be inverted. Conventional optimal inversion and fast imaging methods still take a long time to obtain conductivity and depth information, which affect the efficiency of real-time data interpretation. In this paper, we present a deep learning inversion method that can be used to solve the fast inversion problem of airborne time-domain electromagnetic data; the method uses a one-dimensional convolutional neural network. The network structure consists of two parts containing different numbers of convolutional and pooling layers. The training sample dataset was generated via two ways of constructing geoelectric models through forward modelling. To check the effectiveness of our deep learning inversion strategy, we tested it on synthetic data and two types of survey data. The experimental results show that this inversion method is effective and that it can be applied to airborne time-domain electromagnetic data collected using different observation systems. The proposed inversion method can obtain better inversion results for both simple and complex stratigraphic structures and requires significantly less computation time compared to conventional optimal inversion methods. [ABSTRACT FROM AUTHOR]

Featured Application: This work provides a systematic way to produce a defect-free atom array of neutral atom platforms for quantum information processing. This paper aims to present an approach to address the atom rearrangement problem by developing Convolutional Neural Network (CNN) models. These models predict the coordinates for atom movements while ensuring collision-free transitions and filling all vacancies in the target array. The process begins with designing a cost function for the assignment problem that incorporates constraints to prevent collisions and guarantee vacancy filling. We then build and train CNN models using datasets for three different grid sizes: 10 × 10 ,   13 × 13 ,   and   21 × 21 . Our models achieve high accuracy in predicting atom positions, with individual position accuracies of 99.63%, 98.93%, and 97.24%, respectively, for the aforementioned grid sizes. Despite limitations in training larger models due to hardware constraints, our approach demonstrates significant improvements in speed and accuracy. The final section of the paper presents detailed accuracy results and calculation times for each model, highlighting the potential of CNN-based methods in optimizing atom rearrangement processes. [ABSTRACT FROM AUTHOR]

Monitoring the condition of the grinding wheel in real-time during the grinding process is crucial as it directly impacts the precision and quality of the workpiece. Deep learning technology plays a vital role in analyzing the changes in sensor signals and identifying grinding wheel wear during the grinding process. Therefore, this paper innovatively proposes a grinding wheel wear recognition method based on Variational Mode Decomposition (VMD) denoising and Aquila Optimizer—Convolutional Neural Network—Long Short-Term Memory (AO-CNN-LSTM). The paper utilizes Acoustic Emission (AE) signals generated during grinding to identify the condition of the grinding wheel. To address noise interference, the study introduces the VMD algorithm for denoising the sample dataset, enhancing the effectiveness of neural network training. Subsequently, the dataset is fed into the designed Convolutional Neural Network—Long Short-Term Memory (CNN-LSTM) structure with AO-optimized parameters. Experimental results demonstrate that this method achieves high accuracy and performance. [ABSTRACT FROM AUTHOR]

Detecting instruments in a music signal is often used in database indexing, song annotation, and creating applications for musicians and music producers. Therefore, effective methods that automatically solve this issue need to be created. In this paper, the mentioned task is solved using mel-frequency cepstral coefficients (MFCC) and various architectures of artificial neural networks. The authors' contribution to the development of automatic instrument detection covers the methods used, particularly the neural network architectures and the voting committees created. All these methods were evaluated, and the results are presented and discussed in the paper. The proposed automatic instrument detection methods show that the best classification quality was obtained for an extensive model, which is the so-called committee of voting classifiers. [ABSTRACT FROM AUTHOR]

The vibration signals collected by acceleration sensors are interspersed with noise interference, which increases the difficulty of fault diagnosis for rolling bearings. For this reason, a rolling bearing fault diagnosis method based on complete ensemble empirical model decomposition with adaptive noise (CEEMDAN) and improved convolutional neural network (CNN) is proposed. Firstly, the original vibration signal is decomposed into a series of intrinsic modal function (IMF) components using the CEEMDAN algorithm, the components are filtered according to the correlation coefficients and the signals are reconstructed. Secondly, the reconstructed signals are converted into a two-dimensional grey-scale map and input into a convolutional neural network to extract the features. Lastly, the features are inputted into a support vector machine (SVM) with the optimised parameters of the grey wolf optimiser (GWO) to perform the identification and classification. The experimental results show that the rolling bearing fault diagnosis method based on CEEMDAN and CNN-SVM proposed in this paper can significantly reduce the noise interference, and its average fault diagnosis accuracy is as high as 99.25%. Therefore, it is feasible to apply it in the field of rolling bearing fault diagnosis. [ABSTRACT FROM AUTHOR]

Automatic Container Code Recognition (ACCR) is critical for enhancing the efficiency of container terminals. However, existing ACCR methods frequently fail to achieve satisfactory performance in complex environments at port gates. In this paper, we propose an approach for accurate, fast, and compact container code recognition by utilizing YOLOv4 for container region localization and Deeplabv3+ for character recognition. To enhance the recognition speed and accuracy of YOLOv4 and Deeplabv3+, and to facilitate their deployment at gate entrances, we introduce several improvements. First, we optimize the feature-extraction process of YOLOv4 and Deeplabv3+ to reduce their computational complexity. Second, we enhance the multi-scale recognition and loss functions of YOLOv4 to improve the accuracy and speed of container region localization. Furthermore, we adjust the dilated convolution rates of the ASPP module in Deeplabv3+. Finally, we replace two upsampling structures in the decoder of Deeplabv3+ with transposed convolution upsampling and sub-pixel convolution upsampling. Experimental results on our custom dataset demonstrate that our proposed method, C-YOLOv4, achieves a container region localization accuracy of 99.76% at a speed of 56.7 frames per second (FPS), while C-Deeplabv3+ achieves an average pixel classification accuracy (MPA) of 99.88% and an FPS of 11.4. The overall recognition success rate and recognition speed of our approach are 99.51% and 2.3 ms per frame, respectively. Moreover, C-YOLOv4 and C-Deeplabv3+ outperform existing methods in complex scenarios. [ABSTRACT FROM AUTHOR]

As an advanced detection technique, electrical resistive tomography (ERT) has been applied to detect the solid–liquid two-phase flow velocity based on available ERT measurements. The flow velocity computation by ERT must depend on the relative algorithms, including both the cross-correlation (CC) principle and convolutional neural networks (CNNs). However, these two types of algorithms have poor accuracy and generalization under complex measuring conditions and various flow patterns. To address this issue, in this paper, a hybrid network is proposed that combines a CNN with a reproducing kernel-based support vector machine (RKSVM) technique. The features hidden in ERT measurements are extracted using the CNN, and then the flow velocity is computed by the RKSVM in a high-dimensional feature space. According to the ERT measurements in an actual experimental platform, the results show that the hybrid network has higher accuracy and generalization ability for flow velocity computation compared with the existing CC, RKSVM, and CNN methods. [ABSTRACT FROM AUTHOR]

Facial expression recognition (FER) plays a crucial role in understanding human emotions and is becoming increasingly relevant in educational contexts, where personalized and empathetic interactions are essential. The problems with existing approaches are typically solved using a single deep learning method, which is not robust with complex datasets, such as FER data, which have a characteristic imbalance and multi-class labels. In this research paper, an innovative approach to FER using a homogeneous ensemble convolutional neural network, called HoE-CNN, is presented for future online learning education. This paper aims to transfer the knowledge of models and FER classification using ensembled homogeneous conventional neural network architectures. FER is challenging to research because there are many real-world applications to consider, such as adaptive user interfaces, games, education, and robot integration. HoE-CNN is used to improve the classification performance on an FER dataset, encompassing seven main multi-classes (Angry, Disgust, Fear, Happy, Sad, Surprise, Neutral). The experiment shows that the proposed framework, which uses an ensemble of deep learning models, performs better than a single deep learning model. In summary, the proposed model will increase the efficiency of FER classification results and solve FER2013 at a accuracy of 75.51%, addressing both imbalanced datasets and multi-class classification to transfer the application of the model to online learning applications. [ABSTRACT FROM AUTHOR]

During the long-term operation of thyristor converter valves, the saturable reactor vibration (mainly caused by magnetostriction) will lead to core looseness faults. In order to accurately evaluate the fault degradation degree, this paper proposes a vibration signal recognition model for iron core looseness based on synchrosqueezed wavelet transforms and a convolutional neural network. Firstly, vibration experiments are conducted on saturable reactors to obtain signals under different core looseness degrees. Then, the spectrogram features of vibration signals are extracted using synchrosqueezed wavelet transform. Finally, based on the high-dimensional learning ability of convolutional neural networks, the fault characteristics of the spectrogram are mined to accurately identify the core looseness degree. The research results indicate that the model in the paper has higher recognition accuracy than some other methods, which provides convenience for the monitoring and maintenance of saturable reactors. [ABSTRACT FROM AUTHOR]

The motor is the primary impetus source of most mechanical equipment, and its failure will cause substantial economic losses and safety problems. Therefore, it is necessary to study online fault diagnosis techniques for motors, given the problems caused by shallow learning models or single-sensor fault analysis in previous motor fault diagnosis techniques, such as blurred fault features, inaccurate identification, and time and manpower consumption. In this paper, we proposed a model for motor fault diagnosis based on deep learning and multi-sensor information fusion. Firstly, a correlation adaptive weighting method is proposed in this paper, and it is used to integrate the collected multi-source homogeneous sensor information into multi-source heterogeneous sensor information through the data layer fusion. Secondly, the 1D-CNN is used to carry out feature extraction, feature layer fusion, and fault classification of multi-source heterogeneous information of the motor. Finally, the data of seven states (one healthy and six faulty) of the motor are collected by the motor drive test bench to realize the model's training, testing, and verification. The experimental results show that the fault diagnosis accuracy of the model is 99.3%. Thus, this method has important practical implications for improving the accuracy of motor fault diagnosis further. [ABSTRACT FROM AUTHOR]

With the development of new technologies inside car mechanisms with various sensors connected to the IoT, a new generation of automation is attracting attention. However, there are still some factors that are difficult to detect. Among them, one of the highest risk factors is black ice. A road covered with black ice, which is hard to see from a distance, is not only the cause of damage to vehicles passing over the spot, but it also puts lives at risk. Hence, the detection of black ice is essential. A lot of research has been done on this topic with various sensors and methods. However, hyperspectral imaging has not been used for this particular purpose. Therefore, in this paper, black ice classification has been performed with the help of hyperspectral imaging in collaboration with a deep learning model for the first time. With abundant spectral and spatial information, hyperspectral imaging is a good way to analyze any material. In this paper, a 2D–3D Convolutional Neural Network (CNN) has been used to classify hyperspectral images of black ice. The spectral data were preprocessed, and the dimension of the image cube was reduced with the help of Principal Component Analysis (PCA). The proposed method was then compared with the existing method for better evaluation. [ABSTRACT FROM AUTHOR]

This paper addresses the practical challenge of detecting tomato plant diseases using a hybrid lightweight model that combines a Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN). Traditional image classification models demand substantial computational resources, limiting their practicality. This study aimed to develop a model that can be easily implemented on low-cost IoT devices while maintaining high accuracy with real-world images. The methodology leverages a CNN for extracting high-level image features and an RNN for capturing temporal relationships, thereby enhancing model performance. The proposed model incorporates a Closed-form Continuous-time Neural Network, a lightweight variant of liquid time-constant networks, and integrates Neural Circuit Policy to capture long-term dependencies in image patterns, reducing overfitting. Augmentation techniques such as random rotation and brightness adjustments were applied to the training data to improve generalization. The results demonstrate that the hybrid models outperform their single pre-trained CNN counterparts in both accuracy and computational cost, achieving a 97.15% accuracy on the test set with the proposed model, compared to around 94% for state-of-the-art pre-trained models. This study provides evidence of the effectiveness of hybrid CNN-RNN models in improving accuracy without increasing computational cost and highlights the potential of liquid neural networks in such applications. [ABSTRACT FROM AUTHOR]

In recent years, deep learning (DL) has garnered significant attention for its successful applications across various domains in solving complex problems. This interest has spurred the development of numerous neural network architectures, including Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), Generative Adversarial Networks (GANs), and the more recently introduced Transformers. The choice of architecture depends on the data characteristics and the specific task at hand. In the 1D domain, one-dimensional CNNs (1D CNNs) are widely used, particularly for tasks involving the classification and recognition of 1D signals. While there are many applications of 1D CNNs in the literature, the technical details of their training are often not thoroughly explained, posing challenges for those developing new libraries in languages other than those supported by available open-source solutions. This paper offers a comprehensive, step-by-step tutorial on deriving feedforward and backpropagation equations for 1D CNNs, applicable to both regression and classification tasks. By linking neural networks with linear algebra, statistics, and optimization, this tutorial aims to clarify concepts related to 1D CNNs, making it a valuable resource for those interested in developing new libraries beyond existing ones. [ABSTRACT FROM AUTHOR]

With the rapid increase in the number of drivers, traffic accidents due to driver distraction is a major threat around the world. In this paper, we present a novel long-term recurrent convolutional network (LRCN) model for real-time driver activity recognition during both day- and nighttime conditions. Unlike existing works that use static input images and rely on major pre-processing measures, we employ a TimeDistributed convolutional neural network (TimeDis-CNN) layer to process a sequential input to learn the spatial and temporal information of the driver activity without requiring any major pre-processing effort. A pre-trained (CNN) layer is applied for robust initialization and extraction of the primary spatial features of the sequential image inputs. Then, a long short-term memory (LSTM) network is employed to recognize and synthesize the dynamical long-range temporal information of the driver's activity. The proposed system is capable of detecting nine types of driver activities: driving, drinking, texting, smoking, talking, controlling, looking outside, head nodding, and fainting. For evaluation, we utilized a real vehicle environment and collected data from 35 participants, where 14 of the drivers were in real driving scenarios and the remaining in non-driving conditions. The proposed model achieved accuracies of 88.7% and 92.4% for the daytime and nighttime datasets, respectively. Moreover, the binary classifier's accuracy in determining whether the driver is non-distracted or in a distracted state was 93.9% and 99.2% for the daytime and nighttime datasets, respectively. In addition, we deployed the proposed model on a Jetson Xavier embedded board and verified its effectiveness by conducting real-time predictions. [ABSTRACT FROM AUTHOR]

Electrocardiogram (ECG) signals are a measure minute electrical signals generated during the cardiac cycle, a biometric signal that occurs during vital human activity. ECG signals are susceptible to various types of noise depending on the data acquisition conditions, with factors such as sensor placement and the physiological and mental states of the subject contributing to the diverse shapes of these signals. When the data are acquired in a single session, the environmental variables are relatively similar, resulting in similar ECG signals; however, in subsequent sessions, even for the same person, changes in the environmental variables can alter the signal shape. This phenomenon poses challenges for person identification using ECG signals acquired on different days. To improve the performance of individual identification, even when ECG data is acquired on different days, this paper proposes an ensemble deep neural network for person identification by comparing and analyzing the ECG recognition performance under various conditions. The proposed ensemble deep neural network comprises three streams that incorporate two well-known pretrained models. Each network receives the time-frequency representation of ECG signals as input, and a stream reuses the same network structure under different learning conditions with or without data augmentation. The proposed ensemble deep neural network was validated on the Physikalisch-Technische Bundesanstalt dataset, and the results confirmed a 3.39% improvement in accuracy compared to existing methods. [ABSTRACT FROM AUTHOR]

The quality of cement in cased boreholes is related to the production and life of wells. At present, the most commonly used method is to use CBL-VDL to evaluate, but the interpretation process is complicated, and decisions associated with significant risks may be taken based on the interpretation results. Therefore, cementing quality evaluation must be interpreted by experienced experts, which is time-consuming and labor-intensive. To improve the efficiency of cementing interpretation, this paper used VGG, ResNet, and other convolutional neural networks to automatically evaluate the cementing quality, but the accuracy is insufficient. Therefore, this paper proposes a multi-scale perceptual convolutional neural network with kernels of different sizes that can extract and fuse information of different scales in VDL logging. In total, 5500 datasets in Tarim Oilfield were used for training and validation. Compared with other convolutional neural network algorithms, the multi-scale perceptual convolutional neural network algorithm proposed in this paper can evaluate cementing quality more accurately by identifying VDL logging. At the same time, this model's time and space complexity are lower, and the operation efficiency is higher. To verify the anti-interference of the model, this paper added 3%, 6%, and 9% of white noise to the VDL data set for cementing evaluation. The results show that, compared with other convolutional neural networks, the multi-scale perceptual convolutional neural network model is more stable and more suitable for the identification of cementing quality. [ABSTRACT FROM AUTHOR]

Featured Application: This paper studies attention-related optimizations and innovations for the ConvNeXt network proposed in January 2022, providing a reference for subsequent researchers to optimize this network. Thus far, few studies have been conducted on fine-grained classification tasks for the latest convolutional neural network ConvNeXt, and no effective optimization method has been made available. To achieve more accurate fine-grained classification, this paper proposes two attention embedding methods based on ConvNeXt network and designs a new bilinear CBAM; simultaneously, a multiscale, multi-perspective and all-around attention framework is proposed, which is then applied in ConvNeXt. Experimental verification shows that the accuracy rate of the improved ConvNeXt for fine-grained image classification reaches 87.8%, 91.2%, and 93.2% on fine-grained classification datasets CUB-200-2011, Stanford Cars, and FGVC Aircraft, respectively, showing increases of 2.7%, 0.3% and 0.4%, respectively, compared to those of the original network without optimization, and increases of 3.7%, 8.0% and 2.0%, respectively, compared to those of the traditional BCNN. In addition, ablation experiments are set up to verify the effectiveness of the proposed attention framework. [ABSTRACT FROM AUTHOR]

In this paper, we propose a method for estimating the classes and directions of static audio objects using stereo microphones in a drone environment. Drones are being increasingly used across various fields, with the integration of sensors such as cameras and microphones, broadening their scope of application. Therefore, we suggest a method that attaches stereo microphones to drones for the detection and direction estimation of specific emergency monitoring. Specifically, the proposed neural network is configured to estimate fixed-size audio predictions and employs bipartite matching loss for comparison with actual audio objects. To train the proposed network structure, we built an audio dataset related to speech and drones in an outdoor environment. The proposed technique for identifying and localizing sound events, based on the bipartite matching loss we proposed, works better than those of the other teams in our group. [ABSTRACT FROM AUTHOR]

The diagnosis of different pathologies and stages of cancer using whole histopathology slide images (WSI) is the gold standard for determining the degree of tissue metastasis. The use of deep learning systems in the field of medical images, especially histopathology images, is becoming increasingly important. The training and optimization of deep neural network models involve fine-tuning parameters and hyperparameters such as learning rate, batch size (BS), and boost to improve the performance of the model in task-specific applications. Tuning hyperparameters is a major challenge in designing deep neural network models, having a large impact on the performance. This paper analyzes how the parameters and hyperparameters of a deep learning architecture affect the classification of colorectal cancer (CRC) histopathology images using the well-known VGG19 model. This paper also discusses the pre-processing of these images, such as the use of color normalization and stretching transformations on the data set. Among these hyperparameters, the most important neural network hyperparameter is the learning rate (LR). In this paper, different strategies for the optimization of LR are analyzed (both static and dynamic) and a new experiment based on the variation of LR is proposed (the relevance of dynamic strategies over fixed LR is highlighted), after each layer of the neural network together with decreasing variations according to the epochs. The results obtained are very remarkable, obtaining in the simulation an accurate system that achieves 96.4% accuracy on test images (for nine different tissue classes) using the triangular-cyclic learning rate. [ABSTRACT FROM AUTHOR]

This paper proposes a composite model that combines convolutional neural network models and mechanical analysis to determine the forces acting on an object. First, we establish a model using Newtonian mechanics to analyze the forces experienced by the human body during movement, particularly the forces on joints. The model calculates the mapping relationship between the object's movement and the forces on the joints. Then, by analyzing a large number of fencing competition videos using a deep learning model, we extract video features to study the torques and forces on human joints. Our analysis of numerous images reveals that, in certain movement patterns, the peak pressure on the knee joint can be two to three times higher than in a normal state, while the driving knee can withstand peak torques of 400–600 Nm. This straightforward model can effectively capture the forces and torques on the human body during movement using a deep neural network. Furthermore, this model can also be applied to problems involving non-rigid body motion. [ABSTRACT FROM AUTHOR]

At present, many diseases are diagnosed by computer tomography (CT) image technology, which affects the health of the lives of millions of people. In the process of disease confrontation, it is very important for patients to detect diseases in the early stage by deep learning of 3D CT images. The paper offers a hybrid multi-instance learning model (HLFSRNN-MIL), which hybridizes high-low frequency feature fusion (HLFFF) with sequential recurrent neural network (SRNN) for CT image classification tasks. Firstly, the hybrid model uses Resnet-50 as the deep feature. The main feature of the HLFSRNN-MIL lies in its ability to make full use of the advantages of the HLFFF and SRNN methods to make up for their own weakness; i.e., the HLFFF can extract more targeted feature information to avoid the problem of excessive gradient fluctuation during training, and the SRNN is used to process the time-related sequences before classification. The experimental study of the HLFSRNN-MIL model is on two public CT datasets, namely, the Cancer Imaging Archive (TCIA) dataset on lung cancer and the China Consortium of Chest CT Image Investigation (CC-CCII) dataset on pneumonia. The experimental results show that the model exhibits better performance and accuracy. On the TCIA dataset, HLFSRNN-MIL with Residual Network (ResNet) as the feature extractor achieves an accuracy (ACC) of 0.992 and an area under curve (AUC) of 0.997. On the CC-CCII dataset, HLFSRNN-MIL achieves an ACC of 0.994 and an AUC of 0.997. Finally, compared with the existing methods, HLFSRNN-MIL has obvious advantages in all aspects. These experimental results demonstrate that HLFSRNN-MIL can effectively solve the disease problem in the field of 3D CT images. [ABSTRACT FROM AUTHOR]

Over the last 20 years, lithium-ion batteries have become widely used in many fields due to their advantages such as ease of use and low cost. However, there are concerns about the lifetime and reliability of these batteries. These concerns can be addressed by obtaining accurate capacity and health information. This paper proposes a method to predict the capacity of lithium-ion batteries with high accuracy. Four key features were extracted from current and voltage data obtained during charge and discharge cycles. To enhance prediction accuracy, the Pearson correlation coefficient between these features and battery capacities was analyzed and eliminations were made for some batteries. Using a genetic algorithm (GA), the parameter optimization of Convolutional Neural Network (CNN), Backpropagation (BP), and Recurrent Neural Network (RNN) algorithms was performed. The parameters that provide the best performance were determined in a shorter time using GA, which includes natural selection and genetic processes instead of a trial-and-error method. The study employed five metrics—Mean Square Error (MSE), Root Mean Square Error (RMSE), Normalized Root Mean Square Error (NRMSE), Mean Absolute Error (MAE), and Squared Correlation (R2)—to evaluate prediction accuracy. Predictions based on NASA experimental data were compared with the existing literature, demonstrating superior accuracy. Using 100 training data, 68 data predictions were made with a Root Mean Square Error (RMSE) of 0.1176%. This error rate represents an accuracy level 2.5 times higher than similarly accurate studies in the literature. [ABSTRACT FROM AUTHOR]

The integration of electromagnetic imaging technology with the Internet of Things plays an important role in fields as diverse as healthcare, geophysics, and industrial diagnostics. This paper presents a novel two-step neural network architecture to solve the electromagnetic imaging for uniaxial objects which can be used in the Internet of Things. We incident TM and TE waves to unknown objects and receive the scattered fields. In order to reduce the training difficulty, we first input the gathered scattered field information into a deep convolutional neural network (DCNN) to obtain the preliminary guess. In the second step, we feed the guessed image into the convolutional neural network (CNN) to reconstruct high-resolution images. Our numerical results demonstrate the real-time imaging capability of our proposed two-step method in reconstructing high-contrast scatterers. [ABSTRACT FROM AUTHOR]

Surface defect detection is a critical task in the manufacturing industry to ensure product quality and machining efficiency. Image-based precise defect detection faces significant challenges due to defects lacking fixed shapes and the detection being heavily influenced by lighting conditions. Addressing the efficiency demands of defect detection algorithms, often deployed on embedded devices, and the highly imbalanced pixel ratio between foreground and background images, this paper introduces a multi-scale fusion staged U-shaped convolutional neural network (DEU-Net). The network provides segmentation results for defect anomalies while indicating the probability of defect presence. It enables the model to train with fewer parameters, a crucial requirement for practical applications. The proposed model achieves an MIoU of 66.94 and an F1 score of 74.89 with lower Params (36.675) and Flops (19.714). Comparative analysis with FCN, U-Net, Deeplab v3+, U-Net++, Attention U-Net, and Trans U-Net demonstrates the superiority of the proposed approach in surface defect detection. [ABSTRACT FROM AUTHOR]

Featured Application: This study belongs to the field of intelligent non-destructive testing and proposes a CNN-based method for accurate quantification of defect characterized by ultrasonic diffraction method. The innovation in this study lies in several key aspects: (1) Development of a CNN architecture that automatically classifies A-scan signals in the scan path; (2) Connectivity region solving algorithm to accurately calculate the defect-region size according to the classification results; (3) An intelligent noise reduction framework that enables accurate identification of defective areas in complex noise situations. The purpose of this paper is to automate the interpretation of data during ultrasonic diffraction using a non-destructive testing (NDT) technique to accurately size defects for assisting in decision-making. A convolutional neural network (CNN) architecture was developed to automatically measure the length of the defect. Using the architecture, the population of A-scan signals in the scanning path was classified. The defect region was extracted and its size in the scanning direction was obtained by the connected region solution algorithm based on the classification results. The arrival time of diffraction waves was accurately identified by the intelligent denoising framework proposed, combined with Hilbert transform, and then the height of defects was calculated by corresponding geometric relations. The estimation results demonstrate that the measurement method can be considered as a useful technique for crack sizing in industrial structures, even in the case of complex noise. [ABSTRACT FROM AUTHOR]

The blood oxygen saturation, which indicates the ratio of oxygenated hemoglobin to total hemoglobin in the blood, is closely related to one's health status. Oxygen saturation is typically measured using a pulse oximeter. However, this method can cause skin irritation, and in situations where there is a risk of infectious diseases, the use of such contact-based oxygen saturation measurement devices can increase the risk of infection. Therefore, recently, methods for estimating oxygen saturation using facial or hand images have been proposed. In this paper, we propose a method for estimating oxygen saturation from facial images based on a convolutional neural network (CNN). Particularly, instead of arbitrarily calculating the AC and DC components, which are essential for measuring oxygen saturation, we directly utilized signals obtained from facial images to train the model and predict oxygen saturation. Moreover, to account for the time-consuming nature of accurately measuring oxygen saturation, we diversified the model inputs. As a result, for inputs of 10 s, the Pearson correlation coefficient was calculated as 0.570, the mean absolute error was 1.755%, the root mean square error was 2.284%, and the intraclass correlation coefficient was 0.574. For inputs of 20 s, these metrics were calculated as 0.630, 1.720%, 2.219%, and 0.681, respectively. For inputs of 30 s, they were calculated as 0.663, 2.142%, 2.612%, and 0.646, respectively. This confirms that it is possible to estimate oxygen saturation without calculating the AC and DC components, which heavily influence the prediction results. Furthermore, we analyzed how the trained model predicted oxygen saturation through 'SHapley Additive exPlanations' and found significant variations in the feature contributions among participants. This indicates that, for more accurate predictions of oxygen saturation, it may be necessary to individually select appropriate color channels for each participant. [ABSTRACT FROM AUTHOR]

Urdu is a complex language as it is an amalgam of many South Asian and East Asian languages; hence, its character recognition is a huge and difficult task. It is a bidirectional language with its numerals written from left to right while script is written in opposite direction which induces complexities in the recognition process. This paper presents the recognition and classification of a novel Urdu numeral dataset using convolutional neural network (CNN) and its variants. We propose custom CNN model to extract features which are used by Softmax activation function and support vector machine (SVM) classifier. We compare it with GoogLeNet and the residual network (ResNet) in terms of performance. Our proposed CNN gives an accuracy of 98.41% with the Softmax classifier and 99.0% with the SVM classifier. For GoogLeNet, we achieve an accuracy of 95.61% and 96.4% on ResNet. Moreover, we develop datasets for handwritten Urdu numbers and numbers of Pakistani currency to incorporate real-life problems. Our models achieve best accuracies as compared to previous models in the literature for optical character recognition (OCR). [ABSTRACT FROM AUTHOR]

Image classification is one of the major data mining tasks in smart city applications. However, deploying classification models that have good generalization accuracy is highly crucial for reliable decision-making in such applications. One of the ways to achieve good generalization accuracy is through the use of multiple classifiers and the fusion of their decisions. This approach is known as "decision fusion". The requirement for achieving good results with decision fusion is that there should be dissimilarity between the outputs of the classifiers. This paper proposes and evaluates two ways of attaining the aforementioned dissimilarity. One is using dissimilar classifiers with different architectures, and the other is using similar classifiers with similar architectures but trained with different batch sizes. The paper also compares a number of decision fusion strategies. [ABSTRACT FROM AUTHOR]

The Internet of Things (IoT) system has been a hot topic in recent years. Its operation is a system that stores data in data storage and is completed by the exchange of network information about things. Therefore, the security of information between network transmissions is very important. In recent years, the most likely cause of information security problems has been a distributed denial of service (DDoS) attack. In this paper, we proposed an autonomous defense system that combines edge computing with a two-dimensional convolutional neural network (CNN) to recognize whether the data server in IoT suffers from DDoS attacks and identify the attack mode. The accuracy of trained two-dimensional CNN is up to 99.5% and 99.8% for packet traffic and packet features training, respectively. A field experiment's results show that the data server in the proposed system can effectively distinguish the difference between the DDoS attacks and the normal transmission to reduce the impact of DDoS attacks on the IoT data storage while it is under attack. [ABSTRACT FROM AUTHOR]

Deformation can effectively reflect the structural state of concrete dams and, thus, establishing na accurate concrete dam deformation prediction model is important for dam health monitoring and early warning strategies. To address the problem that the spatial coordinates introduced in the traditional multi-point deformation prediction model of dams not being able to accurately and efficiently reflect the spatial correlation of multiple-measuring points, a 2D-1D-CNN model is proposed which expresses the spatial correlation between each measuring point through spatial feature vectors, replacing the spatial coordinates in the traditional multi-point model. First, the spatial feature vector is extracted from the historical spatio-temporal panel series of deformation values of measuring points via a Two-Dimensional Convolutional Neural Network (2D-CNN); second, the vector is combined with the environmental impact factor of dam deformation to form the final input factor of fused spatial features; and, thirdly, this vector is combined with the environmental impact factors of dam deformation to form the final input factor of fused spatial features, and the non-linear linkage between the factors and the measured displacement values is constructed by the efficient feature processing capability of a One-Dimensional Convolutional Neural Network (1D-CNN) to obtain the prediction results. Finally, the actual monitoring data of a concrete dam in China are used as an example to verify the validity of the model. The results show that the proposed model outperforms the other models in most cases, respectively, which verifies the effectiveness of the proposed model in this paper. [ABSTRACT FROM AUTHOR]

This paper proposes a method for detecting and recognizing partial discharges in high-voltage (HV) equipment. The aim is to address issues commonly found in traditional systems, including complex operations, high computational demands, significant power consumption, and elevated costs. Various types of discharges were investigated in an HV laboratory environment. Discharge data were collected using a high-frequency current sensor and a microcontroller. Subsequently, this data underwent processing and transformation into feature sets using the phase-resolved partial discharge analysis technique. These features were then converted into grayscale map samples in PNG format. To achieve partial discharge classification, a convolutional neural network (CNN) was trained on these samples. After successful training, the network model was adapted for deployment on a microcontroller, facilitated by the STM32Cube.AI ecosystem, enabling real-time partial discharge recognition. The study also examined storage requirements across different CNN layers and their impact on recognition efficacy. To assess the algorithm's robustness, recognition accuracy was tested under varying discharge voltages, insulation media thicknesses, and noise levels. The test results demonstrated that the algorithm could be effectively implemented on a microcontroller, achieving a recognition accuracy exceeding 98%. [ABSTRACT FROM AUTHOR]

Integrating lexical information into Chinese character embedding is a valid method to figure out the Chinese named entity recognition (NER) issue. However, most existing methods focus only on the discovery of named entity boundaries, considering only the words matched by the Chinese characters. They ignore the association between Chinese characters and their left and right matching words. They ignore the local semantic information of the character's neighborhood, which is crucial for Chinese NER. The Chinese language incorporates a significant number of polysemous words, meaning that a single word can possess multiple meanings. Consequently, in the absence of sufficient contextual information, individuals may encounter difficulties in comprehending the intended meaning of a text, leading to the emergence of ambiguity. We consider how to handle the issue of entity ambiguity because of polysemous words in Chinese texts in different contexts more simply and effectively. We propose in this paper the use of graph attention networks to construct relatives among matching words and neighboring characters as well as matching words and adding left- and right-matching words directly using semantic information provided by the local lexicon. Moreover, this paper proposes a short-sequence convolutional neural network (SSCNN). It utilizes the generated shorter subsequence encoded with the sliding window module to enhance the perception of local information about the character. Compared with the widely used Chinese NER models, our approach achieves 1.18%, 0.29%, 0.18%, and 1.1% improvement on the four benchmark datasets Weibo, Resume, OntoNotes, and E-commerce, respectively, and proves the effectiveness of the model. [ABSTRACT FROM AUTHOR]

The use of deep learning techniques in real-time monitoring can save a lot of manpower in various scenarios. For example, mask-wearing is an effective measure to prevent COVID-19 and other respiratory diseases, especially for vulnerable populations such as children, the elderly, and people with underlying health problems. Currently, many public places such as hospitals, nursing homes, social service facilities, and schools experiencing outbreaks require mandatory mask-wearing. However, most of the terminal devices currently available have very limited GPU capability to run large neural networks. This means that we have to keep the parameter size of a neural network modest while maintaining its performance. In this paper, we propose a framework that applies deep learning techniques to real-time monitoring and uses it for the real-time monitoring of mask-wearing status. The main contributions are as follows: First, a feature fusion technique called skip layer pooling fusion (SLPF) is proposed for image classification tasks. It fully utilizes both deep and shallow features of a convolutional neural network while minimizing the growth in model parameters caused by feature fusion. On average, this technique improves the accuracy of various neural network models by 4.78% and 5.21% on CIFAR100 and Tiny-ImageNet, respectively. Second, layer attention (LA), an attention mechanism tailor-made for feature fusion, is proposed. Since different layers of convolutional neural networks make different impacts on the final prediction results, LA learns a set of weights to better enhance the contribution of important convolutional layer features. On average, it improves the accuracy of various neural network models by 2.10% and 2.63% on CIFAR100 and Tiny-ImageNet, respectively. Third, a MobileNetv2-based lightweight mask-wearing status classification model is trained, which is suitable for deployment on mobile devices and achieves an accuracy of 95.49%. Additionally, a ResNet mask-wearing status classification model is trained, which has a larger model size but achieves high accuracy of 98.14%. By applying the proposed methods to the ResNet mask-wearing status classification model, the accuracy is improved by 1.58%. Fourth, a mask-wearing status detection model is enhanced based on YOLOv5 with a spatial-frequency fusion module resulting in a mAP improvement of 2.20%. Overall, this paper presents various techniques to improve the performance of neural networks and apply them to mask-wearing status monitoring, which can help stop pandemics. [ABSTRACT FROM AUTHOR]

Short-to-medium-term electric load forecasting is crucial for grid planning, transformation, and load scheduling for power supply departments. Various complex and ever-changing factors such as weather, seasons, regional economic structures, and enterprise production cycles exert uncontrollable effects on the electric grid load. While the causal convolutional neural network can significantly enhance long-term sequence prediction, it may suffer from problems such as vanishing gradients and overfitting due to extended time series. To address this issue, this paper introduces a new power load data anomaly detection method, which leverages a convolutional neural network (CNN) to extract temporal and spatial information from the load data. The features extracted are then processed using a bidirectional long short-term memory network (BiLSTM) to capture the temporal dependencies in the data more adeptly. An enhanced random forest (RF) classifier is employed for anomaly detection in electric load data. Furthermore, the paper proposes a new model framework for electricity load forecasting that combines a dilated causal convolutional neural network with ensemble learning. This combination addresses issues such as vanishing gradients encountered in causal convolutional neural networks with long time series. Extreme gradient boosting (XGBoost), category boosting (CATBoost), and light gradient boosting machine (LightGBM) models act as the base learners for ensemble modeling to comprehend deep cross-features, and the prediction results generated by ensemble learning serve as a new feature set for secondary ensemble modeling. The dilated convolutional neural network broadens the receptive field of the convolutional kernel. All acquired feature values are concatenated and input into the dilated causal convolutional neural network for training, achieving short-to-medium-term electric load forecasting. Experimental results indicate that compared to existing models, its root mean squared error (RMSE) and mean squared error (MSE) in short-term and mid-term electricity load forecasting are reduced by 4.96% and 12.31%, respectively, underscoring the efficacy of the proposed framework. [ABSTRACT FROM AUTHOR]

In recent years, with the development of geological prospecting from shallow ore to deep and hidden ore, the difficulty of prospecting is increasing day by day, so the application of computer technology and new methods of geological and mineral exploration is paid more and more attention. The mining and prediction of geological prospecting information based on deep learning have become the frontier field of earth science. However, as a deep artificial intelligence algorithm, deep learning still has many problems to be solved in the big data mining and prediction of geological prospecting, such as the small number of training samples of geological and mineral images, the difficulty of building deep learning network models, and the universal applicability of deep learning models. In this paper, the training samples and convolutional neural network models suitable for geochemical element data mining are constructed to solve the above problems, and the model is successfully applied to the prediction research of gold, silver, lead and zinc polymetallic metallogenic areas in South China. Taking the Pangxidong research area in the west of Guangdong Province as an example, this paper carries out prospecting target prediction research based on a 1:50000 stream sediment survey original data. Firstly, the support vector machine (SVM) model and statistical method were used to determine the ore-related geochemical element assemblage. Secondly, the experimental data of geochemical elements were augmented and a dataset was established. Finally, ResNet-50 neural network model is used for data training and prediction research. The experimental results show that the areas numbered 9, 29, 38, 40, 95, 111, 114, 124, 144 have great metallogenic potential, and this method would be a promising tool for metallogenic prediction. By applying the ResNet-50 neural network in metallogenic prediction, it can provide a new idea for the future exploration of mineral resources. In order to verify the generality of the research method in this paper, we conducted experimental tests on the geochemical dataset of B area, another deposit research area in South China. The results show that 100% of the prediction area obtained by using the proposed method covers the known ore deposit area. This model also provides method support for further delineating the prospecting target area in study area B. [ABSTRACT FROM AUTHOR]

To address the problems that most convolutional neural network-based image defogging algorithm models capture incomplete global feature information and incomplete defogging, this paper proposes an end-to-end convolutional neural network and vision transformer hybrid image defogging algorithm. First, the shallow features of the haze image were extracted by a preprocessing module. Then, a symmetric network structure including a convolutional neural network (CNN) branch and a vision transformer branch was used to capture the local features and global features of the haze image, respectively. The mixed features were fused using convolutional layers to cover the global representation while retaining the local features. Finally, the features obtained by the encoder and decoder were fused to obtain richer feature information. The experimental results show that the proposed defogging algorithm achieved better defogging results in both the uniform and non-uniform haze datasets, solves the problems of dark and distorted colors after image defogging, and the recovered images are more natural for detail processing. [ABSTRACT FROM AUTHOR]

Diabetes is caused by insulin deficiency or impaired biological action, and long-term hyperglycemia leads to a variety of tissue damage and dysfunction. Therefore, the early prediction of diabetes and timely intervention and treatment are crucial. This paper proposes a robust framework for the prediction and diagnosis of type 2 diabetes (T2DM) to aid in diabetes applications in clinical diagnosis. The data-preprocessing stage includes steps such as outlier removal, missing value filling, data standardization, and assigning class weights to ensure the quality and consistency of the data, thereby improving the performance and stability of the model. This experiment used the National Health and Nutrition Examination Survey (NHANES) dataset and the publicly available PIMA Indian dataset (PID). For T2DM classification, we designed a convolutional neural network (CNN) and proposed a novel attention-oriented convolutional neural network (SECNN) through the channel attention mechanism. To optimize the hyperparameters of the model, we used grid search and K-fold cross-validation methods. In addition, we also comparatively analyzed various machine learning (ML) models such as support vector machine (SVM), logistic regression (LR), decision tree (DT), random forest (RF), and artificial neural network (ANN). Finally, we evaluated the performance of the model using performance evaluation metrics such as precision, recall, F1-Score, accuracy, and AUC. Experimental results show that the SECNN model has an accuracy of 94.12% on the NHANES dataset and an accuracy of 89.47% on the PIMA Indian dataset. SECNN models and CNN models show significant improvements in diabetes prediction performance compared to traditional ML models. The comparative analysis of the SECNN model and the CNN model has significantly improved performance, further verifying the advantages of introducing the channel attention mechanism. The robust diabetes prediction framework proposed in this article establishes an effective foundation for diabetes diagnosis and prediction, and has a positive impact on the development of health management and medical industries. [ABSTRACT FROM AUTHOR]

In this paper, we introduce Wide-TSNet, a novel hybrid approach for predicting Bitcoin prices using time-series data transformed into images. The method involves converting time-series data into Markov transition fields (MTFs), enhancing them using histogram equalization, and classifying them using Wide ResNets, a type of convolutional neural network (CNN). We propose a tripartite classification system to accurately represent Bitcoin price trends. In addition, we demonstrate the effectiveness of Wide-TSNet through various experiments, in which it achieves an Accuracy of approximately 94% and an F1 score of 90%. It is also shown that lightweight CNN models, such as SqueezeNet and EfficientNet, can be as effective as complex models under certain conditions. Furthermore, we investigate the efficacy of other image transformation methods, such as Gramian angular fields, in capturing the trends and volatility of Bitcoin prices and revealing patterns that are not visible in the raw data. Moreover, we assess the effect of image resolution on model performance, emphasizing the importance of this factor in image-based time-series classification. Our findings explore the intersection between finance, image processing, and deep learning, providing a robust methodology for financial time-series classification. [ABSTRACT FROM AUTHOR]

The task of fashion parsing aims to assign pixel-level labels to clothing targets; thereby, parsing models are required to have good contextual recognition ability. However, the shapes of clothing components are complex, and the types are difficult to distinguish. Recent solutions focus on improving datasets and supplying abundant priori information, but the utilization of features by more efficient methods is rarely explored. In this paper, we propose a multi-scale fashion parsing model called the Priori Dictionary Network (PDN), which includes a priori attention module and a multi-scale backbone. The priori attention module extracts high dimensional features from our designed clothing average template as a priori information dictionary (priori dictionary, PD), and the PD is utilized to activate the feature maps of a CNN from a multi-scale attention mechanism. The backbone is derived from classical models, and five side paths are designed to leverage the richer features of local and global contextual representations. To measure the performance of our method, we evaluated the model on four public datasets, the CFPD, UTFR-SBD3, ModaNet and LIP, and the experimental results show that our model stands out from other State of the Art in all four datasets. This method can assist with the labeling problem of clothing datasets. [ABSTRACT FROM AUTHOR]

Convolutional neural networks (CNNs) serve as powerful tools in computer vision tasks with extensive applications in daily life. However, they are susceptible to adversarial attacks. Still, attacks can be positive for at least two reasons. Firstly, revealing CNNs vulnerabilities prompts efforts to enhance their robustness. Secondly, adversarial images can also be employed to preserve privacy-sensitive information from CNN-based threat models aiming to extract such data from images. For such applications, the construction of high-resolution adversarial images is mandatory in practice. This paper firstly quantifies the speed, adversity, and visual quality challenges involved in the effective construction of high-resolution adversarial images, secondly provides the operational design of a new strategy, called here the noise blowing-up strategy, working for any attack, any scenario, any CNN, any clean image, thirdly validates the strategy via an extensive series of experiments. We performed experiments with 100 high-resolution clean images, exposing them to seven different attacks against 10 CNNs. Our method achieved an overall average success rate of 75% in the targeted scenario and 64% in the untargeted scenario. We revisited the failed cases: a slight modification of our method led to success rates larger than 98.9%. As of today, the noise blowing-up strategy is the first generic approach that successfully solves all three speed, adversity, and visual quality challenges, and therefore effectively constructs high-resolution adversarial images with high-quality requirements. [ABSTRACT FROM AUTHOR]

In the context of automatic charging for electric vehicles, collision localization for the end-effector of robots not only serves as a crucial visual complement but also provides essential foundations for subsequent response design. In this scenario, data-driven collision localization methods are considered an ideal choice. However, due to the typically high demands on the data scale associated with such methods, they may significantly increase the construction cost of models. To mitigate this issue to some extent, in this paper, we propose a novel approach for robot collision localization based on a sparse modular point matrix (SMPM) in the context of automatic charging for electric vehicles. This method, building upon the use of collision point matrix templates, strategically introduces sparsity to the sub-regions of the templates, aiming to reduce the scale of data collection. Additionally, we delve into the exploration of data-driven models adapted to SMPMs. We design a feature extractor that combines a convolutional neural network (CNN) with an echo state network (ESN) to perform adaptive feature extraction on collision vibration signals. Simultaneously, by incorporating a support vector machine (SVM) as a classifier, the model is capable of accurately estimating the specific region in which the collision occurs. The experimental results demonstrate that the proposed collision localization method maintains a collision localization accuracy of 91.27% and a collision localization RMSE of 1.46 mm, despite a 48.15% reduction in data scale. [ABSTRACT FROM AUTHOR]

A considerable amount of research on link prediction has recently been driven by missing relationships between knowledge graph entities and the problem of the incompleteness of knowledge graphs. Some recent studies have shown that convolutional neural networks based on knowledge embeddings are highly expressive and have good performance in link prediction. However, we found that the convolutional neural network (CNN)-based models do not handle the link between relations and entities well. For this reason, this paper proposes a link prediction model (LPM) based on feature mapping and bi-directional convolution. For the modeling of the task, an encoding layer–mapping layer–decoding layer structure is used. Among these layers, the encoding layer adopts a graph attention network to encode multi-hop triad information and obtains richer encoding of entities and relationships. The mapping layer can realize the mapping transformation between entities and relations and project the entity encoding in the space of relation encoding to capture the subtle connection between entities and relations. The decoding layer adopts bidirectional convolution to merge and decode the triples in a sequential inverse order, which makes the decoding layer model more advantageous in prediction. In addition, the decoding layer also adopts the r-drop training method to effectively reduce the distribution error generated by training between models and enhance the robustness of the model. Our experiments demonstrated the effectiveness of mapping relations, bidirectional convolution, and r-drop, and the accuracy of the proposed model showed significant improvements for each evaluation metric on two datasets, WN18RR and FB15k-237. [ABSTRACT FROM AUTHOR]

Featured Application: Environmental perception for unmanned surface vessel (USV). Image deraining ensures the visual quality of images to prompt ship detection for visual perception systems of unmanned surface vessels. However, due to the insufficiency of captured rain streaks features and global information, current image deraining methods often face the issues of rain streaks remaining and image blurring. Consider that the visual perception system captures the same useful information during rainy and hazy days, and only the way in which the image degrades is different. In addition, rainy days are usually accompanied by hazy days at the same time. In this paper, a two-stage and two-channel attention single image deraining network is proposed. Firstly, the subpixel convolution up-sampling module is introduced to increase the range of captured features and improve the image clarity. Secondly, the attention mechanism is integrated with the pyramid multi-scale pooling layer, so that the network can accumulate context information in a local to global way to avoid the loss of global information. In addition, a new composite loss function is designed, in which a regular term loss is introduced to maintain the smoothness and a perceptual loss function is employed to overcome the problem of large differences in the output of the loss function due to outliers. Extensive experimental results on both synthetic and real-world datasets demonstrate the superiority of our model in both quantitative assessments and visual quality by comparing with other state-of-the-art methods. Furthermore, the proposed deraining network is incorporated into the visual perception system and the detection accuracy of ships on rainy seas can be effectively improved. [ABSTRACT FROM AUTHOR]

In 2020, according to the publications of both the Global Cancer Observatory (GCO) and the World Health Organization (WHO), breast cancer (BC) represents one of the highest prevalent cancers in women worldwide. Almost 47% of the world's 100,000 people are diagnosed with breast cancer, among females. Moreover, BC prevails among 38.8% of Egyptian women having cancer. Current deep learning developments have shown the common usage of deep convolutional neural networks (CNNs) for analyzing medical images. Unlike the randomly initialized ones, pre-trained natural image database (ImageNet)-based CNN models may become successfully fine-tuned to obtain improved findings. To conduct the automatic detection of BC by the CBIS-DDSM dataset, a CNN model, namely CoroNet, is proposed. It relies on the Xception architecture, which has been pre-trained on the ImageNet dataset and has been fully trained on whole-image BC according to mammograms. The convolutional design method is used in this paper, since it performs better than the other methods. On the prepared dataset, CoroNet was trained and tested. Experiments show that in a four-class classification, it may attain an overall accuracy of 94.92% (benign mass vs. malignant mass) and (benign calcification vs. malignant calcification). CoroNet has a classification accuracy of 88.67% for the two-class cases (calcifications and masses). The paper concluded that there are promising outcomes that could be improved because more training data are available. [ABSTRACT FROM AUTHOR]

Although the numerical models can estimate the significant influence of local site conditions on the seismic propagation characteristics near the surface in many studies, they cannot feasibly predict the seismic ground motion amplification in regular engineering practice or earthquake hazard assessment due to the high computational cost and their complex implementation. In this paper, the scattering problem of trapezoidal sedimentary basins, one of the representatives of local complex sites with a relatively small model size, and simplified by practice in this type of study, was selected as the basin model. A series of standard basin models were built to quantify the relationship between the site condition parameters and the site amplification parameters (the peak ground acceleration and the hazard location). In addition, the factors that influence seismic ground motion amplification, such as the basin shape ratio, the soil depth, the basin edge dip angle, the ratio of shear wave velocity between the bedrock and the soil layer, the damping coefficient, and the fundamental frequency, were selected to investigate the sensitivity. A convolutional neural network (CNN) algorithm based on deep learning replacing traditional recursive algorithms was explored to establish a prediction model of basin amplification characteristics. By the Bayesian optimization method, the structural parameters of the CNN predicting model were selected to improve the accuracy of the prediction model. The results show that the optimized CNN models could predict the amplification characteristics of the basin better than the un-optimized CNN models. Three prediction models were established with the site condition parameters as the input parameters and their output parameters were the maximum amplification value of the peak ground acceleration (PGA), the hazard location, and their combination for each basin. To analyze the CNN's prediction ability, each CNN model used about 80% of the data from the seismic model repose results for training and the remaining data (20%) for testing. By comparing the CNN prediction results with the FE simulation results, the accuracy and rationality of each prediction model were studied. The results show that, compared to a single numerical model, the CNN prediction results of the site amplification features could be quickly obtained by inputting the relevant parameters. Compared to recursive class models, the established CNN prediction model can directly establish the relationships among multiple input and multiple output parameters. A comparison of the three kinds of CNN models shows that the prediction accuracy of the joint parameter model was slightly lower than that of the two single-output models. [ABSTRACT FROM AUTHOR]

The accuracy of solar energy forecasting is critical for power system planning, management, and operation in the global electric energy grid. Therefore, it is crucial to ensure a constant and sustainable power supply to consumers. However, existing statistical and machine learning algorithms are not reliable for forecasting due to the sporadic nature of solar energy data. Several factors influence the performance of solar irradiance, such as forecasting horizon, weather classification, and performance evaluation metrics. Therefore, we provide a review paper on deep learning-based solar irradiance forecasting models. These models include Long Short-Term Memory (LTSM), Gated Recurrent Unit (GRU), Recurrent Neural Network (RNN), Convolutional Neural Network (CNN), Generative Adversarial Networks (GAN), Attention Mechanism (AM), and other existing hybrid models. Based on our analysis, deep learning models perform better than conventional models in solar forecasting applications, especially in combination with some techniques that enhance the extraction of features. Furthermore, the use of data augmentation techniques to improve deep learning performance is useful, especially for deep networks. Thus, this paper is expected to provide a baseline analysis for future researchers to select the most appropriate approaches for photovoltaic power forecasting, wind power forecasting, and electricity consumption forecasting in the medium term and long term. [ABSTRACT FROM AUTHOR]

Image recognition of plant growth states provides technical support for crop monitoring; this reduces labor costs and promotes efficient planting. However, difficulties in data collection, the required high levels of algorithm efficiency, and the lack of computing power resources create challenges to the development of intelligent agriculture. As a result, a deep transfer learning algorithm is proposed in this paper. The main motivation for this study was the lack of a dataset of plant growth stages. The key idea was to collect radish growth stage images in an experimental field using standardized equipment and to generate more images using DCGAN. By improving the deep transfer learning model, radish growth stages can be identified much more accurately. In this study, five different deep migration models were selected, namely, Inception-v3, MobileNet, Xception, VGG-16, and VGG-19. Our experiment demonstrated that Inception-v3 was the most suitable model for the recognition of plant growth states. Based on Inception-v3, we propose three improved models. The test accuracies for the radish and Oxford Flower datasets were 99.5% and 99.3%, respectively. Additionally, the accuracy of the pest and disease dataset also achieved excellent performance, with an accuracy of 94.7%, 2.4% higher than previously. These results demonstrate the wide applicability of our model and the rationality of constructing a radish growth stage dataset. [ABSTRACT FROM AUTHOR]

As a key component of motion support, the rolling bearing is currently a popular research topic for accurate diagnosis of bearing faults and prediction of remaining bearing life. However, most existing methods still have difficulties in learning representative features from the raw data. In this paper, the Xi'an Jiaotong University (XJTU-SY) rolling bearing dataset is taken as the research object, and a deep learning technique is applied to carry out the bearing fault diagnosis research. The root mean square (RMS), kurtosis, and sum of frequency energy per unit acquisition period of the short-time Fourier transform are used as health factor indicators to divide the whole life cycle of bearings into two phases: the health phase and the fault phase. This division not only expands the bearing dataset but also improves the fault diagnosis efficiency. The Deep Convolutional Neural Networks with Wide First-layer Kernels (WDCNN) network model is improved by introducing multi-scale large convolutional kernels and Gate Recurrent Unit (GRU) networks. The bearing signals with classified health states are trained and tested, and the training and testing process is visualized, then finally the experimental validation is performed for four failure locations in the dataset. The experimental results show that the proposed network model has excellent fault diagnosis and noise immunity, and can achieve the diagnosis of bearing faults under complex working conditions, with greater diagnostic accuracy and efficiency. [ABSTRACT FROM AUTHOR]

This paper proposes a slope stability prediction model based on deep learning and digital twinning methods. To establish a reliable slope database, 30 actual slopes were collected, and 100 digital twin (DT) models were generated for each actual slope by fine-tuning the slope profiles. The safety factors of all slope samples were calculated using the Limit Equilibrium Methods (LEMs). A convolutional neural network (CNN) regression model was established, and the root mean square error (RMSE) was used as the evaluation indicator. In order to find an excellent CNN model, the K-fold (K = 10) cross-validation was used to compare the predictive effect of 1D CNN and 2D CNN on the slope safety factor. On this basis, CNN models with different network depths were compared. The results showed that the 2D CNN model with six convolutional layers had the best network prediction effect for the slope dataset. To validate the generalization ability of the model, an actual slope was input into the CNN model; its prediction result was 1.0229, and the absolute error with its real safety factor (1.0197) was 0.0032. With the slope stability prediction model proposed in this paper, the safety factor of slopes can be obtained from their geological and physical data, which greatly simplifies the calculation of the safety factor and has great engineering significance. [ABSTRACT FROM AUTHOR]