Search

Document forgery is a significant issue in Korea, with around ten thousand cases reported every year. Analyzing paper plays a crucial role in examining questionable documents such as marketable securities and contracts, which can aid in solving criminal cases of document forgery. Paper analysis can also provide essential insights in other types of criminal cases, serving as an important clue for solving cases such as the source of a blackmail letter. The papermaking process generates distinct forming fabric marks and formations, which are critical features for paper classification. These characteristics are observable under transmitted light and are created by the forming fabric pattern and the distribution of pulp fibers, respectively. In this study, we propose a novel approach for paper identification based on hybrid features. This method combines texture features extracted from images converted using the gray‐level co‐occurrence matrix (GLCM) approach and a convolutional neural network (CNN), with another set of features extracted by the CNN using the same images as input. We applied the proposed method to classification tasks for seven major paper brands available in the Korean market, achieving an accuracy of 97.66%. The results confirm the applicability of this method for visually inspecting paper products and demonstrate its potential for assisting in solving criminal cases involving document forgery. [ABSTRACT FROM AUTHOR]

Detecting insulation performance through testing the Raman spectroscopy of transformer oil is noninvasive and shows great promise in on-site diagnosis. The information, stored in spectra, that may reflect aging states of insulation aims to be effectively unfolded and provides decision support as well. In this article, a transformation method based on intrinsic product arithmetic is used to transform the 1-D Raman spectral data into 2-D image data. With the help of CNN based on the dimensionality expanding method, diagnosis of oil–paper insulation with different aging states based on the Raman spectroscopy was realized. The network-based oil–paper insulation aging diagnosis model has an accuracy of 95% in ten aging categories of 60 test samples and 100% in four aging categories. The result shows the trained CNN was able to identify the differences of transformer oil samples at each aging stage through visualized Raman spectral image. This method provides a more accurate determination method for diagnosing oil-immersed transformers’ aging conditions; it also develops an available method for a more detailed evaluation of insulation aging levels. [ABSTRACT FROM AUTHOR]

Offshore wind-hydrogen systems operate in harsh marine environments for extended periods, posing risks of low accessibility and high failure rates. This paper proposes a data-driven fault detection framework for offshore wind-hydrogen systems, aiming to promptly detect potential faults based on the system's physical parameters. The research establishes a comprehensive model based on the operating principles of offshore wind-hydrogen systems. The study uses fault injection techniques to simulate common partial faults in offshore wind-hydrogen systems and collects relevant physical parameters (such as wind turbine power generation, energy storage battery charging/discharging current, and electrolyzer hydrogen production rate). A fault detection model was constructed using a combination of Convolutional Neural Networks (CNN) and Bidirectional Long Short-Term Memory (BiLSTM) to enable precise detection of potential faults in the system. The established model provides theoretical support for designing, optimizing, and operating offshore wind-hydrogen systems, reducing reliance on actual experiments and lowering project risks and costs. Introducing artificial faults can evaluate the system's performance in different fault scenarios. This paper proposes a CNN-BiLSTM fault detection method that achieves automatic feature extraction and high-precision classification of time-series fault data, confirming the practicality and feasibility of offshore wind-hydrogen systems. This investigation realizes the integration of the offshore wind-hydrogen system model and deep learning, as well as a fully automated learning process from data to fault detection. By calculating and comparing results, it is verified that the framework has a high accuracy of 96.9%. This innovative research offers new methods and perspectives for enhancing the reliability and efficiency of fault detection in offshore wind-hydrogen systems. • A comprehensive multi-system simulation model for offshore wind-hydrogen systems is established. • Fault injection is employed to acquire data samples for offshore wind-hydrogen systems. • Utilizing the CNN-BiLSTM method, a high-accuracy deep learning fault detection model is crafted. • A simulation model-based data-driven deep learning framework for fault detection is devised in this study. [ABSTRACT FROM AUTHOR]

With the aim of solving the problem of identifying complex underwater acoustic targets using a single signal feature in the Time–Frequency (TF) feature, this paper designs a method that recognizes the underwater targets based on the Delay-Doppler joint feature. First, this method uses symplectic finite Fourier transform (SFFT) to extract the Delay-Doppler features of underwater acoustic signals, analyzes the Time–Frequency features at the same time, and combines the Delay-Doppler (DD) feature and Time–Frequency feature to form a joint feature (TF-DD). This paper uses three types of convolutional neural networks to verify that TF-DD can effectively improve the accuracy of target recognition. Secondly, this paper designs an object recognition model (TF-DD-CNN) based on joint features as input, which simplifies the neural network's overall structure and improves the model's training efficiency. This research employs ship-radiated noise to validate the efficacy of TF-DD-CNN for target identification. The results demonstrate that the combined characteristic and the TF-DD-CNN model introduced in this study can proficiently detect ships, and the model notably enhances the precision of detection. [ABSTRACT FROM AUTHOR]

Recently, with the emergence of many image editing tools (photoshop, Topaz studio, etc.), the authenticity of images has been severely challenged. However, the performance of some existing traditional feature extraction methods and detection methods based on convolutional neural network (CNN) is poor, and the information provided by the features extracted from the network is limited and single. In this paper, an end-to-end ringed residual U-Net is proposed to detect image splicing forgery by blending features of non-natural regions. Some regions with significant differences from the image background are defined as non-natural regions(such as the irregular border at the splicing of images). In this paper, a feature enhancement module for non-natural regions is constructed, which the image through the pooling of four different scales, and these features are then combined with the original image and input to the backbone network for processing, aiming to highlight regions of the image that differ significantly from the background. Therefore, after adding the feature enhancement module for non-natural regions to the end-to-end ring residual U-Net, more attention will be paid to the tampering regions in the feature extraction stage, image manipulation detection and localization will also become more accurate. Compared with some mainstream methods, this method achieves better performance on the three standard datasets(CASIA2.0, NIST2016, COLUMBIA). In addition, it has excellent robustness under JPEG compression attack and noise corruption attack. [ABSTRACT FROM AUTHOR]

In recent years, with the rapid development of deep learning technology, a large number of excellent convolutional neural networks (CNNs) have been proposed, many of which are based on improvements to classical methods. Based on the Inception family of methods, depthwise separable convolution was applied to Xception to achieve lightweighting, and Inception-ResNet introduces residual connections to accelerate model convergence. However, existing improvements for the Inception module often neglect further enhancement of its receptive field, while increasing the receptive field of CNNs has been widely studied and proven to be effective in improving classification performance. Motivated by this fact, three effective expansion modules are proposed in this paper. The first expansion module, Inception expand (Inception-e) module, is proposed to improve the classification accuracy by concatenating more and deeper convolutional branches. To reduce the number of parameters for Inception e, this paper proposes a second expansion module—Equivalent Inception-e (Eception) module, which is equivalent to Inception-e in terms of feature extraction capability, but which suppresses the growth of the parameter quantity brought by the expansion by effectively reducing the redundant convolutional layers; on the basis of Eception, this paper proposes a third expansion module—Lightweight Eception (Lception) module, which crosses depthwise convolution with ordinary convolution to further effectively reduce the number of parameters. The three proposed modules have been validated on the Cifar10 dataset. The experimental results show that all these extensions are effective in improving the classification accuracy of the models, and the most significant effect is the Lception module, where Lception (rank = 4) on the Cifar10 dataset improves the accuracy by 1.5% compared to the baseline model (Inception module A) by using only 0.15 M more parameters. [ABSTRACT FROM AUTHOR]

This paper focuses on deep vision sensing-assisted gesture recognition for athletes in dynamic scenes. Although many research attention had been devoted to this field in recent years, most of existing works failed to fully take characteristics of dynamic scenes into consideration. To deal with this challenge, this paper proposes a diffusion convolution neural network-based multiview gesture recognition approach in dynamic scenes. For one thing, the dynamic spatiotemporal slice position selection based on the body mask heatmap is adopted to calculate positions of horizontal and vertical slices. Thus, the dynamic selection of slice positions in two directions can be realized, and then the extraction of bi-directional spatiotemporal slice images can be completed. For another, action sequences through the 3D residual neural network are learned, and the spatiotemporal information among frames are mined through recurrent networks. Through their combination, a multi-view gesture recognition approach for athletes is constructed. In the experiments, two standard datasets UCF101 and HMDB51 are utilized to establish simulation environment. The proposed method can reach the accuracy beyond 95% on the two datasets. Compared with several typical recognition methods, the proposed method shows higher accuracy. [ABSTRACT FROM AUTHOR]

For insulated gate bipolar transistor (IGBT) modules using wire bonding as the interconnection method, the main failure mechanism is cracking of the bonded interface. Studying the mechanical properties of the bonded interface is crucial for assessing the reliability of IGBT modules. In this paper, first, shear tests are conducted on the bonded interface to test the bonded interface's strength. Then, finite element–cohesive zone modeling (FE-CZM) is established to describe the mechanical behavior of the bonded interface. A novel machine learning (ML) architecture integrating a convolutional neural network (CNN) and a long short-term memory (LSTM) network is used to identify the shape and parameters of the traction separation law (TSL) of the FE-CZM model accurately and efficiently. The CNN-LSTM architecture not only has excellent feature extraction and sequence-data-processing abilities but can also effectively address the long-term dependency problem. A total of 1800 sets of datasets are obtained based on numerical computations, and the CNN-LSTM architecture is trained with load–displacement (F–δ) curves as input parameters and TSL shapes and parameters as output parameters. The results show that the error rate of the model for TSL shape prediction is only 0.186%. The performance metric's mean absolute percentage error (MAPE) is less than 3.5044% for all the predictions of the TSL parameters. Compared with separate CNN and LSTM architectures, the proposed CNN-LSTM-architecture approach exhibits obvious advantages in recognizing TSL shapes and parameters. A combination of the FE-CZM and ML methods in this paper provides a promising and effective solution for identifying the mechanical parameters of the bonded interfaces of IGBT modules. [ABSTRACT FROM AUTHOR]

Accurate power load prediction is an important guide for power system planning and operation. High‐ or low‐load prediction results will affect the operation of the power system. In recent years, deep learning technology represented by convolution neural network (CNN) and transformer has been proved to be suitable for power load prediction. This paper proposes a new short‐term power load hybrid forecasting model, called channel enhanced attention (CEA) and temporal convolutional network (TCN)‐based transformer comprehensive forecasting model. This method combines the short‐term feature extraction ability of TCN with the long‐term dependent capture ability of transformer for short‐term load forecasting. And the CEA designed in this study is added to improve the prediction accuracy. On the same dataset, the designed model predicts power load mean square errors of 0.056 and 0.146 for the next 24 h and the next week, respectively, which is 0.002 to 0.073 and 0.012 to 0.024 lower than the baseline model. The experimental results show that the hybrid short‐term power load prediction model proposed in this paper is significantly better than the existing methods. The predicted curve is in agreement with the actual charge change, which provides a good guidance for short‐term power load prediction. [ABSTRACT FROM AUTHOR]

Microscopic image analysis technology helps solve the inadvertences of artificial traditional methods in disease, wastewater treatment, and environmental change monitoring analysis. Convolutional neural network (CNN) play an important role in microscopic image analysis. Image segmentation, in which U-Net is increasingly applied in microscopic image segmentation, is a crucial step in detection, tracking, monitoring, feature extraction, modelling, and analysis. This paper comprehensively reviews the development history of U-Net, analyses several research results of various segmentation methods since the emergence of U-Net, and conducts a comprehensive review of related papers. This paper summarised the improved methods of U-Net and then listed the existing significance of image segmentation techniques and their improvements introduced over the years. Finally, focusing on the different improvement strategies of U-Net in different papers, the related work of each application target is reviewed according to detailed technical categories to facilitate future research. Researchers can see the dynamics of the transmission of technological development and keep up with future trends in this interdisciplinary field. [ABSTRACT FROM AUTHOR]

Cancelable biometrics serves as an effective countermeasure against various template attacks launched by intruders, safeguarding the biometric system. This paper proposes a cancelable approach with a novel feature extraction technique for iris recognition, known as the hybrid architecture of the convolutional neural network (CNN) and GRU (gated recurrent unit). To provide cancelability to the system, the paper makes use of a random projection technique. The proposed method has the best outcome in terms of accurate identification. The method is validated on two Iris datasets IITD and MMU, which show promising results on the equal error rate (EER) and accuracy. The proposed model provides 0.02 and 0.045 EER for IITD and MMU, respectively, and accuracy 0.98 and 0.933%, for IITD and MMU Iris dataset, respectively, which is very high compared to other methodologies. The proposed hybrid architecture is being used for a cancelable biometric system for the first time based on literature review. The efficiency of the proposed method is high when validated on the datasets. [ABSTRACT FROM AUTHOR]

At present, in end-to-end network combined with deep learning in stereo matching, how to perceive ample image details within an acceptable range of computational cost, so as to improve the final matching accuracy, has become a hot research topic. In this paper, we design a cascaded disparity correction network based on DispNet, which can refine the initial disparity image by combining the process output results in the trunk network. The method proposed in this paper is named ETE–DC–CNN (end to end–disparity correction–convolutional neural network). In the trunk network, the mixed dilated convolution module is employed to extract the features of the original image, and the feature image is constructed into a 3D disparity space volume through depth-separable convolution, after which the initial disparity image can be obtained through 2D encoder–decoder module. In the correction network, the gradient information of the initial feature image is combined to reconstruct the modified matching cost body guided by the initial disparity image and then a smaller encoder–decoder module is trained and processed to make the final result at the sub-pixel level. The algorithm in this paper has been verified in SceneFlow and KITTI 2012/2015 data sets. The method proposed in this article achieves 3.46, 2.12, 1.19, and 0.6 results in the non-occluded area and 4.04, 2.55, 1.58, and 0.7 results in the global area on the Er (> 2 px), Er (> 3 px), Er (> 5 px), and Epe indicators in the KITTI 2012 test set, which are higher than those of the backbone network DispNet. [ABSTRACT FROM AUTHOR]

Recent technological developments have enabled computers to identify and categorize facial expressions to determine a person's emotional state in an image or a video. This process, called "Facial Expression Recognition (FER)", has become one of the most popular research areas in computer vision. In recent times, deep FER systems have primarily concentrated on addressing two significant challenges: the problem of overfitting due to limited training data availability, and the presence of expression-unrelated variations, including illumination, head pose, image resolution, and identity bias. In this paper, a comprehensive survey is provided on deep FER, encompassing algorithms and datasets that offer insights into these intrinsic problems. Initially, this paper presents a detailed timeline showcasing the evolution of methods and datasets in deep facial expression recognition (FER). This timeline illustrates the progression and development of the techniques and data resources used in FER. Then, a comprehensive review of FER methods is introduced, including the basic principles of FER (components such as preprocessing, feature extraction and classification, and methods, etc.) from the pro-deep learning era (traditional methods using handcrafted features, i.e., SVM and HOG, etc.) to the deep learning era. Moreover, a brief introduction is provided related to the benchmark datasets (there are two categories: controlled environments (lab) and uncontrolled environments (in the wild)) used to evaluate different FER methods and a comparison of different FER models. Existing deep neural networks and related training strategies designed for FER, based on static images and dynamic image sequences, are discussed. The remaining challenges and corresponding opportunities in FER and the future directions for designing robust deep FER systems are also pinpointed. [ABSTRACT FROM AUTHOR]

Power transformers play a critical role in the performance of power systems. This equipment is costly due to significant copper and iron prices and manufacturing costs. Therefore, maintenance and protection of such equipment is essential. Despite its robust performance, maloperation of differential protection (DP) in transformers may cause operational challenges to power system operators. The differential relay may operate incorrectly after the transformer energization leads to an inrush current (IC) and the relay identifies the event as an internal fault, and consequently issues the trip command. The other case of maloperation includes, but not limited to, a moment when the current transformer saturates due to an external fault. In this paper, a novel approach for DP is proposed, that is based on signal processing methods. In this paper, variational mode decomposition (VMD) and the deep neural network are implemented by using the convolutional neural network (CNN) and bi‐directional long short‐term memory (BiLSTM) models. The VMD decomposes differential current signal (DCS) to intrinsic mode functions with corresponding narrow‐band property frequency spectrums, which provides more detailed information about signal characteristics in different frequency bands. At the next stage, an effective feature for the BiLSTM is extracted by the CNN with the convolutional layers to classify events and proper discrimination. Extensive simulations on a 500 MVA transformer in MATLAB demonstrate the effectiveness of the proposed protection approach to differentiate ICs from internal and external faults with 99.8% accuracy in less than 1/8th of a power cycle. [ABSTRACT FROM AUTHOR]

The purpose of this paper is to help people with auditory and speech disabilities to communicate with others and for controlling computers and machines. This paper proposes two different methods for identifying six distinctive hand gestures and sign language for divergent environmental conditions. The first method is based on the hand feature extraction i.e., convexity defects. For that, initially, the hand region is detected by HSV skin color conversion process. Contour and convex hull of hand are extracted from the hand region. Finally, convexity defects are determined to identify the hand gestures. The second method is deep learning based YOLOv3 model that uses DARKNET-53 convolutional neural network (CNN) as its backbone. The model is trained on a large annotated dataset. Experimental results reveal that the deep-leaning method outperforms the hand feature approach and obtain 98.92% and 95.57% accuracy for deep learning and hand feature-based model respectively. [ABSTRACT FROM AUTHOR]

Automated and accurate detection of power quality (PQ) events is important from the point of view of safety as well as maintaining the reliability of the power transmission and distribution network. However, detection of multiple PQ events in a noisy environment is challenging task. Another important issue is the choice of meaningful features that can directly influence the accuracy of PQ detection. Considering these two aforesaid facts, this paper presents a novel framework for automated classification of PQ signals in a noisy environment employing cross Stockwell Transform (XST). The XST proposed in this paper has better noise suppression capability compared to conventional Stockwell Transform. Here, XST was used to convert 1D PQ signals to 2D time–frequency (T–F) images. To improve the accuracy of PQ detection, an automated feature extraction method employing deep learning is implemented in this work. The noise free T–F images obtained using XST were fed as inputs to several pre-trained convolutional neural networks (CNNs) for deep feature extraction. Transfer learning technique was implemented to reduce the computational cost. The extracted deep features were further undergone selection using one-way analysis of variance test followed by false discovery rate correction. The statistically significant deep features were subsequently fed to three benchmark machine learning classifiers for classification of PQ signals. In addition, tests were also carried out on real-life PQ signals to verify the practicability of the proposed framework. Investigations revealed that the proposed method returned mean accuracy of 99.72% and 96.45% for classification of simulated and real-life PQ signals, respectively. [ABSTRACT FROM AUTHOR]

Based on optical image enhancement, this paper uses convolutional neural network to detect key points of swimming posture. In swimming posture analysis, key point detection can provide information about posture accuracy and evaluation. However, due to the change of illumination conditions, the reduction of image quality and occlusion, the accuracy and stability of key point detection are limited. In order to solve this problem, an optical image enhancement method based on convolutional neural network is proposed in this paper. First, a specific convolutional neural network architecture is used to extract features from input images. Then optical image enhancement technology is used to preprocess the input image to improve the image quality. Next, the trained convolutional neural network model is used to detect key points. Experimental results show that the proposed method has good performance under different illumination conditions and image quality. Therefore, this study provides a new idea and method for the application of optical image enhancement in the detection of key points in swimming posture analysis. [ABSTRACT FROM AUTHOR]

The main purpose of this paper is to provide information on how to create a convolutional neural network (CNN) for extracting features from EEG signals. Our task was to understand the primary aspects of creating and fine-tuning CNNs for various application scenarios. We considered the characteristics of EEG signals, coupled with an exploration of various signal processing and data preparation techniques. These techniques include noise reduction, filtering, encoding, decoding, and dimension reduction, among others. In addition, we conduct an in-depth analysis of well-known CNN architectures, categorizing them into four distinct groups: standard implementation, recurrent convolutional, decoder architecture, and combined architecture. This paper further offers a comprehensive evaluation of these architectures, covering accuracy metrics, hyperparameters, and an appendix that contains a table outlining the parameters of commonly used CNN architectures for feature extraction from EEG signals. [ABSTRACT FROM AUTHOR]

Lung cancer is an uncontrolled growth of tissue causing a lump in the human lung. If lung cancer can be detected early, it can increase the survival rate. Therefore, a multi-classification approach of lung nodule detection with high computational effectiveness is required. In this paper, a multi-classification approach of lung nodule detection and classification is proposed using artificial intelligence on computed tomography (CT) scan images. Different preprocessing steps are applied for resizing, smoothing, and enhancement of the CT images. Then, two different approaches for feature extraction using VGG16 transfer learning and morphological segmentation are proposed. Morphological segmentation and feature extraction are applied for the segmentation of the region of interest and to extract the distinct features. Finally, the proposed deep learning architecture and seven different machine learning algorithms are applied on the preprocessed data and the extracted features for the classification of lung nodules into three classes: malignant, benign, and normal. It is observed that the stacked ensemble model of deep learning convolutional neural network (CNN) and VGG16 transfer learning models (CNN+VGG16) can achieve 99.55% accuracy using preprocessed data. It is also observed that all the ML algorithms perform with reasonably high accuracy using the low-dimensional morphological features. It is observed from the fivefold cross-validation results that logistic regression performs with 99.36% accuracy in 23.71 s time using the preprocessed data. Whereas, using the morphological features, k-nearest neighbor, and the support vector machine perform with the highest accuracy of 99.76% with very reduced computational time of 0.017 and 0.008 s, respectively. [ABSTRACT FROM AUTHOR]

To recommend useful information to users more efficiently, this paper proposes a dual-path recommendation algorithm which combines multilayer Convolutional Neural Network (CNN) and attention-enhanced long short-term memory network (Attention-LSTM). Firstly, the matrix factorisation technique is used for learning the long-term preferences of users. Secondly, a dual-path network based on CNN and LSTM is constructed to perform feature extraction on the rating matrix. The dual-path network can learn the long-term preferences of users while capturing their dynamic preferences in changing preferences. The algorithm is tested on the public dataset MovieLens-1M, and the MAE value reflects the accuracy of the algorithm. [ABSTRACT FROM AUTHOR]

In this paper, a method based on transfer learning is proposed to recover the three-dimensional shape of cultural relics faces from a single old photo. It can simultaneously reconstruct the three-dimensional facial structure and align the texture of the cultural relics with fewer training samples. The UV position map is used to represent the three-dimensional shape in space and act as the output of the network. A convolutional neural network is used to reconstruct the UV position map from a single 2D image. In the training process, the human face data is used for pre-training, and then a small amount of artifact data is used for fine-tuning. A deep learning model with strong generalization ability is trained with fewer artifact data, and a three-dimensional model of the cultural relic face can be reconstructed from a single old photograph. The methods can train more complex deep networks without a large amount of cultural relic data, and no over-fitting phenomenon occurs, which effectively solves the problem of fewer cultural relic samples. The method is verified by restoring a Chinese Terracotta Warrior with facial cracks and a Buddha with a broken nose. Other applications can be used in the fields such as texture recovery, facial feature extraction, and three-dimensional model estimation of the damaged cultural relics or sculptures in the photos. [ABSTRACT FROM AUTHOR]

Environmental applications play a significant role in the ongoing research area of Polarimetric Synthetic Aperture Radar (PolSAR) image classification. In this paper, a new model is proposed for classifying PolSAR images and applied to a part of the Greater Cairo area in the Nile basin, South of Delta, Egypt. First, the proposed model performs data pre-processing by extracting the coherency and covariance elements noted as [T] and [C] matrices, respectively. Second, temporal convolutional networks (TCN) deep learning is used to extract the features from coherency and covariance elements and then train the model. Third, the SoftMax classifier is used to classify the PolSAR image. Finally, the proposed model is tested with evaluation metrics. The obtained results show that the proposed model can achieve high classification performances. [ABSTRACT FROM AUTHOR]

The magnetic flux leakage (MFL) technique is widely employed for nondestructive testing of ferromagnetic specimens and materials, including wire ropes, bridge cables, and pipelines. As regards the MFL testing, extracting features from MFL signals is crucial for defect recognition and estimation of corresponding widths. Deep learning has been extensively used for feature extraction, but it often performs inadequately on a small sample dataset. To address this limitation, this paper develops a network framework that combines the Wavelet Scattering Transform (WST) and Neural Networks (NN) for defect width estimation. The WST is a knowledge-based feature extraction technique with a structure similar to convolutional neural networks. It offers a translation-invariant representation of signal features using a redundant dictionary of wavelets. The NN then maps the WST feature representation to the defect width information. Experiments on real steel plates with defects are carried out to validate the effectiveness of the proposed framework. Quantitative comparisons of the experimental results demonstrate that the proposed framework achieves better estimation performance in handling MFL signals and has superiority in scenarios with limited training samples. [ABSTRACT FROM AUTHOR]

As one of the key technologies in battery management system, accurate remaining useful life (RUL) prediction is critical to guarantee the reliability and safety for electrical equipment. However, the generalization and robustness of a single method are limited. A novel fusion data‐driven RUL prediction method CSSA‐ELM‐LSSVR based on charging‐discharging health features extraction is proposed in this paper, which fusions chaotic sparrow search algorithm (CSSA), extreme learning machine (ELM), and least squares support vector regression (LSSVR). First, four health indicators (HIs) are extracted from the charging‐discharging process, which can reflect the battery degradation phenomenon from multiple perspectives. Then, pearson correlation coefficient is used to numerically analyze the correlation between HIs and battery aging capacities. Second, the extracted HIs are used as the inputs for ELM and LSSVR to predict the degradation trend of battery, where CSSA is used for hyperparameters optimization in ELM. Finally, considering that CSSA‐ELM can capture the general trend of degradation curves, while LSSVR can trace the detail changes, a fusion framework based on CSSA‐ELM and LSSVR is proposed for RUL prediction. Two weighting schemes, namely precision‐based weighting (PW) and random forest regressor‐based weighting (RFRW) are put forward to fix the weights of CSSA‐ELM and LSSVR algorithms. Two publicly available datasets from National Aeronautics and Space Administration (NASA) and MIT are adopted to verify the feasibility and effectiveness of the proposed method. The results indicate that the proposed method with any weighting scheme has an overall superior prediction performance for different kinds of batteries compared with CSSA‐ELM, LSSVR, convolution neural network and long short term memory. Moreover, the RFRW scheme has better overall performance. Specifically, the maximum root mean square error of the predicted method is 2.5126%, the mean absolute percentage error is 12.9167%, the mean absolute error is 1.8376%, the predicted RUL errors are within one cycle, and the determination coefficient R2$R^2$ is above 0.97. [ABSTRACT FROM AUTHOR]

In remote sensing image fusion, the conventional Convolutional Neural Networks (CNNs) extract local features of the image through layered convolution, which is limited by the receptive field and struggles to capture global features. Transformer utilizes self-attention to capture long-distance dependencies in images, which has a global receptive field, but the computational cost for high-resolution images is excessively high. In response to the above issues, this paper draws inspiration from the FusionNet network, harnessing the local detail acquisition capability of CNNs and the global data procuring capacity of Transformer. It presents a novel method for remote sensing image sharpening named Guided Filtering-Cross Stage Partial Network-Transformer, abbreviated as GF-CSTNet. This solution unifies the strengths of Guided Filtering (GF), Cross Stage Partial Network (CSPNet), and Transformer. Firstly, this method utilizes GF to enhance the acquired remote sensing image data. The CSPNet and Transformer structures are then combined to further enhance fusion performance by leveraging their respective advantages. Subsequently, a Rep-Conv2Former method is designed to streamline attention and extract diverse receptive field features through a multi-scale convolution modulator block. Simultaneously, a reparameterization module is constructed to integrate the multiple branches generated during training into a unified branch during inference, thereby optimizing the model's inference speed. Finally, a residual learning module incorporating attention has been devised to augment the modeling and feature extraction capabilities of images. Experimental results obtained from the GaoFen-2 and WorldView-3 datasets demonstrate the effectiveness of the proposed GF-CSTNet approach. It effectively extracts detailed information from images while avoiding the problem of spectral distortion. [ABSTRACT FROM AUTHOR]

Nowadays, computational intelligence-assisted autonomous assessment of education quality has become a more and more general concern in the area of smart education management. As education quality assessment is a complicated process with multiple heterogeneous factors, it remains challenging to make effective assessment using simple information modality and criteria. To deal with this issue, this paper introduces multiscale deep learning, and proposes a novel data-driven autonomous assessment framework for education quality. In particular, four aspects of heterogeneous indicators are selected as the basic indexes and a dilated convolutional neural network structure is formulated to perform multiscale feature extraction. Then, the structural equation is adopted to make multivariate characterization and output the final assessment results. At last, some simulations are carried out on realistic education operation data to evaluate the efficiency of the proposed autonomous assessment framework. Two aspects of findings can be deduced from the results. For one thing, multisource fusion of multiple indicators well makes sense to autonomous education assessment. For another, multiscale deep learning can provide some beneficial promotion to assessment efficiency. [ABSTRACT FROM AUTHOR]

Intelligent fault diagnostics based on deep learning provides a favorable guarantee for the reliable operation of equipment, but a trained deep learning model generally has low prediction accuracy in cross-domain diagnostics. To solve this problem, a deep learning fault diagnosis method based on the reconstructed envelope spectrum is proposed to improve the ability of rolling bearing cross-domain fault diagnostics in this paper. First, based on the envelope spectrum morphology of rolling bearing failures, a standard envelope spectrum is constructed that reveals the unique characteristics of different bearing health states and eliminates the differences between domains due to different bearing speeds and bearing models. Then, a fault diagnosis model was constructed using a convolutional neural network to learn features and complete fault classification. Finally, using two publicly available bearing data sets and one bearing data set obtained by self-experimentation, the proposed method is applied to the data of the fault diagnostics of rolling bearings under different rotational speeds and different bearing types. The experimental results show that, compared with some popular feature extraction methods, the proposed method can achieve high diagnostic accuracy with data at different rotational speeds and different bearing types, and it is an effective method for solving the problem with cross-domain fault diagnostics for rolling bearings. [ABSTRACT FROM AUTHOR]

In this paper, a novel image reconstruction method for printmaking is proposed via the combination of nonlinear diffusion filtering and convolution neural network. Nonlinear diffusion filtering based on a partial differential equation abstracts the input image to extract color features and texture features of images by nonlinear structured tensors. The image color features and texture features are combined to obtain a feature vector, and the feature vector is fed into the model as the input data. Then, the pre-trained deep learning model VGG-19 is utilized as the backbone network for further feature representation, and the extracted feature maps of each layer of the VGG19 model can be visualized for image reconstruction. The quality of the reconstructed images of prints is improved with the powerful feature extraction and combination ability of neural networks, which has the advantages of fast reconstruction speed and high quality of reconstructed images. Finally, the simulation experiments can demonstrate that the proposed reconstruction approach can achieve relatively ideal reconstruction performance in scenes of printmaking. [ABSTRACT FROM AUTHOR]

In order to balance accuracy and real‐time performance in semantic segmentation, this paper proposes a real‐time semantic segmentation algorithm model based on attention mechanism and multi‐branch feature fusion using Fast convolutional neural network model (Fast‐SCNN). In this method, the spatial detail feature enhancement branch is introduced to enhance spatial detail features firstly. Then, through rational design of fusion module, the feature information of each branch is optimized to achieve better fusion of deep and shallow features. At the end of the feature fusion module, an adaptive feature enhancement focus module is introduced to capture the interdependence between remote pixels. The experimental results show that the proposed algorithm achieves 71.55% segmentation accuracy on Cityscapes dataset, the reasoning speed FPS is 97.6 frames/s, and the number of parameters is 1.39 M, which verifies the effectiveness of the network model constructed by the algorithm. Code is available at https://github.com/ccchhheeennn/model. [ABSTRACT FROM AUTHOR]

The fast scenario transfer for portrait styles has been a universal concern in the area of image processing. Conventionally, it was realized mostly by manual manipulation based on expertise experience, which costs a large amount of human labor. To fit the growing business volume in the era of Internet 4.0, it is supposed to investigate reliable autonomous workflow that generates portrait-style results via intelligent algorithms. Therefore, this paper proposes a fast scenario transfer method for portrait styles through collaborative awareness of convolutional neural network (CNN) and generative learning (GAL). On the one hand, a CNN structure is designed to make feature extraction towards the initial images, which can be used for following image generation. On the other hand, the GAL is utilized to generate new images with post-transferred scenario styles, so that the expected scenario style transfer results can be output by generating new images through long-term iterations. Especially, the loss function is designed by simultaneously considering local and global characteristics. Finally, the analysis and experimental results show that the correction process can be completed by injecting the extracted input face features into the feature maps of corresponding sizes in the generation process using a pre-trained feature extractor. Thus, the face conversion efficiency can be improved. [ABSTRACT FROM AUTHOR]

In recent years, deep learning methods have achieved remarkable success in hyperspectral image classification (HSIC), and the utilization of convolutional neural networks (CNNs) has proven to be highly effective. However, there are still several critical issues that need to be addressed in the HSIC task, such as the lack of labeled training samples, which constrains the classification accuracy and generalization ability of CNNs. To address this problem, a deep multi-scale attention fusion network (DMAF-NET) is proposed in this paper. This network is based on multi-scale features and fully exploits the deep features of samples from multiple levels and different perspectives with an aim to enhance HSIC results using limited samples. The innovation of this article is mainly reflected in three aspects: Firstly, a novel baseline network for multi-scale feature extraction is designed with a pyramid structure and densely connected 3D octave convolutional network enabling the extraction of deep-level information from features at different granularities. Secondly, a multi-scale spatial–spectral attention module and a pyramidal multi-scale channel attention module are designed, respectively. This allows modeling of the comprehensive dependencies of coordinates and directions, local and global, in four dimensions. Finally, a multi-attention fusion module is designed to effectively combine feature mappings extracted from multiple branches. Extensive experiments on four popular datasets demonstrate that the proposed method can achieve high classification accuracy even with fewer labeled samples. [ABSTRACT FROM AUTHOR]

The Hyperspectral Image (HSI) is a great source of information for observing the earth's elements due to its numerous narrow and continuous spectral wavelength bands. There are some key difficulties, such as the fact that the image bands are spectrally and spatially highly correlated, and the 'curse of dimensionality' in using the original HSI for classification. Band (dimensionality/feature) reduction is necessary to improve classification performance through feature extraction and selection. As such, this paper proposes a hybrid HSI classification paradigm, termed Hybrid-2DNET. Specifically, our proposed Hybrid-2DNET incorporates factor analysis-based feature extraction along the Minimum-Redundancy-Maximum-Relevance (mRMR)-based feature selection criterion and a 2D-wavelet Convolutional Neural Network (CNN) to reduce both spectral and spatial dimensionalities. The experimental analyses performed on three remote sensings HSI datasets, namely Indian Pines, University of Pavia, and Salinas Scene, manifest that our proposed Hybrid-2DNET outperforms the handcrafted and deep learning methods. [ABSTRACT FROM AUTHOR]

We present a novel method for real-time fault classification using the time history of acoustic emissions (AEs) recorded from a lab-scale gas turbine operating under normal and faulty conditions across multiple turbine speeds. Time-frequency features are extracted using the continuous wavelet transform, and for each signal, the root mean square (RMS) and kurtosis are calculated. We employ a color mapping technique to combine the time-frequency and statistical features into a single red–green–blue (RGB) image. The red channel is mapped to the time-frequency data, whereas the green and blue channels are mapped to the RMS and kurtosis, respectively. Subsequently, a deep convolutional neural network is trained on the generated images to classify the gas turbine condition. We show that the proposed model can form an online monitoring system using AEs to classify multiple running conditions at various turbine speeds. The methodology not only achieves real-time classification of faults but also minimizes the human intervention in identifying these faults. The datasets and codes used in this paper will be openly available. [ABSTRACT FROM AUTHOR]

Electroencephalography (EEG)-based emotion recognition is increasingly pivotal in the realm of affective brain–computer interfaces. In this paper, we propose TSANN-TG (temporal–spatial attention neural network with a task-specific graph), a novel neural network architecture tailored for enhancing feature extraction and effectively integrating temporal–spatial features. TSANN-TG comprises three primary components: a node-feature-encoding-and-adjacency-matrices-construction block, a graph-aggregation block, and a graph-feature-fusion-and-classification block. Leveraging the distinct temporal scales of features from EEG signals, TSANN-TG incorporates attention mechanisms for efficient feature extraction. By constructing task-specific adjacency matrices, the graph convolutional network with an attention mechanism captures the dynamic changes in dependency information between EEG channels. Additionally, TSANN-TG emphasizes feature integration at multiple levels, leading to improved performance in emotion-recognition tasks. Our proposed TSANN-TG is applied to both our FTEHD dataset and the publicly available DEAP dataset. Comparative experiments and ablation studies highlight the excellent recognition results achieved. Compared to the baseline algorithms, TSANN-TG demonstrates significant enhancements in accuracy and F1 score on the two benchmark datasets for four types of cognitive tasks. These results underscore the significant potential of the TSANN-TG method to advance EEG-based emotion recognition. [ABSTRACT FROM AUTHOR]

Violence detection is a critical task aimed at identifying violent behavior in video by extracting frames and applying classification models. However, the complexity of video data and the suddenness of violent events present significant hurdles in accurately pinpointing instances of violence, making the extraction of frames that indicate violence a challenging endeavor. Furthermore, designing and applying high-performance models for violence detection remains an open problem. Traditional models embed extracted spatial features from sampled frames directly into a temporal sequence, which ignores the spatio-temporal characteristics of video and limits the ability to express continuous changes between adjacent frames. To address the existing challenges, this paper proposes a novel framework called ACTION-VST. First, a keyframe extraction algorithm is developed to select frames that are most likely to represent violent scenes in videos. To transform visual sequences into spatio-temporal feature maps, a multi-path excitation module is proposed to activate spatio-temporal, channel and motion features. Next, an advanced Video Swin Transformer-based network is employed for both global and local spatio-temporal modeling, which enables comprehensive feature extraction and representation of violence. The proposed method was validated on two large-scale datasets, RLVS and RWF-2000, achieving accuracies of over 98 and 93%, respectively, surpassing the state of the art. [ABSTRACT FROM AUTHOR]

Hyperspectral image classification (HSIC) has garnered increasing attention among researchers. While classical networks like convolution neural networks (CNNs) have achieved satisfactory results with the advent of deep learning, they are confined to processing local information. Vision transformers, despite being effective at establishing long-distance dependencies, face challenges in extracting high-representation features for high-dimensional images. In this paper, we present the multiscale efficient attention with enhanced feature transformer (MEA-EFFormer), which is designed for the efficient extraction of spectral–spatial features, leading to effective classification. MEA-EFFormer employs a multiscale efficient attention feature extraction module to initially extract 3D convolution features and applies effective channel attention to refine spectral information. Following this, 2D convolution features are extracted and integrated with local binary pattern (LBP) spatial information to augment their representation. Then, the processed features are fed into a spectral–spatial enhancement attention (SSEA) module that facilitates interactive enhancement of spectral–spatial information across the three dimensions. Finally, these features undergo classification through a transformer encoder. We evaluate MEA-EFFormer against several state-of-the-art methods on three datasets and demonstrate its outstanding HSIC performance. [ABSTRACT FROM AUTHOR]

Existing deep learning (DL) algorithms are based on a large amount of training data and they face challenges in effectively extracting fault features when dealing with few-shot fault diagnoses. Model-agnostic meta-learning (MAML) also faces some challenges, including the limited capability of the basic convolutional neural network (CNN) with a single convolutional kernel to extract fault features comprehensively, as well as the instability of model training due to the inner and outer double-layer loops. To address these issues, this paper presents a multi-step loss meta-learning method based on multi-scale feature extraction (MFEML). Firstly, an improved multi-scale feature extraction module (IMFEM) is designed to solve the problem of the insufficient feature extraction capability of the CNN. Secondly, the multi-step loss is used to reconstruct the meta-loss to address the issue of MAML training instability. Finally, the experimental results of two datasets demonstrate the effectiveness of the MFEML. [ABSTRACT FROM AUTHOR]

Background: Glaucoma, the second leading cause of global blindness, demands timely detection due to its asymptomatic progression. This paper introduces an advanced computerized system, integrates Machine Learning (ML), convolutional neural networks (CNNs), and image processing for accurate glaucoma detection using medical imaging data, surpassing prior research efforts. Method: Developing a hybrid glaucoma detection framework using CNNs (ResNet50, VGG-16) and Random Forest. Models analyze pre-processed retinal images independently, and post-processing rules combine predictions for an overall glaucoma impact assessment. Result: The hybrid framework achieves a significant 95.41% accuracy, with precision and recall at 99.37% and 88.37%, respectively. The F1 score, balancing precision and recall, reaches a commendable 93.52%. These results highlight the robustness and effectiveness of the hybrid framework in accurate glaucoma diagnosis. Conclusion: In summary, our research presents an innovative hybrid framework combining CNNs and traditional ML models for glaucoma detection. Using ResNet50, VGG-16, and Random Forest in an ensemble approach yields remarkable accuracy, precision, recall, and F1 score. These results showcase the methodology's potential to enhance glaucoma diagnosis, emphasizing its promising role in early detection and preventing irreversible vision loss. The integration of ML and DNNs in medical imaging analysis suggests a valuable path for future advancements in ophthalmic healthcare. [ABSTRACT FROM AUTHOR]

Breast cancer is one of the cancers with high morbidity and mortality in the world, which is a serious threat to the health of women. With the development of deep learning, the recognition about computer-aided diagnosis technology is getting higher and higher. And the traditional data feature extraction technology has been gradually replaced by the feature extraction technology based on convolutional neural network which helps to realize the automatic recognition and classification of pathological images. In this paper, a novel method based on deep learning and wavelet transform is proposed to classify the pathological images of breast cancer. Firstly, the image flip technique is used to expand the data set, then the two-level wavelet decomposition and reconfiguration technology is used to sharpen and enhance the pathological images. Secondly, the processed data set is divided into the training set and the test set according to 8:2 and 7:3, and the YOLOv8 network model is selected to perform the eight classification tasks of breast cancer pathological images. Finally, the classification accuracy of the proposed method is compared with the classification accuracy obtained by YOLOv8 for the original BreaKHis dataset, and it is found that the algorithm can improve the classification accuracy of images with different magnifications, which proves the effectiveness of combining two-level wavelet decomposition and reconfiguration with YOLOv8 network model. [ABSTRACT FROM AUTHOR]

Convolutional neural networks (CNNs) need to replicate feature detectors when modeling spatial information, which reduces their efficiency. The number of replicated feature detectors or labeled training data required for such methods grows exponentially with the dimensionality of the data being used. On the other hand, space-insensitive methods are difficult to encode and express effectively due to the limitation of their rich text structures. In response to the above problems, this paper proposes a capsule network (self-attention capsule network, or SA-CapsNet) with a self-attention mechanism for text classification tasks, wherein the capsule network itself, given the feature with the symmetry hint on two ends, acts as both encoder and decoder. In order to learn long-distance dependent features in sentences and encode text information more efficiently, SA-CapsNet maps the self-attention module to the feature extraction layer of the capsule network, thereby increasing its feature extraction ability and overcoming the limitations of convolutional neural networks. In addition, in this study, in order to improve the accuracy of the model, the capsule was improved by reducing its dimension and an intermediate layer was added, enabling the model to obtain more expressive instantiation features in a given sentence. Finally, experiments were carried out on three general datasets of different sizes, namely the IMDB, MPQA, and MR datasets. The accuracy of the model on these three datasets was 84.72%, 80.31%, and 75.38%, respectively. Furthermore, compared with the benchmark algorithm, the model's performance on these datasets was promising, with an increase in accuracy of 1.08%, 0.39%, and 1.43%, respectively. This study focused on reducing the parameters of the model for various applications, such as edge and mobile applications. The experimental results show that the accuracy is still not apparently decreased by the reduced parameters. The experimental results therefore verify the effective performance of the proposed SA-CapsNet model. [ABSTRACT FROM AUTHOR]

Deep convolutional neural networks have shown advanced performance in accurately segmenting images. In this paper, an SNP-like convolutional neuron structure is introduced, abstracted from the nonlinear mechanism in nonlinear spiking neural P (NSNP) systems. Then, a U-shaped convolutional neural network named SNP-like parallel-convolutional network, or SPC-Net, is constructed for segmentation tasks. The dual-convolution concatenate (DCC) and dual-convolution addition (DCA) network blocks are designed, respectively, in the encoder and decoder stages. The two blocks employ parallel convolution with different kernel sizes to improve feature representation ability and make full use of spatial detail information. Meanwhile, different feature fusion strategies are used to fuse their features to achieve feature complementarity and augmentation. Furthermore, a dual-scale pooling (DSP) module in the bottleneck is designed to improve the feature extraction capability, which can extract multi-scale contextual information and reduce information loss while extracting salient features. The SPC-Net is applied in medical image segmentation tasks and is compared with several recent segmentation methods on the GlaS and CRAG datasets. The proposed SPC-Net achieves 90.77% DICE coefficient, 83.76% IoU score and 83.93% F1 score, 86.33% ObjDice coefficient, 135.60 Obj-Hausdorff distance, respectively. The experimental results show that the proposed model can achieve good segmentation performance. [ABSTRACT FROM AUTHOR]

Hypergraph neural networks (HGNNs), extending the techniques of graph neural networks, have been applied to various fields due to their ability to capture more complex high-order node relationships. However, for hyperspectral image (HSI) classification tasks, previous HGNN-based works usually constructed hypergraphs using pixels as nodes, resulting in massive computational costs. Meanwhile, pixel-level personalized features are required for HSI classification. To achieve high efficiency and accuracy simultaneously, this paper presents a fast hypergraph neural network with detail preservation (DPFHNet) for HSI classification. It constructs hypergraphs at the superpixel level to reduce time consumption and supplement pixel-level detail features through a classification refinement module. This framework contains multiple stages. Firstly, its main stage is designed with HGNNs from a superpixel viewpoint rather than pixels, providing a fast strategy to capture high-order complex relationships of multiple homogeneous irregular regions. After that, auxiliary stages based on convolutional neural networks are integrated into the main stage, which adopts a hierarchical design and attempts to acquire pixel-level spatial-spectral information before the hypergraph feature extraction of the main stage, assisting in learning more valuable features. Finally, a classification refinement module is constructed, which generates pixel-level detail features to refine the superpixel-level features obtained by HGNN. Experiments on three datasets illustrate that DPFHNet achieves competitive results and efficiency compared to advanced methodologies. [ABSTRACT FROM AUTHOR]

The recognition of food images is of great significance for nutrition monitoring, food retrieval and food recommendation. However, the accuracy of recognition had not been high enough due to the complex background of food images and the characteristics of small inter-class differences and large intra-class differences. To solve these problems, this paper proposed a food image recognition method based on transfer learning and ensemble learning. Firstly, generic image features were extracted by using the convolutional neural network models (VGG19, ResNet50, MobileNet V2, AlexNet) pre-trained on the ImageNet dataset. Secondly, the 4 pre-trained models were transferred to the food image dataset for model fine-tuning. Finally, different basic learner combination strategies were adopted to establish the ensemble model and classify feature information. In this paper, several kinds of experiments were performed to compare the results of food image recognition between single models and ensemble models on food-11 dataset. The experimental results demonstrated that the accuracy of the ensemble model was the highest, reaching 96.88%, which was superior to any base learner. Therefore, the convolutional neural network model based on transfer learning and ensemble learning has strong learning ability and generalization ability, and it is feasible and practical to apply the method to food image recognition. [ABSTRACT FROM AUTHOR]

To enhance the accuracy of theft detection for electricity consumers, this paper introduces a novel strategy based on the fusion of the dual-time feature and deep learning methods. Initially, considering electricity-consumption features at dual temporal scales, the paper employs temporal convolutional networks (TCN) with a long short-term memory (LSTM) multi-level feature extraction module (LSTM-TCN) and deep convolutional neural network (DCNN) to parallelly extract features at these scales. Subsequently, the extracted features are coupled and input into a fully connected (FC) layer for classification, enabling the precise detection of theft users. To validate the method's effectiveness, real electricity-consumption data from the State Grid Corporation of China (SGCC) is used for testing. The experimental results demonstrate that the proposed method achieves a remarkable detection accuracy of up to 94.7% during testing, showcasing excellent performance across various evaluation metrics. Specifically, it attained values of 0.932, 0.964, 0.948, and 0.986 for precision, recall, F1 score, and AUC, respectively. Additionally, the paper conducts a comparative analysis with mainstream theft identification approaches. In the comparison of training processes, the proposed method exhibits significant advantages in terms of identification accuracy and fitting degree. Moreover, with adjustments to the training set proportions, the proposed method shows minimal impact, indicating robustness. [ABSTRACT FROM AUTHOR]

With the increasing number and types of global power loads and the development and popularization of smart grid technology, a large number of researches on load-level non-intrusive load monitoring technology have emerged. However, the unique power characteristics of the load make NILM face the difficult problem of low robustness of feature extraction and low accuracy of classification and identification in the recognition stage. This paper proposes a structured V-I mapping method to address the inherent limitations of traditional V-I trajectory mapping methods from a new perspective. In addition, for the verification of the V-I trajectory mapping method proposed in this paper, the complexity of load characteristics is comprehensively considered, and a lightweight convolutional neural network is designed based on AlexNet. The experimental results on the NILM dataset show that the proposed method significantly improves recognition accuracy compared to existing VI trajectory mapping methods. [ABSTRACT FROM AUTHOR]

The incompleteness and lack of bearing fault data have become important problems in bearing fault diagnosis. This paper presents an intelligent fault diagnosis method for rolling bearings based on a similarity clustering multi-channel convolution neural network with the hierarchical branch (HB-SC-MCCNN). First, the relevant features are extracted by MCCNN, and combined with the similarity clustering principle, the accurate binary classification is realized in the case of insufficient labeled data. Second, the similarity clustering module and additional loss are added to the SC-MCCNN network to form a hierarchical-branch network, which simplifies the problem of fault multi-classification into binary classification with multiple steps, and to reduces the dependence on the amount of label data in multi-classification. Finally, based on the self-learning characteristics of HB-SC-MCCNN, the unlabeled data and the missing fault types in the training set are re-labeled to realize the re-training of the network. On the benchmark dataset, the comparison experiment results with several salient deep learning models show that the method proposed in this paper successfully realizes the hierarchical diagnosis of bearing faults and presents more substantial competitiveness in the case of insufficient labeled data and missing fault types. [ABSTRACT FROM AUTHOR]

With the continuous development of 3D data acquisition technology, point cloud data, an essential form of 3D data representation is widely used in fields such as autonomous driving, indoor navigation, virtual reality, and augmented reality. As an essential branch of point cloud data processing, cloud classification has important research significance and value. However, this task poses challenges due to the sparsity, irregularity, and unordered nature of point cloud data. Among most of the methods dealing with this problem, there are problems of inadequate extraction of local features, low accuracy of classification, and poor generalization of point cloud data. Therefore, this paper addresses the above issue. This paper presents an improved 3D point cloud classification network by enhancing the Dynamic Graph Convolutional Neural Network (DGCNN). Firstly, this paper combines K-Nearest Neighbors (KNN) and ball radius query for feature extraction to better capture the local structural information in cloud classification data. Secondly, a conventional convolution layer is incorporated between the second and third graph convolution layers to enhance the feature representation in the proposed approach. Finally, this paper uses a global pooling method that combines maximum pooling and average pooling to construct the global structure of the point cloud while preserving the most critical information. Realize 3D point cloud classification. The experimental results demonstrate a 0.9% improvement in accuracy on the ModelNet40 dataset using the proposed improved method. This validates the effectiveness of the enhancement process described in this paper and offers valuable insights for enhancing the performance and application of point cloud classification. [ABSTRACT FROM AUTHOR]

In this paper, we have proposed a hybrid bio-inspired algorithm which takes the merits of whale optimization algorithm (WOA) and adaptive particle swarm optimization (APSO). The proposed algorithm is referred as the hybrid WOA_APSO algorithm. We utilize a convolutional neural network (CNN) for classification purposes. Extensive experiments are performed to evaluate the performance of the proposed model. Here, pre-processing and segmentation are performed on 120 lung CT images for obtaining the segmented tumored and non-tumored region nodule. The statistical, texture, geometrical and structural features are extracted from the processed image using different techniques. The optimized feature selection plays a crucial role in determining the accuracy of the classification algorithm. The novel variant of whale optimization algorithm and adaptive particle swarm optimization, hybrid bio-inspired WOA_APSO, is proposed for selecting optimized features. The feature selection grouping is applied by embedding linear discriminant analysis which helps in determining the reduced dimensions of subsets. Twofold performance comparisons are done. First, we compare the performance against the different classification techniques such as support vector machine, artificial neural network (ANN) and CNN. Second, the computational cost of the hybrid WOA_APSO is compared with the standard WOA and APSO algorithms. The experimental result reveals that the proposed algorithm is capable of automatic lung tumor detection and it outperforms the other state-of-the-art methods on standard quality measures such as accuracy (97.18%), sensitivity (97%) and specificity (98.66%). The results reported in this paper are encouraging; hence, these results will motivate other researchers to explore more in this direction. [ABSTRACT FROM AUTHOR]

Hyperspectral images' (HSIs) classification research has seen significant progress with the use of convolutional neural networks (CNNs) and Transformer blocks. However, these studies primarily incorporated Transformer blocks at the end of their network architectures. Due to significant differences between the spectral and spatial features in HSIs, the extraction of both global and local spectral–spatial features remains incomplete. To address this challenge, this paper introduces a novel method called TransHSI. This method incorporates a new spectral–spatial feature extraction module that leverages 3D CNNs to fuse Transformer to extract the local and global spectral features of HSIs, then combining 2D CNNs and Transformer to capture the local and global spatial features of HSIs comprehensively. Furthermore, a fusion module is proposed, which not only integrates the learned shallow and deep features of HSIs but also applies a semantic tokenizer to transform the fused features, enhancing the discriminative power of the features. This paper conducts experiments on three public datasets: Indian Pines, Pavia University, and Data Fusion Contest 2018. The training and test sets are selected based on a disjoint sampling strategy. We perform a comparative analysis with 11 traditional and advanced HSI classification algorithms. The experimental results demonstrate that the proposed method, TransHSI algorithm, achieves the highest overall accuracies and kappa coefficients, indicating a competitive performance. [ABSTRACT FROM AUTHOR]

With the advancement of neural networks, more and more neural networks are being applied to structural health monitoring systems (SHMSs). When an SHMS requires the integration of numerous neural networks, high-performance and low-latency networks are favored. This paper focuses on damage detection based on vibration signals. In contrast to traditional neural network approaches, this study utilizes a stochastic configuration network (SCN). An SCN is an incrementally learning network that randomly configures appropriate neurons based on data and errors. It is an emerging neural network that does not require predefined network structures and is not based on gradient descent. While SCNs dynamically define the network structure, they essentially function as fully connected neural networks that fail to capture the temporal properties of monitoring data effectively. Moreover, they suffer from inference time and computational cost issues. To enable faster and more accurate operation within the monitoring system, this paper introduces a stochastic convolutional feature extraction approach that does not rely on backpropagation. Additionally, a random node deletion algorithm is proposed to automatically prune redundant neurons in SCNs, addressing the issue of network node redundancy. Experimental results demonstrate that the feature extraction method improves accuracy by 30% compared to the original SCN, and the random node deletion algorithm removes approximately 10% of neurons. [ABSTRACT FROM AUTHOR]