Search

Recently, with the emergence of many image editing tools (photoshop, Topaz studio, etc.), the authenticity of images has been severely challenged. However, the performance of some existing traditional feature extraction methods and detection methods based on convolutional neural network (CNN) is poor, and the information provided by the features extracted from the network is limited and single. In this paper, an end-to-end ringed residual U-Net is proposed to detect image splicing forgery by blending features of non-natural regions. Some regions with significant differences from the image background are defined as non-natural regions(such as the irregular border at the splicing of images). In this paper, a feature enhancement module for non-natural regions is constructed, which the image through the pooling of four different scales, and these features are then combined with the original image and input to the backbone network for processing, aiming to highlight regions of the image that differ significantly from the background. Therefore, after adding the feature enhancement module for non-natural regions to the end-to-end ring residual U-Net, more attention will be paid to the tampering regions in the feature extraction stage, image manipulation detection and localization will also become more accurate. Compared with some mainstream methods, this method achieves better performance on the three standard datasets(CASIA2.0, NIST2016, COLUMBIA). In addition, it has excellent robustness under JPEG compression attack and noise corruption attack. [ABSTRACT FROM AUTHOR]

Microscopic image analysis technology helps solve the inadvertences of artificial traditional methods in disease, wastewater treatment, and environmental change monitoring analysis. Convolutional neural network (CNN) play an important role in microscopic image analysis. Image segmentation, in which U-Net is increasingly applied in microscopic image segmentation, is a crucial step in detection, tracking, monitoring, feature extraction, modelling, and analysis. This paper comprehensively reviews the development history of U-Net, analyses several research results of various segmentation methods since the emergence of U-Net, and conducts a comprehensive review of related papers. This paper summarised the improved methods of U-Net and then listed the existing significance of image segmentation techniques and their improvements introduced over the years. Finally, focusing on the different improvement strategies of U-Net in different papers, the related work of each application target is reviewed according to detailed technical categories to facilitate future research. Researchers can see the dynamics of the transmission of technological development and keep up with future trends in this interdisciplinary field. [ABSTRACT FROM AUTHOR]

At present, in end-to-end network combined with deep learning in stereo matching, how to perceive ample image details within an acceptable range of computational cost, so as to improve the final matching accuracy, has become a hot research topic. In this paper, we design a cascaded disparity correction network based on DispNet, which can refine the initial disparity image by combining the process output results in the trunk network. The method proposed in this paper is named ETE–DC–CNN (end to end–disparity correction–convolutional neural network). In the trunk network, the mixed dilated convolution module is employed to extract the features of the original image, and the feature image is constructed into a 3D disparity space volume through depth-separable convolution, after which the initial disparity image can be obtained through 2D encoder–decoder module. In the correction network, the gradient information of the initial feature image is combined to reconstruct the modified matching cost body guided by the initial disparity image and then a smaller encoder–decoder module is trained and processed to make the final result at the sub-pixel level. The algorithm in this paper has been verified in SceneFlow and KITTI 2012/2015 data sets. The method proposed in this article achieves 3.46, 2.12, 1.19, and 0.6 results in the non-occluded area and 4.04, 2.55, 1.58, and 0.7 results in the global area on the Er (> 2 px), Er (> 3 px), Er (> 5 px), and Epe indicators in the KITTI 2012 test set, which are higher than those of the backbone network DispNet. [ABSTRACT FROM AUTHOR]

Recent technological developments have enabled computers to identify and categorize facial expressions to determine a person's emotional state in an image or a video. This process, called "Facial Expression Recognition (FER)", has become one of the most popular research areas in computer vision. In recent times, deep FER systems have primarily concentrated on addressing two significant challenges: the problem of overfitting due to limited training data availability, and the presence of expression-unrelated variations, including illumination, head pose, image resolution, and identity bias. In this paper, a comprehensive survey is provided on deep FER, encompassing algorithms and datasets that offer insights into these intrinsic problems. Initially, this paper presents a detailed timeline showcasing the evolution of methods and datasets in deep facial expression recognition (FER). This timeline illustrates the progression and development of the techniques and data resources used in FER. Then, a comprehensive review of FER methods is introduced, including the basic principles of FER (components such as preprocessing, feature extraction and classification, and methods, etc.) from the pro-deep learning era (traditional methods using handcrafted features, i.e., SVM and HOG, etc.) to the deep learning era. Moreover, a brief introduction is provided related to the benchmark datasets (there are two categories: controlled environments (lab) and uncontrolled environments (in the wild)) used to evaluate different FER methods and a comparison of different FER models. Existing deep neural networks and related training strategies designed for FER, based on static images and dynamic image sequences, are discussed. The remaining challenges and corresponding opportunities in FER and the future directions for designing robust deep FER systems are also pinpointed. [ABSTRACT FROM AUTHOR]

Based on optical image enhancement, this paper uses convolutional neural network to detect key points of swimming posture. In swimming posture analysis, key point detection can provide information about posture accuracy and evaluation. However, due to the change of illumination conditions, the reduction of image quality and occlusion, the accuracy and stability of key point detection are limited. In order to solve this problem, an optical image enhancement method based on convolutional neural network is proposed in this paper. First, a specific convolutional neural network architecture is used to extract features from input images. Then optical image enhancement technology is used to preprocess the input image to improve the image quality. Next, the trained convolutional neural network model is used to detect key points. Experimental results show that the proposed method has good performance under different illumination conditions and image quality. Therefore, this study provides a new idea and method for the application of optical image enhancement in the detection of key points in swimming posture analysis. [ABSTRACT FROM AUTHOR]

To recommend useful information to users more efficiently, this paper proposes a dual-path recommendation algorithm which combines multilayer Convolutional Neural Network (CNN) and attention-enhanced long short-term memory network (Attention-LSTM). Firstly, the matrix factorisation technique is used for learning the long-term preferences of users. Secondly, a dual-path network based on CNN and LSTM is constructed to perform feature extraction on the rating matrix. The dual-path network can learn the long-term preferences of users while capturing their dynamic preferences in changing preferences. The algorithm is tested on the public dataset MovieLens-1M, and the MAE value reflects the accuracy of the algorithm. [ABSTRACT FROM AUTHOR]

In this paper, a method based on transfer learning is proposed to recover the three-dimensional shape of cultural relics faces from a single old photo. It can simultaneously reconstruct the three-dimensional facial structure and align the texture of the cultural relics with fewer training samples. The UV position map is used to represent the three-dimensional shape in space and act as the output of the network. A convolutional neural network is used to reconstruct the UV position map from a single 2D image. In the training process, the human face data is used for pre-training, and then a small amount of artifact data is used for fine-tuning. A deep learning model with strong generalization ability is trained with fewer artifact data, and a three-dimensional model of the cultural relic face can be reconstructed from a single old photograph. The methods can train more complex deep networks without a large amount of cultural relic data, and no over-fitting phenomenon occurs, which effectively solves the problem of fewer cultural relic samples. The method is verified by restoring a Chinese Terracotta Warrior with facial cracks and a Buddha with a broken nose. Other applications can be used in the fields such as texture recovery, facial feature extraction, and three-dimensional model estimation of the damaged cultural relics or sculptures in the photos. [ABSTRACT FROM AUTHOR]

The fast scenario transfer for portrait styles has been a universal concern in the area of image processing. Conventionally, it was realized mostly by manual manipulation based on expertise experience, which costs a large amount of human labor. To fit the growing business volume in the era of Internet 4.0, it is supposed to investigate reliable autonomous workflow that generates portrait-style results via intelligent algorithms. Therefore, this paper proposes a fast scenario transfer method for portrait styles through collaborative awareness of convolutional neural network (CNN) and generative learning (GAL). On the one hand, a CNN structure is designed to make feature extraction towards the initial images, which can be used for following image generation. On the other hand, the GAL is utilized to generate new images with post-transferred scenario styles, so that the expected scenario style transfer results can be output by generating new images through long-term iterations. Especially, the loss function is designed by simultaneously considering local and global characteristics. Finally, the analysis and experimental results show that the correction process can be completed by injecting the extracted input face features into the feature maps of corresponding sizes in the generation process using a pre-trained feature extractor. Thus, the face conversion efficiency can be improved. [ABSTRACT FROM AUTHOR]

Background: Glaucoma, the second leading cause of global blindness, demands timely detection due to its asymptomatic progression. This paper introduces an advanced computerized system, integrates Machine Learning (ML), convolutional neural networks (CNNs), and image processing for accurate glaucoma detection using medical imaging data, surpassing prior research efforts. Method: Developing a hybrid glaucoma detection framework using CNNs (ResNet50, VGG-16) and Random Forest. Models analyze pre-processed retinal images independently, and post-processing rules combine predictions for an overall glaucoma impact assessment. Result: The hybrid framework achieves a significant 95.41% accuracy, with precision and recall at 99.37% and 88.37%, respectively. The F1 score, balancing precision and recall, reaches a commendable 93.52%. These results highlight the robustness and effectiveness of the hybrid framework in accurate glaucoma diagnosis. Conclusion: In summary, our research presents an innovative hybrid framework combining CNNs and traditional ML models for glaucoma detection. Using ResNet50, VGG-16, and Random Forest in an ensemble approach yields remarkable accuracy, precision, recall, and F1 score. These results showcase the methodology's potential to enhance glaucoma diagnosis, emphasizing its promising role in early detection and preventing irreversible vision loss. The integration of ML and DNNs in medical imaging analysis suggests a valuable path for future advancements in ophthalmic healthcare. [ABSTRACT FROM AUTHOR]

Hypergraph neural networks (HGNNs), extending the techniques of graph neural networks, have been applied to various fields due to their ability to capture more complex high-order node relationships. However, for hyperspectral image (HSI) classification tasks, previous HGNN-based works usually constructed hypergraphs using pixels as nodes, resulting in massive computational costs. Meanwhile, pixel-level personalized features are required for HSI classification. To achieve high efficiency and accuracy simultaneously, this paper presents a fast hypergraph neural network with detail preservation (DPFHNet) for HSI classification. It constructs hypergraphs at the superpixel level to reduce time consumption and supplement pixel-level detail features through a classification refinement module. This framework contains multiple stages. Firstly, its main stage is designed with HGNNs from a superpixel viewpoint rather than pixels, providing a fast strategy to capture high-order complex relationships of multiple homogeneous irregular regions. After that, auxiliary stages based on convolutional neural networks are integrated into the main stage, which adopts a hierarchical design and attempts to acquire pixel-level spatial-spectral information before the hypergraph feature extraction of the main stage, assisting in learning more valuable features. Finally, a classification refinement module is constructed, which generates pixel-level detail features to refine the superpixel-level features obtained by HGNN. Experiments on three datasets illustrate that DPFHNet achieves competitive results and efficiency compared to advanced methodologies. [ABSTRACT FROM AUTHOR]

Military object military object detection technology serves as the foundation and critical component for reconnaissance and command decision-making, playing a significant role in information-based and intelligent warfare. However, many existing military object detection models focus on exploring deeper and more complex architectures, which results in models with a large number of parameters. This makes them unsuitable for inference on mobile or resource-constrained combat equipment, such as combat helmets and reconnaissance Unmanned Aerial Vehicles (UAVs). To tackle this problem, this paper proposes a lightweight detection framework. A CSP-GhostnetV2 module is proposed in our method to make the feature extraction network more lightweight while extracting more effective information. Furthermore, to fuse multiscale information in low-computational scenarios, GSConv and the proposed CSP-RepGhost are used to form a lightweight feature aggregation network. The experimental results demonstrate that our proposed lightweight model has significant advantages in detection accuracy and efficiency compared to other detection algorithms. [ABSTRACT FROM AUTHOR]

Ship detection aims to automatically identify whether there are ships in the images, precisely classifies and localizes them. Regardless of whether utilizing early manually designed methods or deep learning technology, ship detection is dedicated to exploring the inherent characteristics of ships to enhance recall. Nowadays, high-precision ship detection plays a crucial role in civilian and military applications. In order to provide a comprehensive review of ship detection in optical remote-sensing images (SDORSIs), this paper summarizes the challenges as a guide. These challenges include complex marine environments, insufficient discriminative features, large scale variations, dense and rotated distributions, large aspect ratios, and imbalances between positive and negative samples. We meticulously review the improvement methods and conduct a detailed analysis of the strengths and weaknesses of these methods. We compile ship information from common optical remote sensing image datasets and compare algorithm performance. Simultaneously, we compare and analyze the feature extraction capabilities of backbones based on CNNs and Transformer, seeking new directions for the development in SDORSIs. Promising prospects are provided to facilitate further research in the future. [ABSTRACT FROM AUTHOR]

Middle-box based attacks create serious functional defects in the devices such as firewalls, address translators, load balancers, server units, and other data inspecting devices. Middle-box based attacks are more severe than terminal node-based attacks. These attacks are mainly initiated to malfunction the internal events of middle-level devices. Notably, Internet of Healthcare Things (IoHT) is a completely distributed and heterogeneous environment that leads into more vulnerable events. In the distributed medical system field, the middle-box devices manage secret medical data transactions, internal network communication, patient data protection principles and packet inspection procedures. The medical data collected from each patient needs secrecy and stability in various aspects in the IoHT environment. The middle-box based attacks injected into the IoHT nodes create inefficiency in maintaining patient data, Denial of Service (DoS) at middle-box nodes, excessive diagnosis time, and lack of data protection. For handling these issues, a new security architecture and a new attack detection model are proposed in this paper which has been developed using ranking subsets and Convolutional Neural Network (CNN) principles. The proposed CNN with ranking principles model is designed with binary class fuzzy fisher face optimization technique and flower pollination optimization method to initiate feature extraction. The extracted features of each data flow are analyzed using CNN and ranking subset methodologies. In this proposed model, the continuous involvement of middle-box events in respective devices are classified under various anomaly cases and legitimate cases. The proposed IoHT model attains maximum success rate than the existing models as indicated in implementation section. [ABSTRACT FROM AUTHOR]

Accurate estimation of Li-ion battery capacity is critical for a battery management system (BMS). This paper proposes an innovative method which combines a convolutional neural network and incremental capacity analysis (ICA). In the present approach, the voltage and temperature, which significantly affect the ICA curve during the discharging process, are adopted as the inputs for CNN. Rather than extracting feature parameters of an IC curve, as is carried out in the available research, the present method uses the whole ICA curve as the input to avoid complicated feature extraction and correlation analysis. The results show that the maximum error of capacity estimation is less than 4.7%, the rectified mean squared error is less than 1.3% for each battery, and the overall RMSE is below 1.12%. [ABSTRACT FROM AUTHOR]

The purpose of pan-sharpening is to generate high-resolution multispectral (HRMS) images by combining multispectral images (MS) and panchromatic images (PAN), which have become an important part of remote sensing image processing. Therefore, how to better extract complete feature information from MS images and PAN images has become the focus of our attention. In this paper, we propose a new pansharpening method, called Transformer-based Dual-path cross fusion network (TDF) for Pan-sharpening remote sensing images, which aims to extract the spatial details of PAN images while maintaining the spectral fidelity of MS images. The whole network structure can be divided into two parts: in the encoder part, we adopt the Swin-Transformer module for the downsampling operation, which expands the sensory field of the network to the feature map, and then extracts the global information. However, since the Swin-Transformer module is not good at extracting pixel-level details, we introduce the Base Feature Extraction (BFE) and the Invertible Neural Network Block (INNB) modules for the interaction between the local and the global feature information. we also introduce the Edge-Enhancement Block (EEB) to further enhance the feature extraction at multi-scales during the image fusion process. In the decoder section, we once again employ the Swin Transformer module for downsampling. After the convolution operation and activation function, we utilize the Sub-Pixel Convolutional Neural Network for upsampling to generate the ultimate high-resolution multispectral images. Simulation experiments and real experiments are conducted on QuickBird (QB) and WorldView2 (WV2) datasets, which demonstrated our method are superior to the current methods. [ABSTRACT FROM AUTHOR]

Various prediction approaches regarding liver diseases have been developed. Still, they are expensive and more complex. This work aims to design an effective method for identifying liver diseases at earlier stages. This paper presents a modified Mask-regionalconvolutional neural network (MRCNN) architecture for non-invasive liver disease prediction. The Pelican Optimization Algorithm (POA) is used to balance the bounding box regression and mask branching training losses of the RCNN model. The liver disease features are extracted from three datasets namely Indian liver patient records, Hepatitis C, and Cirrhosis Prediction datasets. The POA-modified MRCNN model is mainly used to identify the interrelationship that exists between different laboratory measurements and diagnoses. The efficiency of the proposed model is compared with different state-of-art methods such as Opposition-based Laplacian Equilibrium Optimizer, Adaptive Hybridized Deep CNN, SVM, and Tree-based classifiers in terms of Accuracy, Precision, Recall, F-measure, and Mathews Correlation Coefficient (MCC). The proposed model offers an MCC value of 94.89, an accuracy of 98%, a precision of 96.2%, an F-measure of 97.3%, and a recall of 95% respectively. The results demonstrate the efficiency of the proposed model in predicting liver disease at an early stage via automatic screening and minimizing the burden of physicians. [ABSTRACT FROM AUTHOR]

Automatic extraction of building contours from high-resolution images is of great significance in the fields of urban planning, demographics, and disaster assessment. Network models based on convolutional neural network (CNN) and transformer technology have been widely used for semantic segmentation of buildings from high resolution remote sensing images (HRSI). However, the fixed geometric structure and the local receptive field of the convolutional kernel are not good at global feature extraction, and the transformer technique with self-attention mechanism introduces computational redundancies and extracts local feature details poorly in the process of modeling the global contextual information. In this paper, a dual-branch fused reconstructive transformer network, DFRTNet, is proposed for efficient and accurate building extraction. In the encoder, the traditional transformer is reconfigured by designing the local and global feature extraction module (LGFE); the branch of global feature extraction (GFE) performs dynamic range attention (DRA) based on the idea of top-k attention for extracting global features; furthermore, the branch of local feature extraction (LFE) is used to obtain fine-grained features. The multilayer perceptron (MLP) is employed to efficiently fuse the local and global features. In the decoder, a simple channel attention module (CAM) is used in the up-sampling part to enhance channel dimension features. Our network achieved the best segmentation accuracy on both the WHU and Massachusetts building datasets when compared to other mainstream and state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Single image super‐resolution (SISR) has been revolutionized by convolutional neural networks (CNN). However, existing SISR algorithms have feature extraction and adaptive adjustment limitations, leading to information duplication and unsatisfactory image reconstruction. In this paper, we propose a deep and adaptive feature extraction attention network (DAAN), which first fully extracts shallow features and then adaptively captures precise and fine‐scale features by a deep feature extraction block (DFEB). It includes multi‐dimensional feature extraction blocks (MFEBs) that combine large kernel and dynamic convolution layers to improve large‐scale information utilization effectively. Finally, an enhanced spatial attention block (ESAB) to further selectively reinforce the transmission of details. A large number of experimental results show that our proposed model reconstruction performance is superior to existing classical methods. [ABSTRACT FROM AUTHOR]

• An edge detection algorithm for thermal infrared weak texture images. • Construct a high-quality thermal infrared image edge dataset RI-BSDS500 for training to improve the training convergence speed and generalization ability of the model. • Different thermal infrared image datasets are tested under different algorithms, and the results are analyzed from the perspectives of objective parameters and subjective effects, which proves that the proposed algorithm in this paper is more effective on thermal infrared images. In order to solve the problems such as difficulties in extracting image edge information caused by low contrast and blurred edges of thermal infrared images, a thermal infrared image edge detection algorithm PiDiNet-TIR constructed based on the PiDiNet model is proposed. On the basis of the visible light image dataset BSDS500, the visible light image is grayed out, noise is added, and contrast is reduced to construct the thermal infrared image edge dataset I R-BSDS500, which provides image data for model training and testing. Deeply study the theory of PiDiNet model, add rich convolution mechanism to its backbone network, improve the activation function, pooling layer and up-sampling module, study the SimAM attention mechanism and add it to the side network. Using the open-source thermal infrared image dataset and homemade thermal infrared images for testing, we compare and analyze the mean square error (MSE), structural similarity of image (SSIM), feature similarity of image (FSIM), and Frames Per Second (FPS)of different detection algorithms, such as HED, RCF, DexiNet, PiDiNet, and the algorithm proposed in this paper. The results of image evaluation parameters prove that the edge detection algorithm proposed in this paper has high feature extraction efficiency and feature expression ability, and the algorithm detection performance is higher than other algorithms. [ABSTRACT FROM AUTHOR]

Edge detection is of critical importance for middle-level and high-level tasks in computer vision. Existing edge detection methods usually use VGG16 as the encoding network and achieve exceptional performance through transfer learning, which has the characteristics of high parameters and high computational cost. Researchers have implemented edge detection by designing decoding networks. Unlike existing methods, this paper is inspired by the effective mechanisms of edge detection in the parallel pathway of biological vision and proposes a new lightweight encoding–decoding structure for edge detection networks, which we refer to as XYW-Net. In the encoding network, we drew inspiration from the receptive field properties of X-type cells, Y-type cells, and W-type cells involved in the parallel pathway, and developed more meticulous convolutional models. Based on the structure of the parallel pathway, the three cell modules are combined into a novel encoding network and excellent feature extraction performance is obtained. Within the decoding network, this paper draws inspiration from the feature integration ability of the inferotemporal cortex (IT) and introduces a novel feature integration module to constitute the decoding network. Experiments show that the proposed network in this paper obtains the Optimal Dataset Scale (ODS) = 0.812 on the BSDS500 dataset with only 0.79 M parameters. Additionally, the model has exhibited outstanding ODS performance on various publicly available edge detection datasets, including NYUD, BIPEDv1, and Multicue. Moreover, future research could concentrate on implementing more efficient antagonistic mechanisms and devising networks grounded in higher-level visual cortical mechanisms. This could further augment the performance and efficiency of edge detection networks. We encourage researchers to delve into these directions within the field. The codes are available at https://github.com/PXinTao/XYW-Net. [ABSTRACT FROM AUTHOR]

The core of data series classification and clustering is how to evaluate the similarity between time series. However, for one-dimensional time series, the vast majority of similarity measurement methods currently relied on one-dimensional information. Although some classifications of time series were achieved by the images transformed from time series, they mostly relied on a single imaging mechanism (time domain or frequency domain). In order to give a new idea for time series similarity measurement, this paper proposed a similarity measurement method of time series based on the fused images. According to recurrence plots (RP) and wavelet scalogram (WS), the original time series was first transformed into images. Then, RP and WS were fused into an image. Next, the feature in the image was extracted by ResNet-18. Finally, the similarity of the time series can be obtained by the Euclidean distance between the features extracted by ResNet-18. The proposed method was verified by the time series from UCR Time Series Classification/Clustering Homepage. The results showed that the similarity measurement of time series can be effectively improved by fusing the images obtained by different imaging mechanisms in the time domain and frequency domain. • This paper proposes a new similarity measurement method for time series based on the image fusion of different forms. • The time domain and frequency domain information of time series are represented by recurrence plots and wavelet scalogram. • The characteristics of the image fused by recurrence plots and wavelet scalogram are extracted by Convolutional Neural Network to measure the similarity of time series. • 30 sets of time series show the validity and superiority of the proposed method. • The reasons for the effectiveness of the proposed method are analyzed in detail. [ABSTRACT FROM AUTHOR]

With the rapid expansion of the electric vehicle market, the demand for lithium-ion batteries (LIBs) is exploding. The state of health (SOH) of LIBs is receiving more widespread attention, which is the key parameter for battery health management. This paper proposes a SOH estimation method for LIBs via feature optimization and convolutional neural network (CNN) to reduce the information redundancy of existing multiple features, aimed at leveraging multiple sources of features while optimizing their combination to minimize redundancy. Firstly, multiple features are extracted from different perspectives, including electrical, thermodynamic, and electrochemical properties, to comprehensively characterize the aging of batteries. Secondly, we construct a SOH estimator based on principal component analysis (PCA) with CNN (PCA-CNN). Finally, the dimension of features is optimized with a simulated annealing algorithm (SA) under the mean-variance objective function. Moreover, Comparative experiments are conducted on the Oxford dataset for validation. The results demonstrate the effectiveness of the proposed multi-feature description method in terms of accuracy and smoothness. Compared to traditional CNN methods and fixed-dimension PCA-CNN, this estimation approach significantly improves performance, showing more than 20% and 30% increases in the key metrics of MAE and RMSE, respectively. This study successfully optimized feature combinations to reduce redundancy within the feature set while enhancing the accuracy of SOH estimation. [ABSTRACT FROM AUTHOR]

Longitudinal impulse, as a common dynamic problem of heavy haul trains, could induce the lateral instability of the coupler and the separation of the locomotive and wagon connection and thus seriously hinder the train running safety. The coupler force undergoes complex changes during longitudinal impulse transmission and exhibits strong nonlinear characteristics, which poses significant challenges to the identification of the coupler force. To address these issues, this paper reports a novel quantitative method for the coupler force identification of heavy haul locomotives. Firstly, the moving average filtering method is used to preprocess the signal of longitudinal relative displacement between the coupler and carbody (LRDCC), and the approximate relative velocity (ARV) feature is also extracted from the preprocessed signal. Then, a Convolutional Neural Network (CNN) model is constructed to extract high-level features from LRDCC and ARV. The model with randomly initialized weight parameters does not require additional training and thus reduces the computational cost. Finally, an Extreme Learning Machine (ELM) is used as the regression layer to process the extracted high-level features and further improve the identification performance. Additionally, the dung beetle algorithm is used to obtain the optimal model parameters to improve the coupler force identification performance. Not only a dynamics simulation but a field test is carried out to show that the proposed method could accurately detect the coupler force of heavy haul locomotives. Furthermore, the proposed method shows promising prospects in replacing the traditional monitoring method under the actual long-term working conditions of trains. • An indirect measurement scheme is proposed for coupler force dynamic identification. • The proposed network model presents high identification Accuracy and efficiency. • Method showcases strong generalization under complex, long-term train operations. [ABSTRACT FROM AUTHOR]

• Four different types of melt pool signals are integrated and fused to enhance the signal-to-defect correlation. • A data partitioning method is proposed to reduce registration errors and facilitate the defect-related feature extraction. • The feature-level fusion obtains the optimal classification performance compared with the other two fusion strategies. • The proposed data fusion method outperforms the individual signal-based methods for quality classification. In situ monitoring technologies for additive manufacturing are severely affected by signal-to-defect spatial registration, and a single monitoring solution that captures a specific process signature cannot identify defects with sufficient accuracy in industrial applications. In this paper, a data partitioning method was proposed to reduce registration errors and facilitate the extraction of defect-related representative features from data segments. Then, three multi-signal fusion methods based on convolutional neural networks were established from feature-level fusion, decision-level fusion, and data-level fusion, which enhanced the signal-to-defect correlation by means of complementary sensor information. The results showed that the feature-level fusion obtained the optimal classification performance compared with the other two fusion strategies. Among them, the classification accuracies of 100-, 150-, 200-, 300-, 400-, and 500-μm defects reached 74.41%, 89.84%, 90.82%, 93.95%, 97.85%, and 98.83%, respectively. The proposed data fusion approach outperformed the individual signal-based models for quality classification. [ABSTRACT FROM AUTHOR]

Implementing key engineering solutions to optimise the operation of energy industries requires daily electricity demand forecasting and including uncertainty, to promote markets insight analysis as part of their strategic planning, regulating and supplying electricity to consumers. This paper proposes hybrid artificial intelligence models combining convolutional neural networks (CNN) as a feature extraction algorithm with extreme learning machines (ELM) as a framework to predict electricity demand with confidence intervals generated by Kernel Density Estimation (KDE) approaches. In order to develop CELM-KDE model, time-lagged series of daily electricity demand with local climate variables based on the air temperature, atmospheric vapour pressure, evaporation, solar radiation, humidity and sea level pressures are used to train the proposed CELM-KDE hybrid model. In order to fully evaluate the newly developed model from a point-based, as well as a probabilistic prediction strategy, the observed and predicted electricity demand as well as the probability distribution of errors are analysed using KDE method that operates without prior data distribution assumptions. Based on observed and predicted electricity demand and the relevant probabilistic confidence intervals generated by the CELM-KDE model, the final results show that the proposed method attains significantly better probability interval predictions than traditionally-used point-based models. The proposed CELM-KDE model is demonstrated to be highly effective in providing a comprehensive coverage of predicted errors, as well as providing greater insights into the average bandwidth and detailed predicted electricity demand in the testing stage. The results also indicate that the proposed hybrid model is a reliable decision support tool to develop engineering solutions in area of energy modelling, monitoring and forecasting, which could potentially be useful to the industry policymakers. We show that the point-and probabilistic-based electricity demand predictive models can be employed as an effective tool to improve accuracy of forecasting and provision of insights for national electricity markets and key energy industry stakeholder application tools. [Display omitted] • A hybrid deep learning model for daily electricity demand prediction is proposed. • A Kernel Density Estimation is applied to derive probabilistic prediction intervals. • The algorithm quantifies uncertainties in point-based electricity demand predictions. • The proposed model outperforms deep learning models using statistical uncertainty indicators. [ABSTRACT FROM AUTHOR]

• LPSF module is designed to improve the gas features. • Collaborative attention is proposed for local and global gas features. • The feature compensation mechanism of CNN and Transformer is designed. • PSCFormer is proposed for gas recognition. Based on their powerful feature extraction capability, a convolutional neural network (CNN) has been gradually applied to gas identification in the electronic nose (e-nose) system. The responses of different intensities in the e-nose system are significantly correlated, and CNN extracts the local gas features by convolution while ignoring their global correlation. Transformer combines different responses and obtains the correlation between global features by self-attention. This paper proposes a lightweight hybrid network called Peak Search-based Convolutional Transformers (PSCFormer). First, combining the data characteristics of gas information, the Local Peak Search and Feature Fusion (LPSF) module is proposed to focus on the key gas features. Second, Transformer Encoder (TE) is proposed to obtain the global correlation between global features, and the parallel Convolution Encoder (CE) is proposed to capture the local dependence. Finally, a reasonable feature complementation mechanism is presented, and the preference of TE is alleviated for the slow-down response while solving the receptive field limitation of CE. This paper has evaluated three different datasets to validate the effectiveness of PSCFormer, all of which show stable and excellent performance with a good tradeoff between efficiency and complexity. The results prove that PSCFormer is an efficient and lightweight gas identification network, which provides a method to promote the engineering application of the e-nose system. [ABSTRACT FROM AUTHOR]

Data-driven fault diagnosis has become a hot topic of research in recent years, due to its wide applicability, high accuracy, and ease of modeling. In data-driven fault diagnosis, feature extraction is usually performed through a combination of one-dimensional time domain or frequency domain analysis methods. However, the constraints of data format and diagnostic methods give rise to three primary issues: inadequate utilization, expression, and mining of fault features, thereby impeding the broader application of data-driven methods. This paper presents a fault diagnosis framework that integrates cross-domain fusion images and a lightweight feature-enhanced network to address these issues. We leverage the temporal and frequency features of raw time series data, transforming them into images. This approach not only offers a greater amount of fault information but also highlights the inherent features more prominently. In terms of diagnosis methods, a novel feature-enhanced network model is proposed. This model takes images generated by a cross-domain image fusion module as inputs and then goes through a customized feature extraction module, a feature fusion module, a feature enhancement module, and a classification module to achieve high-precision and fast fault diagnosis. The effectiveness of this framework is validated on two publicly available datasets. The results show that the average accuracy of this fault diagnosis framework can reach 100%, surpassing the findings of existing research. The experiments on noise resistance further showcase the superiority of the proposed framework. It is expected that the framework presented in this study will provide a new perspective and direction for fault diagnosis. • Propose an innovative framework for precise fault diagnosis. • CFI images can translate fault information into texture and color features. • Differences between different faults can be better highlighted through CFI images. • Demonstrate the superiority of the framework through two distinct case studies. [ABSTRACT FROM AUTHOR]

• In MMG-based hand movement recognition, novel swarm intelligence algorithms (BES, GWO, SSA) were introduced to optimize SVM. • Based on hand-crafted feature extraction methods and a deep learning method, the performances of classification methods are compared in accuracy and time consumption. • Adopting GWO-SVM with TD + FD features can obtain good classification accuracy of eight classes of hand movements, up to 93.55 %, and take relatively less training time. On the basis of extracting mechanomyography (MMG) signal features, the classification of hand movements has certain application values in human-machine interaction systems and wearable devices. In this paper, pattern recognition of hand movements based on MMG signal is studied with swarm intelligence algorithms introduced to optimize support vector machine (SVM). Time domain (TD) features, wavelet packet node energy (WPNE) features, frequency domain (FD) features, convolution neural network (CNN) features were extracted from each channel to constitute different feature sets. Three novel swarm intelligence algorithms (i.e., bald eagle search (BES), sparrow search algorithm (SSA), grey wolf optimization (GWO)) optimized SVM is proposed to train the models and recognition of hand movements are tested for each MMG feature extraction method. Using GWO as the optimization algorithm, time consumption is less than using the other two swarm algorithms. Using GWO with TD+FD features can obtain the classification accuracy of 93.55 %, which is higher than other methods while using CNN to extract features can be independent of domain knowledge. The results confirm GWO-SVM with TD + FD features is superior to some other methods in the classification problem for tiny samples based on MMG. [ABSTRACT FROM AUTHOR]