Search

Document forgery is a significant issue in Korea, with around ten thousand cases reported every year. Analyzing paper plays a crucial role in examining questionable documents such as marketable securities and contracts, which can aid in solving criminal cases of document forgery. Paper analysis can also provide essential insights in other types of criminal cases, serving as an important clue for solving cases such as the source of a blackmail letter. The papermaking process generates distinct forming fabric marks and formations, which are critical features for paper classification. These characteristics are observable under transmitted light and are created by the forming fabric pattern and the distribution of pulp fibers, respectively. In this study, we propose a novel approach for paper identification based on hybrid features. This method combines texture features extracted from images converted using the gray‐level co‐occurrence matrix (GLCM) approach and a convolutional neural network (CNN), with another set of features extracted by the CNN using the same images as input. We applied the proposed method to classification tasks for seven major paper brands available in the Korean market, achieving an accuracy of 97.66%. The results confirm the applicability of this method for visually inspecting paper products and demonstrate its potential for assisting in solving criminal cases involving document forgery. [ABSTRACT FROM AUTHOR]

One of the pandemics that have caused many deaths is the Coronavirus disease 2019 (COVID-19). It first appeared in late 2019, and many deaths are increasing day by day until now. Therefore, the early diagnosis of COVID-19 has become a salient issue. Additionally, the current diagnosis methods have several demerits, and a new investigation is required to enhance the diagnosis performance. In this paper, a set of phases are performed, such as collecting data, filtering and augmenting images, extracting features, and classifying ECG images. The data were obtained from two publicly available ECG image datasets, and one of them contained COVID ECG reports. A set of preprocessing methods are applied to the ECG images, and data augmentation is performed to balance the ECG images based on the classes. A deep learning approach based on a convolutional neural network (CNN) is performed for feature extraction. Four different pre-trained models are applied, such as Vgg16, Vgg19, ResNet-101, and Xception. Moreover, an ensemble of Xception and the temporary convolutional network (TCN), which is named ECGConvnet, is proposed. Finally, the results obtained from the former models are fed to four main classifiers. These classifiers are softmax, random forest (RF), multilayer perception (MLP), and support vector machine (SVM). The former classifiers are used to evaluate the diagnosis ability of the proposed methods. The classification scenario is based on fivefold cross-validation. Seven experiments are presented to evaluate the performance of the ECGConvnet. Three of them are multi-class, and the remaining are binary class diagnosing. Six out of seven experiments diagnose COVID-19 patients. The aforementioned experimental results indicated that ECGConvnet has the highest performance over other pre-trained models, and the SVM classifier showed higher accuracy in comparison with the other classifiers. The resulting accuracies from ECGConvnet based on SVM are (99.74%, 98.6%, 99.1% on the multi-class diagnosis tasks) and (99.8% on one of the binary-class diagnoses, while the remaining achieved 100%). It is possible to develop an automatic diagnosis system for COVID based on deep learning using ECG data. [ABSTRACT FROM AUTHOR]

In the context of the Internet of Things, there is a growing demand for real-time monitoring of water distribution systems (WDS). Among the various leak detection methods, acoustic leak detection is considered to be a suitable method. However, existing methods are not very effective in environments with high daytime ambient noise. To address this issue, this paper conducted on-site data collection experiments and designed a monitoring system that combines traditional nighttime monitoring with daytime monitoring, combining water company pipeline inspections and repair work. A large number of daytime audio samples were collected. In this paper, the logarithmic spectrogram (log spectrogram) was used to represent the features of the leak signal. By comparing the features of the signal during day and night, noisy and quiet environments, and leak and normal signals, we identified the interfering frames that required noise reduction, and applied frame-level noise reduction processing to the signal. Based on this, a log PS-ResNet18 model was developed to identify leaks, and its performance was compared with other classification models [including traditional nighttime detection methods, random forests, XGBoost, and convolutional neural network (CNN)]. The results showed that the log PS-ResNet18 model had the best performance, with an all-day accuracy rate of 99.4% and a daytime accuracy rate of 99.3%. In addition, by conducting ablation experiments to explore the role and contribution of the log PS-ResNet18 and noise reduction methods in the model, the results showed that the log spectrogram and noise reduction methods increased the all-day accuracy rate by 18.8% and 23.2%, respectively, and by 24.7% when used together. In another practical application, the log PS-ResNet18 model achieved an all-day detection accuracy rate of 99.6%. This study demonstrated the applicability of the log spectrogram and CNN combination in daytime leak detection, overcoming research limitations in the field. This research presents the log PS-ResNet18 framework, which combines deep learning models and denoised logarithmic spectrograms to improve leak detection in water supply pipelines under daytime environmental noise. The research focuses on field data collection and analysis of cast iron pipes with different diameters in Hangzhou (HZ). The model was tested on cast iron pipes in Lishui (LS) and proved to be effective. The proposed method is highly versatile and can be applied to different regions and pipe materials after sufficient sample collection and model training validation. The research recommends a comprehensive leak monitoring solution that involves initial intelligent detection using front-end noise meters and secondary identification of suspicious audio signals using the log PS-ResNet18 model in the cloud. This enables water utility operators to respond quickly to pipeline leaks, leading to more efficient water resource conservation and improved water supply service quality. [ABSTRACT FROM AUTHOR]

Deep learning, a crucial technique for achieving artificial intelligence (AI), has been successfully applied in many fields. The gradual application of the latest architectures of deep learning in the field of time series forecasting (TSF), such as Transformers, has shown excellent performance and results compared to traditional statistical methods. These applications are widely present in academia and in our daily lives, covering many areas including forecasting electricity consumption in power systems, meteorological rainfall, traffic flow, quantitative trading, risk control in finance, sales operations and price predictions for commercial companies, and pandemic prediction in the medical field. Deep learning-based TSF tasks stand out as one of the most valuable AI scenarios for research, playing an important role in explaining complex real-world phenomena. However, deep learning models still face challenges: they need to deal with the challenge of large-scale data in the information age, achieve longer forecasting ranges, reduce excessively high computational complexity, etc. Therefore, novel methods and more effective solutions are essential. In this paper, we review the latest developments in deep learning for TSF. We begin by introducing the recent development trends in the field of TSF and then propose a new taxonomy from the perspective of deep neural network models, comprehensively covering articles published over the past five years. We also organize commonly used experimental evaluation metrics and datasets. Finally, we point out current issues with the existing solutions and suggest promising future directions in the field of deep learning combined with TSF. This paper is the most comprehensive review related to TSF in recent years and will provide a detailed index for researchers in this field and those who are just starting out. [ABSTRACT FROM AUTHOR]

Utilizing multi-modal data, as opposed to only hyperspectral image (HSI), enhances target identification accuracy in remote sensing. Transformers are applied to multi-modal data classification for their long-range dependency but often overlook intrinsic image structure by directly flattening image blocks into vectors. Moreover, as the encoder deepens, unprofitable information negatively impacts classification performance. Therefore, this paper proposes a learnable transformer with an adaptive gating mechanism (AGMLT). Firstly, a spectral–spatial adaptive gating mechanism (SSAGM) is designed to comprehensively extract the local information from images. It mainly contains point depthwise attention (PDWA) and asymmetric depthwise attention (ADWA). The former is for extracting spectral information of HSI, and the latter is for extracting spatial information of HSI and elevation information of LiDAR-derived rasterized digital surface models (LiDAR-DSM). By omitting linear layers, local continuity is maintained. Then, the layer Scale and learnable transition matrix are introduced to the original transformer encoder and self-attention to form the learnable transformer (L-Former). It improves data dynamics and prevents performance degradation as the encoder deepens. Subsequently, learnable cross-attention (LC-Attention) with the learnable transfer matrix is designed to augment the fusion of multi-modal data by enriching feature information. Finally, poly loss, known for its adaptability with multi-modal data, is employed in training the model. Experiments in the paper are conducted on four famous multi-modal datasets: Trento (TR), MUUFL (MU), Augsburg (AU), and Houston2013 (HU). The results show that AGMLT achieves optimal performance over some existing models. [ABSTRACT FROM AUTHOR]

In this paper, a fusion model based on convolution and self-attention with multi-subimage input model (CNN-SA-MS) is proposed to estimate significant wave height (SWH) from shipborne X-band radar images. The model takes multiple radar subimages as input simultaneously, which not only improves the accuracy of SWH inversion by including more information, but also avoids the restriction of selecting a single subimage in the upwind direction and dependence on external devices for wind data provision. Based on the characteristics of radar images and computational efficiency considerations, this paper selects three radar subimages as the input for the model. The comparison data from buoys and ECMWF are used for training and testing. After averaging the results of 64 radar images, the root mean square error (RMSE) and correlation coefficient (CC) of the CNN-SA-MS model are 0.197 m and 0.903, respectively. The results show that the CNN-SA-MS model improves the accuracy and stability of SWH estimation compared to single-subimage CNN regression model. For the two time periods with significant discrepancies between radar data and ECMWF predictions, we introduce satellite altimeter information as a source of reference for evaluation. The resulting analysis indicates that the significant wave height estimates generated by CNN-SA-MS model are more reliable. [ABSTRACT FROM AUTHOR]

This paper proposes a convolutional neural network (CNN) model of the signal distribution control algorithm (SDCA) to maximize the dynamic vehicular traffic signal flow for each junction phase. The aim of the proposed algorithm is to determine the reward value and new state. It deconstructs the routing components of the current multi-directional queuing system (MDQS) architecture to identify optimal policies for every traffic scenario. Initially, the state value is divided into a function value and a parameter value. Combining these two scenarios updates the resulting optimized state value. Ultimately, an analogous criterion is developed for the current dataset. Next, the error or loss value for the present scenario is computed. Furthermore, utilizing the Deep Q-learning methodology with a quad agent enhances previous study discoveries. The recommended method outperforms all other traditional approaches in effectively optimizing traffic signal timing. [ABSTRACT FROM AUTHOR]

Breast cancer, a widespread global disease, represents a significant threat to women's health and lives. Many researchers have proposed computer-aided diagnosis systems for classifying breast cancer. The majority of the approaches primarily utilize deep learning methods, which overlook the crucial necessity of incorporating both local information for precise tumor detection. In addition, available breast cancer datasets are imbalanced in nature. Therefore, this paper presents the hybrid breast network (HBNet) for detection of breast cancer, designed to address two critical challenges: class imbalance and incorporation of both global and local information in achieving precise tumor classification. To overcome the problem of class imbalance, HBNet incorporates the borderline synthetic minority oversampling technique. Simultaneously, it employs a feature fusion approach to combine deep and handcrafted features extracted by utilizing ResNet50 and HOG which incorporates global and local information. Moreover, the proposed method integrates the block-matching and 3D denoising filter to effectively eliminate multiplicative noise that has enhanced the performance of the system. The proposed HBNet is evaluated with BUSI and UDIAT datasets and achieved an average accuracy of 95.824% and 90.37%, respectively. [ABSTRACT FROM AUTHOR]

In recent years, deep learning methods have achieved remarkable success in hyperspectral image classification (HSIC), and the utilization of convolutional neural networks (CNNs) has proven to be highly effective. However, there are still several critical issues that need to be addressed in the HSIC task, such as the lack of labeled training samples, which constrains the classification accuracy and generalization ability of CNNs. To address this problem, a deep multi-scale attention fusion network (DMAF-NET) is proposed in this paper. This network is based on multi-scale features and fully exploits the deep features of samples from multiple levels and different perspectives with an aim to enhance HSIC results using limited samples. The innovation of this article is mainly reflected in three aspects: Firstly, a novel baseline network for multi-scale feature extraction is designed with a pyramid structure and densely connected 3D octave convolutional network enabling the extraction of deep-level information from features at different granularities. Secondly, a multi-scale spatial–spectral attention module and a pyramidal multi-scale channel attention module are designed, respectively. This allows modeling of the comprehensive dependencies of coordinates and directions, local and global, in four dimensions. Finally, a multi-attention fusion module is designed to effectively combine feature mappings extracted from multiple branches. Extensive experiments on four popular datasets demonstrate that the proposed method can achieve high classification accuracy even with fewer labeled samples. [ABSTRACT FROM AUTHOR]

Photovoltaics (PV), which is one of variable renewable energies, have been installed largely. In the environment of largely installed PV, the output fluctuates of PV influences on the operation of power gird network adversely. Therefore, PV energy generation forecasting is valid for power grid operation and management and needs the reduction of large forecast error as well as average error. Due to a day‐ahead forecast of the total PV energy generation in the power grid area, we developed the forecasting method by using meteorological forecast data of many points in the target area. In order to forecast the regional PV energy generation, the proposed method uses auto‐encoder and convolutional neural network (CNN) for extracting requirements and valid data, and forecast with neural network (NN) by means of extracted information. In this paper, we improved the forecasting error by using multiple meteorological elements as input data. As a result, we indicated that using both of global horizontal irradiance and low cloud cover is required for the reginal PV energy generation forecasting, and large forecasting error can be reduced by adding either dew point depression, or cumulative precipitation as input data. © 2024 Institute of Electrical Engineer of Japan and Wiley Periodicals LLC. [ABSTRACT FROM AUTHOR]

Background: Accurate segmentation of brain glioma is a critical prerequisite for clinical diagnosis, surgical planning and treatment evaluation. In current clinical workflow, physicians typically perform delineation of brain tumor subregions slice‐by‐slice, which is more susceptible to variabilities in raters and also time‐consuming. Besides, even though convolutional neural networks (CNNs) are driving progress, the performance of standard models still have some room for further improvement. Purpose: To deal with these issues, this paper proposes an attention‐guided multi‐scale context aggregation network (AMCA‐Net) for the accurate segmentation of brain glioma in the magnetic resonance imaging (MRI) images with multi‐modalities. Methods: AMCA‐Net extracts the multi‐scale features from the MRI images and fuses the extracted discriminative features via a self‐attention mechanism for brain glioma segmentation. The extraction is performed via a series of down‐sampling, convolution layers, and the global context information guidance (GCIG) modules are developed to fuse the features extracted for contextual features. At the end of the down‐sampling, a multi‐scale fusion (MSF) module is designed to exploit and combine all the extracted multi‐scale features. Each of the GCIG and MSF modules contain a channel attention (CA) module that can adaptively calibrate feature responses and emphasize the most relevant features. Finally, multiple predictions with different resolutions are fused through different weightings given by a multi‐resolution adaptation (MRA) module instead of the use of averaging or max‐pooling to improve the final segmentation results. Results: Datasets used in this paper are publicly accessible, that is, the Multimodal Brain Tumor Segmentation Challenges 2018 (BraTS2018) and 2019 (BraTS2019). BraTS2018 contains 285 patient cases and BraTS2019 contains 335 cases. Simulations show that the AMCA‐Net has better or comparable performance against that of the other state‐of‐the‐art models. In terms of the Dice score and Hausdorff 95 for the BraTS2018 dataset, 90.4% and 10.2 mm for the whole tumor region (WT), 83.9% and 7.4 mm for the tumor core region (TC), 80.2% and 4.3 mm for the enhancing tumor region (ET), whereas the Dice score and Hausdorff 95 for the BraTS2019 dataset, 91.0% and 10.7 mm for the WT, 84.2% and 8.4 mm for the TC, 80.1% and 4.8 mm for the ET. Conclusions: The proposed AMCA‐Net performs comparably well in comparison to several state‐of‐the‐art neural net models in identifying the areas involving the peritumoral edema, enhancing tumor, and necrotic and non‐enhancing tumor core of brain glioma, which has great potential for clinical practice. In future research, we will further explore the feasibility of applying AMCA‐Net to other similar segmentation tasks. [ABSTRACT FROM AUTHOR]

Hyperspectral images' (HSIs) classification research has seen significant progress with the use of convolutional neural networks (CNNs) and Transformer blocks. However, these studies primarily incorporated Transformer blocks at the end of their network architectures. Due to significant differences between the spectral and spatial features in HSIs, the extraction of both global and local spectral–spatial features remains incomplete. To address this challenge, this paper introduces a novel method called TransHSI. This method incorporates a new spectral–spatial feature extraction module that leverages 3D CNNs to fuse Transformer to extract the local and global spectral features of HSIs, then combining 2D CNNs and Transformer to capture the local and global spatial features of HSIs comprehensively. Furthermore, a fusion module is proposed, which not only integrates the learned shallow and deep features of HSIs but also applies a semantic tokenizer to transform the fused features, enhancing the discriminative power of the features. This paper conducts experiments on three public datasets: Indian Pines, Pavia University, and Data Fusion Contest 2018. The training and test sets are selected based on a disjoint sampling strategy. We perform a comparative analysis with 11 traditional and advanced HSI classification algorithms. The experimental results demonstrate that the proposed method, TransHSI algorithm, achieves the highest overall accuracies and kappa coefficients, indicating a competitive performance. [ABSTRACT FROM AUTHOR]

Rock images play a vital role in providing data for engineering geological studies. However, low-light (a.k.a. dark) rock images are often obtained, and the existing methods for image enhancement, whether they are software-based, algorithm-based, or data-driven-based, are incapable of addressing the issue. This paper establishes a novel unsupervised deep learning (DL) model that caters to low-light rock image enhancement. The light enhancement process is carried out automatically and pixel-wise by utilizing the deep curve estimation (DCE) algorithm and a convolutional neural network (CNN). This study establishes a rock image dataset, encompassing diverse (1) rock types (tuff, siltstone, & granite groups), (2) light levels (2400 lx, 1200 lx, &100 lx), (3) color temperatures (5500 K, 4200 K, & 3000 K), and (4) surface conditions (wet & dry). The novel DL model is developed based on (1) high-order curves of the DCE algorithm, (2) an elaborate CNN architecture with step-wise convolutions and a squeeze and excitation module, (3) three non-reference loss functions, and (4) an alerting level for better generalization. The DL model possesses several advantageous features: (1) automatic light enhancement of rock images without subjective inputs, (2) independence from paired data, which requires manual retouching, (3) pixel-wise adjustment of intensities across color channels, (4) preservation of rock details without distortion by the attention mechanism, (5) high inference speeds, e.g., ~ 3 ms per rock image, and (6) most importantly, state-of-the-art performance when compared to 10 other widely-used enhancement methods, both visually and quantitatively, by three evaluation indices. Despite being designed and trained for rock images, the DL model also demonstrates impressive performance on non-rock images. Highlights: This study establishes a rock image dataset, encompassing diverse rock types, light levels, color temperatures, and surface conditions. This paper establishes a novel unsupervised deep learning (DL) model that caters to low-light rock image enhancement, automatically and pixel-wise. The DL model achieves state-of-the-art performance in enhancing low-light rock images when compared to 10 other widely-used light enhancement methods, both visually and quantitatively. [ABSTRACT FROM AUTHOR]

Aiming at the high computational cost of traditional compressed sensing algorithms, this paper proposed a sparse imaging algorithm based on depth expansion model from the perspective of sparse signal recovery. Firstly, it constructed a complex sparse reconstruction network VAMP-Net. In VAMP-Net, it divided complex regressive echo signal into real part and imaginary part as input. Secondly, it substituted the input into the iterative block based on VAMP algorithm. Finally, it carried out the optimal nonlinear sparse transformation by convolutional neural module to obtain the recovered real part and imaginary part signals, and then merged them to obtain the restored target image. As for the proposed algorithm, this paper used artificial data sets to conduct simulation experiments under different target density, iteration times and noise environment, and compared with the traditional iterative shrinkage threshold algorithm and deep learning reconstruction algorithm. Then it used the measured data with different sparsity for field measurement verification. Experimental results show that the image reconstructed by this algorithm has better performance in NMSE, TBR, reconstruction speed and memory usage. [ABSTRACT FROM AUTHOR]

Accurate SARS-CoV-2 screening is made possible by automated Computer-Aided Diagnosis (CAD) which reduces the stress on healthcare systems. Since Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) is highly contagious, the transition chain can be broken through an early diagnosis by clinical knowledge and Artificial Intelligence (AI). Manual findings are time and labor-intensive. Even if Reverse Transcription-Polymerase Chain Reaction (RT-PCR) delivers quick findings, Chest X-ray (CXR) imaging is still a more trustworthy tool for disease classification and assessment. Several studies have been conducted using Deep Learning (DL) algorithms for COVID-19 detection. One of the biggest challenges in modernizing healthcare is extracting useful data from high-dimensional, heterogeneous, and complex biological data. Intending to introduce an automated COVID-19 diagnosis model, this paper develops a proficient optimization model that enhances the classification performance with better accuracy. The input images are initially pre-processed with an image filtering approach for noise removal and data augmentation to extend the dataset. Secondly, the images are segmented via U-Net and are given to classification using the Fused U-Net Convolutional Neural Network (FUCNN) model. Here, the performance of U-Net is enhanced through the modified Moth Flame Optimization (MFO) algorithm named Chaotic System-based MFO (CSMFO) by optimizing the weights of U-Net. The significance of the implemented model is confirmed over a comparative evaluation with the state-of-the-art models. Specifically, the proposed CSMFO-FUCNN attained 98.45% of accuracy, 98.63% of sensitivity, 98.98% of specificity, and 98.98% of precision. [ABSTRACT FROM AUTHOR]

Recent advances in artificial intelligence have opened up new avenues for microstructure characterization, notably in metallic materials. Physical and mechanical properties generally depend on the microstructure of the metallic material. On the other hand, microstructural characterization takes time and calls for specific techniques that don't always lead to conclusive results quickly. To address this issue, this research focuses on the application of artificial intelligence approaches to microstructural categorization. We demonstrate the advantages of the AI approach using an example of Al-Si alloy, a material that is widely employed in a variety of industries. To specify a suitable convolutional neural network (CNN) approach for the microstructural classification of the Al-Si alloy, CNN models were trained and compared using DenseNet201, Inception v3, InceptionResNetV2, ResNet152V2, VGG16, and Xception architectures. Resulting from the comparison, it was determined that the developed supervised transfer learning model can execute the microstructural classification of Al-Si alloy microstructural images. This paper is an attempt to advance methods of microstructure recognition/classification/characterization by using Deep Learning approaches. The significance of the established model is demonstrated and its accordance with the literature data. Also, necessity is shown of developing material models and optimization through systematic microstructural investigation, production conditions, and material attributes. [ABSTRACT FROM AUTHOR]

Real-time monitoring of transient stability has gained significant importance in the power system. This paper proposes an advanced hybrid Transient Stability Assessment (TSA) monitoring system, composed of a Convolutional Neural Network (CNN) and Random Forest (RF) classifier which captures the PMU measurements in real-time. CNN utilizes heatmaps for detecting the transient stability status which is hereby used as a feature extractor for the RF classifier. The IEEE-14 and the IEEE-39 bus systems are used as case studies in MATLAB. A wind turbine with a doubly-fed induction generator is also installed to inspect its impact on the power system stability. The efficiency of the system is tested under different contingency scenarios by implementing various faults on distinct locations under dynamic loading conditions. The test results verified that the proposed hybrid CNN-RF (Convolutional Neural Network-Random Forest) model exhibited excellent results in terms of monitoring accuracy, higher precision, and performance in the presence of noise. [ABSTRACT FROM AUTHOR]

Nowadays, automatic human activity recognition from video images is necessary for monitoring applications and caring for disabled people. The use of surveillance cameras and the processing of the obtained images leads to the achievement of a smart, accurate system for the recognition of human behavior. Since human detection in different scenes is associated with many challenges, several approaches have been implemented to detect human activity from video image processing. Due to the complexity of human activities, background noises and other factors affect the detection. For the solution of these problems, two deep learning-based algorithms have been described in the current article. According to the convolutional neural networks, the LSTM + CNN method and the 3D CNN method have been used to recognize the human activities in the images of the video. Each algorithm is explained and analyzed in detail. The experiments designed in this paper are performed by two datasets: the HMDB-51 dataset and the UCF101 dataset. In the HMDB-51 dataset, the highest obtained accuracy for CNN + LSTM method was equal to 70.2 and for method 3D CNN equal to 54.4. In the UCF101 dataset, the highest obtained accuracy for CNN + LSTM method was equal to 95.1 and for method 3D CNN equal to 90.8. [ABSTRACT FROM AUTHOR]

Recently, convolutional neural network (CNN) and Transformer have been successfully applied in hyperspectral image (HSI) classification. Despite their success, some challenges persist. Popular HSI classification methods typically employ only a single patch as the network input, which may not provide robust information for various datasets or within different scenarios of a specific dataset. Large-scale patches are usually conducive to classifying large-scale scenes, while small-scale patches excel at classifying boundary locations. In addition, the majority of methods do not distinguish between the central pixel and its adjacent pixels, although the information from the central position is crucial. In this paper, a novel double-branch hierarchical partial convolution network (DBHP-Net) is proposed to address the aforementioned challenges. Concretely, DBHP-Net employs a new convolution, named TConv, to emphasize mining the spatial-channel features of the central position. Then, the TConvFormer Block is built by adopting the advanced engineering techniques of Transformer. Furthermore, we construct our model in a hierarchical style. The double-branch structure with large-scale and small-scale patches provides complementary information from the dataset. Experimental results based on randomly selected samples and spatially disjoint samples of two benchmark datasets demonstrate that our method outperforms other state-of-the-art (SOTA) methods. [ABSTRACT FROM AUTHOR]

Removing adverse weather conditions from images, such as haze, fog, rain, and snowfall, is a significant issue in several scenarios. Many techniques have been described in the literature that only involve removing specific types of adverse weather degradation. A convolutional neural network (CNN)-based all-in-one dehaze network was recently presented to remove all adverse weather conditions. But, this method contains many variables because it employs many encoder blocks for each adverse weather removal operation, and its efficiency still has to be improved. This paper concentrates on creating an effective solution to remove adverse weather from the foggy and rainy real-time images. The proposed research presented a single encoder–decoder-based transformer fusion with a multi-head attention module for real-time image dehazing. Also, the proposed method introduces a separated patches module fusion with a deep residual attention module to improve the different weather degradation problems and minimize the feature loss of degraded pixels in the transformer encoder block. The proposed method is validated and tested on real-time foggy and rainy images. The qualitative and quantitative evaluation demonstrates that the proposed method is more efficient than other methods. [ABSTRACT FROM AUTHOR]

A fault in a power system is an anomalous state that must be recognized as soon as feasible. To minimize the repercussions of the fault, such as damages occurred to the device, loss of tangible assets and loss of human resources, it is critical to notice the problem promptly. In a power distribution system, there are several approaches for detecting different types of faults. In this paper, a neoteric approach using Bayesian optimized Convolutional Neural Network is used to detect and classify different symmetrical as well as unsymmetrical faults in power distribution systems. The effectiveness of the proposed CNN model is validated for an IEEE 13 bus radial distribution system grid modeled (and simulated) in PSCAD. Time series of the measured 3-phase fault currents (for eleven different categories of faults) are used to create training & testing data. This data has been imported in MATLAB software to develop a CNN classifier (whose hyper-parameters are optimized by using a Bayesian optimizer) for faults in power distribution system, under distinct fault situations by varying fault resistance, faulty node and fault inception angles. Findings of simulation clearly indicate that proposed model has very high categorizing accuracy and is superior and competitive to other techniques available in literature. [ABSTRACT FROM AUTHOR]

Tomato crop yield can be negatively impacted by various diseases and pests. The application of computer vision to diagnose tomato diseases and pests presents two significant challenges. Firstly, the collected dataset of tomato pests and diseases is often imbalanced, leading to poor model performance. Secondly, mainstream models struggle to balance the relationship between training efficiency and accuracy. In this paper, we propose a novel method for diagnosing tomato pests and diseases using a lightweight network. Specifically, we develop Squeeze and SE Net (SSNet), a new convolutional neural network (CNN) based on SqueezeNet and SENet. We evaluate the performance of SSNet through comparative experiments for diagnosing tomato pests and diseases. Additionally, we examine the impact of dataset balance, data volume, and hyperparameters on model performance. Our results demonstrate that SSNet achieves model accuracies of 98.80% and 98.39% for tomato pests and diseases, respectively, with only 0.398 M parameters. This approach provides a promising and lightweight alternative to existing models. [ABSTRACT FROM AUTHOR]

Deep learning (DL) networks are a popular choice for short-term load forecasting (STLF) in the residential sector. Hybrid DL methodologies based on convolutional neural networks (CNNs) and long short-term memory networks (LSTMs) have a higher forecasting accuracy than conventional statistical STLF techniques for different types of single-household load series. However, existing load forecasting methodologies are often inefficient when a high load demand persists for a few hours in a day. Peak load consumption is explicitly depicted as a tail in the probability distribution function (PDF) of the load series. Due to the diverse and uncertain nature of peak load demands, DL methodologies have difficulty maintaining consistent forecasting results, particularly when the PDF of the load series has a longer tail. This paper proposes a multihousehold load forecasting strategy based on the collective moment measure (CMM) (which is obtained from the PDF of the load series), data augmentation, and a CNN. Each load series was compared and ordered through CMM indexing, which helped maintain a minimum or constant shifting variance in the dataset inputted to the CNN. Data augmentation was used to enlarge the input dataset and solve the existing data requirement issues of the CNN. With the ordered load series and data augmentation strategy, the simulation results demonstrated a significant improvement in the performance of both single-household and multihousehold load forecasting. The proposed method predicts day-ahead multihousehold loads simultaneously and compares the results based on a single household. The forecasting performance of the proposed method for six different household groups with 10, 20, 30, 50, 80, and 100 household load series was evaluated and compared with those of existing methodologies. The mean absolute percentage error of the prediction results for each multihousehold load series could be improved by more than 3%. This study can help advance the application of DL methods for household load prediction under high-load-demand conditions. [ABSTRACT FROM AUTHOR]

The monitoring of the lifetime of cutting tools often faces problems such as life data loss, drift, and distortion. The prediction of the lifetime in this situation is greatly compromised with respect to the accuracy. The recent rise of deep learning, such as Gated Recurrent Unit Units (GRUs), Hidden Markov Models (HMMs), Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), Attention networks, and Transformers, has dramatically improved the data problems in tool lifetime prediction, substantially enhancing the accuracy of tool wear prediction. In this paper, we introduce a novel approach known as PCHIP-Enhanced ConvGRU (PECG), which leverages multiple—feature fusion for tool wear prediction. When compared to traditional models such as CNNs, the CNN Block, and GRUs, our method consistently outperformed them across all key performance metrics, with a primary focus on the accuracy. PECG addresses the challenge of missing tool wear measurement data in relation to sensor data. By employing PCHIP interpolation to fill in the gaps in the wear values, we have developed a model that combines the strengths of both CNNs and GRUs with data augmentation. The experimental results demonstrate that our proposed method achieved an exceptional relative accuracy of 0.8522, while also exhibiting a Pearson's Correlation Coefficient (PCC) exceeding 0.95. This innovative approach not only predicts tool wear with remarkable precision, but also offers enhanced stability. [ABSTRACT FROM AUTHOR]

Standardized morphological evaluation in pathology is usually qualitative. Classifying and qualitatively analyzing the nucleated cells in the bone marrow aspirate images based on morphology is crucial for the diagnosis of acute myoid leukemia (AML), acute lymphoblastic leukemia (ALL), and Myelodysplastic syndrome (MDS), etc. However, it is time-consuming and difficult to accurately identify nucleated cells and calculate the percentage of the cells because of the complexity of bone marrow aspirate images. This paper proposed a deep learning analysis model of bone marrow aspirate images, termed Cell Detection and Confirmation Network (CDC-NET), for the aided diagnosis of AML by improving the accuracy of cell detection and recognition. Specifically, we take the nucleated cells in the bone marrow aspirate images as the detection objects to establish the model. Since some cells from different categories have similar morphology, classification error is inevitable. We design a confirmation network in which multiple trained classifiers work as pathologists to confirm the cell category by a voting method. To demonstrate the effectiveness of the proposed approach, experiments on clinical microscopic datasets are conducted. The Recall and Precision of CDC-NET are 78.54% and 91.74% respectively, and the missed rate of our method is lower than those of the other popular methods. The experimental results demonstrated that the proposed model has the potential for the pathological analysis of aspirate smears and the aided diagnosis of AML. [ABSTRACT FROM AUTHOR]

Brain–computer interfaces (BCIs) based on motor imagery (MI) enable the disabled to interact with the world through brain signals. To meet demands of real-time, stable, and diverse interactions, it is crucial to develop lightweight networks that can accurately and reliably decode multi-class MI tasks. In this paper, we introduce BrainGridNet, a convolutional neural network (CNN) framework that integrates two intersecting depthwise CNN branches with 3D electroencephalography (EEG) data to decode a five-class MI task. The BrainGridNet attains competitive results in both the time and frequency domains, with superior performance in the frequency domain. As a result, an accuracy of 80.26 percent and a kappa value of 0.753 are achieved by BrainGridNet, surpassing the state-of-the-art (SOTA) model. Additionally, BrainGridNet shows optimal computational efficiency, excels in decoding the most challenging subject, and maintains robust accuracy despite the random loss of 16 electrode signals. Finally, the visualizations demonstrate that BrainGridNet learns discriminative features and identifies critical brain regions and frequency bands corresponding to each MI class. The convergence of BrainGridNet's strong feature extraction capability, high decoding accuracy, steady decoding efficacy, and low computational costs renders it an appealing choice for facilitating the development of BCIs. [ABSTRACT FROM AUTHOR]

Mechanical fault diagnosis can prevent the deterioration of mechanical equipment failures and is important for the stable operation of mechanical equipment. Firstly, this paper reviews three basic methods of fault diagnosis and common methods of data-driven fault diagnosis, focusing on the characteristics and advantages of deep learning and convolutional neural networks. Then, the basic structure and working principle of CNN (Convolutional Neural Networks) and some basic methods to achieve better training results are introduced. In the next place, from data processing, data fusion, sample set construction, and so on, it is reviewed that the method of fault diagnosis based on CNN and their application scenarios and advantages and disadvantages; for another, the related knowledge and concepts of transfer learning are introduced, and some current application scenarios and advantages and disadvantages of mechanical fault diagnosis techniques combining migration learning and convolutional neural networks are reviewed. Finally, the current difficulties and challenges of convolutional neural networks are discussed, and the research directions have been prospected for CNN applied to the field of fault diagnosis. Although there is quite some similar literature reviewed, this review aims to introduce the basic methods of fault diagnosis, which draw forth the basic applications of the fault diagnosis of data-driven, CNN in the domain of fault diagnosis, and the application scenarios and advantages and disadvantages of combining TL (Transfer Learning) and CNN in fault diagnosis, as well as some problems and prospects. It helps researchers to have a basic understanding of this. [ABSTRACT FROM AUTHOR]

In recent years, radar emitter signal recognition has enjoyed a wide range of applications in electronic support measure systems and communication security. More and more deep learning algorithms have been used to improve the recognition accuracy of radar emitter signals. However, complex deep learning algorithms and data preprocessing operations have a huge demand for computing power, which cannot meet the requirements of low power consumption and high real-time processing scenarios. Therefore, many research works have remained in the experimental stage and cannot be actually implemented. To tackle this problem, this paper proposes a resource reuse computing acceleration platform based on field programmable gate arrays (FPGA), and implements a one-dimensional (1D) convolutional neural network (CNN) and long short-term memory (LSTM) neural network (NN) model for radar emitter signal recognition, directly targeting the intermediate frequency (IF) data of radar emitter signal for classification and recognition. The implementation of the 1D-CNN-LSTM neural network on FPGA is realized by multiplexing the same systolic array to accomplish the parallel acceleration of 1D convolution and matrix vector multiplication operations. We implemented our network on Xilinx XCKU040 to evaluate the effectiveness of our proposed solution. Our experiments show that the system can achieve 7.34 giga operations per second (GOPS) data throughput with only 5.022 W power consumption when the radar emitter signal recognition rate is 96.53%, which greatly improves the energy efficiency ratio and real-time performance of the radar emitter recognition system. [ABSTRACT FROM AUTHOR]

In the analysis of agricultural product price time series, the detection of abnormal fluctuations is the primary task. Accurately judging the abnormal fluctuations of agricultural product prices can help farmers avoid potential economic losses in a timely manner and improve the circulation efficiency of agricultural products. This paper introduces a convolutional neural network (CNN) classification model based on time series images (TSI), and identifies abnormal fluctuations in agricultural product prices using improved standard deviation–slope judgment. First, a standard deviation–slope (SDS) time series abnormal fluctuation criterion is proposed. Second, the Markov Transfer Field (MTF) method is used to convert the sparse one-dimensional time series of agricultural product prices into a two-dimensional dense image. Third, the CNN model is used to automatically extract features from time series images containing abnormal fluctuations, and they are divided into two categories: "normal" and "abnormal"; Finally, the performance of the proposed model was evaluated using China's corn and wheat price dataset. Comparing with other abnormal fluctuation judgment methods, the accuracy of the proposed algorithm is about 20% higher on average. This confirms the applicability of the standard deviation–slope time series Image-Resnet-34 (SDS-TSI-Resnet34) model in practical scenarios. At the end of the paper, some feasible suggestions for the efficient development of agricultural economy are proposed based on the abnormal fluctuation judgment method. [ABSTRACT FROM AUTHOR]

The prediction of wildfire spreading is necessary for managing and fighting the forest fire. The traditional models require higher accuracy of the input parameters, which is impossible in real forest fires. The paper proposed a fire-spreading model based on the dynamic data of the fire field to improve its adaptability. The model is designed using a convolutional neural network with mixed-inputs and attention mechanisms (MI-AM-CNN). It predicts the burn map after a period of time through the multiple-channel image containing terrain variables and the current burn map, and the scalars containing climate variables. The channel and spatial attention modules are integrated to handle the advanced features that contain important fire variables information and strengthen the influence of important features on the prediction. Based on the FARSITE, a large number of data sets are generated for training, validating, and testing the models in the paper. The proposed model MI-AM-CNN is compared with the state-of-the-art neural network models. Quantitative results show that MI-AM-CNN has the highest performance in predicting effectiveness and efficiency, and it can be applied recursively to get the continuous predicted results. In addition, the prediction results of MI-AM-CNN on the historical fire data demonstrate the ability of its application in the real fire case. The MI-AM-CNN can be used as a predictive method in firefighting operations, and its predicted results can provide theoretical support for the forest fire spread prediction method based on artificial intelligence. [ABSTRACT FROM AUTHOR]

This paper presents a highly configurable and low-complexity CNN accelerator based on the MobileNetV3 model. To the best of authors' knowledge, this is the first design of CNN accelerator based on the MobileNetV3 model. A highly efficient processing flow and memory-access scheme are proposed in this paper so that the throughput is greatly enhanced for the structural features in MobileNetV3 model. Furthermore, the proposed processing flow enhances the efficiency for the utilization of hardware components to reduce the complexity. Based on the proposed processing flow, this paper presents a highly configurable architecture to support various operation modes in MobileNetV3 model. The designed architecture is synthesized and layout with TSMC 90 nm technology. The evaluations for the performance and area complexity are conducted based on the post-layout estimations. It is shown in this paper that the performance of 197.7 FPS is achieved with the hardware complexity of 5392 KGEs for the MobileNetV3-Large. Compared to the state-of-the-art accelerator based on MobileNet, the FPS of the proposed design is improved by 3.4 × and the complexity is reduced by 18%. [ABSTRACT FROM AUTHOR]

In order to more effectively monitor and interfere with enemy signals, it is particularly important to accurately and efficiently identify the intercepted signals and estimate their parameters in the increasingly complex electromagnetic environment. Therefore, in non-cooperative situations, it is of great practical significance to study how to accurately detect direct sequence spread spectrum (DSSS) signals in real time and estimate their parameters. The traditional time-delay correlation algorithm encounters the challenges such as peak energy leakage and false peak interference. As an alternative, this paper introduces a Pseudo-Noise (PN) code period estimation method utilizing a one-dimensional (1D) convolutional neural network based on the residual network (CNN-ResNet). This method transforms the problem of spread spectrum code period estimation into a multi-classification problem of spread spectrum code length estimation. Firstly, the In-phase/Quadrature(I/Q) two-way of the received DSSS signals is directly input into the CNN-ResNet model, which will automatically learn the characteristics of the DSSS signal with different PN code lengths and then estimate the PN code length. Simulation experiments are conducted using a data set with DSSS signals ranging from −20 to 10 dB in terms of signal-to-noise ratios (SNRs). Upon training and verifying the model using BPSK modulation, it is then put to the test with QPSK-modulated signals, and the estimation performance was analyzed through metrics such as loss function, accuracy rate, recall rate, and confusion matrix. The results demonstrate that the 1D CNN-ResNet proposed in this paper is capable of effectively estimating the PN code period of the non-cooperative DSSS signal, exhibiting robust generalization abilities. [ABSTRACT FROM AUTHOR]

With the wide application of direct sequence spread spectrum (DSSS) signals, the comprehensive performance of DSSS communication systems has been continuously improved, making the electronic reconnaissance link in communication countermeasures more difficult. Electronic reconnaissance technology, as the fundamental means of modern electronic warfare, mainly includes signal detection, recognition, and parameter estimation. At present, research on DSSS detection algorithms is mostly based on the correlation characteristics of DSSS signals, and autocorrelation algorithm is the most mature and widely used method in practical engineering. With the continuous development of deep learning, deep-learning-based methods have gradually been introduced to replace traditional algorithms in the field of signal processing. This paper proposes a spread spectrum signal detection method based on convolutional neural network (CNN). Through experimental analysis, the detection performance of the CNN model proposed in this paper on DSSS signals in various situations has been compared and analyzed with traditional autocorrelation detection methods for different signal-to-noise ratios. The experiments verified the estimation performance of the model in this paper under different signal-to-noise ratios, different spreading code lengths, different spreading code types, and different modulation methods and compared it with the autocorrelation detection algorithm. It was found that the detection performance of the model in this paper was higher than that of the autocorrelation detection method, and the overall performance was improved by 4 dB. [ABSTRACT FROM AUTHOR]

In the field of image fusion, spatial detail blurring and color distortion appear in synthetic aperture radar (SAR) images and multispectral (MS) during the traditional fusion process due to the difference in sensor imaging mechanisms. To solve this problem, this paper proposes a fusion method for SAR images and MS images based on a convolutional neural network. In order to make use of the spatial information and different scale feature information of high-resolution SAR image, a dual-channel feature extraction module is constructed to obtain a SAR image feature map. In addition, different from the common direct addition strategy, an attention-based feature fusion module is designed to achieve spectral fidelity of the fused images. In order to obtain better spectral and spatial retention ability of the network, an unsupervised joint loss function is designed to train the network. In this paper, the Sentinel 1 SAR images and Landsat 8 MS images are used as datasets for experiments. The experimental results show that the proposed algorithm has better performance in quantitative and visual representation when compared with traditional fusion methods and deep learning algorithms. [ABSTRACT FROM AUTHOR]

Breast cancer is a deadly disease which is most commonly diagnosed in women. It spreads worldwide as the number of cases is increasing each day. The significant increase in cancer cases leads researchers to develop imaging tools for its detection. However, false-positive rates in manual detections are more, which may be due to human error, time taking process or some other issues. If these cancers are not detected at an early stage, they can cause the death of the patient. Therefore, several machine learning and deep learning-based methodologies have come into existence, which can be used to detect breast cancer in early stages. Nowadays, deep learning-based methods are trending, therefore, this paper discusses some important work done by researchers using deep learning. This survey provides an in-depth study of various deep learning models used for breast cancer detection. The details about mammography, histopathology and ultrasound datasets are also given which are being used for comparative analysis of the developed methods. This survey is not only on one imaging modality instead covering three modalities and thus giving a wider study of various methods. Important works from various years have been discussed along with recent works based on vision transformer. Therefore, this paper presents all the necessary information to researchers working in this area and they can think of new ideas based on it to carry out further work. [ABSTRACT FROM AUTHOR]

The use of deep learning (DL) techniques for side-channel analysis (SCA) has become increasingly popular recently. This paper assesses the application of DL to non-profiled SCA attacks on AES-128 encryption, taking into consideration various challenges, including high-dimensional data, imbalanced classes, and countermeasures. The paper proposes using a multi-layer perceptron (MLP) and a convolutional neural network (CNN) to tackle hiding protection methods, such as noise generation and de-synchronization. The paper also introduces a technique called significant Hamming weight (SHW) labeling and a dataset reconstruction approach to handle imbalanced datasets, resulting in a reduction of 30% in the number of measurements required for training. The experimental results on reconstructed dataset demonstrate improved performance in DL-based SCA compared to binary labeling techniques, especially in the face of hiding countermeasures. This leads to better results for non-profiled attacks on different targets, such as ASCAD and RISC-V microcontrollers. [ABSTRACT FROM AUTHOR]

Generating natural language description for visual content is a technique for describing the content available in the image(s). It requires knowledge of both the domains of computer vision and natural language processing. For this, various models with different approaches are suggested. One of them is encoder-decoder-based description generation. Existing papers used only objects for descriptions, but the relationship between them is equally essential, requiring context information. Which required techniques like Long Short-Term Memory (LSTM). This paper proposes an encoder-decoder-based methodology to generate human-like textual descriptions. Dense-LSTM is presented for better description as a decoder with a modified VGG19 encoder to capture information to describe the scene. Standard datasets Flickr8K and Flickr30k are used for testing and training purposes. BLEU (Bilingual Evaluation Understudy) score is used to evaluate the generated text. For the proposed model, a GUI (Graphical User Interface) is developed, which produces the audio description of the output received and provides an interface for searching the related visual content and query-based search. [ABSTRACT FROM AUTHOR]

Forest stock volume is the main factor to evaluate forest carbon sink level. At present, the combination of multi-source remote sensing and non-parametric models has been widely used in FSV estimation. However, the biodiversity of natural forests is complex, and the response of the spatial information of remote sensing images to FSV is significantly reduced, which seriously affects the accuracy of FSV estimation. To address this challenge, this paper takes China's Baishanzu Forest Park with representative characteristics of natural forests as the research object, integrates the forest survey data, SRTM data, and Landsat 8 images of Baishanzu Forest Park, constructs a time series dataset based on survey time, and establishes an FSV estimation model based on the CNN-LSTM-Attention algorithm. The model uses the convolutional neural network to extract the spatial features of remote sensing images, uses the LSTM to capture the time-varying characteristics of FSV, captures the feature variables with a high response to FSV through the attention mechanism, and finally completes the prediction of FSV. The experimental results show that some features (e.g., texture, elevation, etc.) of the dataset based on multi-source data feature variables are more effective in FSV estimation than spectral features. Compared with the existing models such as MLR and RF, the proposed model achieved higher accuracy in the study area (R2 = 0.8463, rMSE = 26.73 m3/ha, MAE = 16.47 m3/ha). [ABSTRACT FROM AUTHOR]

This paper proposed a real-time fault diagnostic method for hydraulic systems using data collected from multiple sensors. The method is based on a proposed multi-sensor convolutional neural network (MS-CNN) that incorporates feature extraction, sensor selection, and fault diagnosis into an end-to-end model. Both the sensor selection process and fault diagnosis process are based on abstract fault-related features learned by a CNN deep learning model. Therefore, compared with the traditional sensor-and-feature selection method, the proposed MS-CNN can find the sensor channels containing higher-level fault-related features, which provides two advantages for diagnosis. First, the sensor selection can reduce the redundant information and improve the diagnostic performance of the model. Secondly, the reduced number of sensors simplifies the model, reducing communication burden and computational complexity. These two advantages make the MS-CNN suitable for real-time hydraulic system fault diagnosis, in which the multi-sensor feature extraction and the computation speed are both significant. The proposed MS-CNN approach is evaluated experimentally on an electric-hydraulic subsea control system test rig and an open-source dataset. The proposed method shows obvious superiority in terms of both diagnosis accuracy and computational speed when compared with traditional CNN models and other state-of-the-art multi-sensor diagnostic methods. [ABSTRACT FROM AUTHOR]

AbstractThis paper extends a text classification method utilizing natural language processing (NLP) into the field of traditional Chinese medicine (TCM) compound decoction to effectively and scientifically extend the TCM compound decoction duration. Specifically, a TCM compound decoction duration classification named TCM-TextCNN is proposed to fuse multi-dimensional herb features and improve TextCNN. Indeed, first, we utilize word vector technology to construct feature vectors of herb names and medicinal parts, aiming to describe the herb characteristics comprehensively. Second, considering the impact of different herb features on the decoction duration, we use an improved Term Frequency-Inverse Word Frequency (TF-IWF) algorithm to weigh the feature vectors of herb names and medicinal parts. These weighted feature vectors are then concatenated to obtain a multi-dimensional herb feature vector, allowing for a more comprehensive representation. Finally, the feature vector is input into the improved TextCNN, which uses k-max pooling to reduce information loss rather than max pooling. Three fully connected layers are added to generate higher-level feature representations, followed by softmax to obtain the final results. Experimental results on a dataset of TCM compound decoction duration demonstrate that TCM-TextCNN improves accuracy, recall, and F1 score by 5.31%, 5.63%, and 5.22%, respectively, compared to methods solely rely on herb name features, thereby confirming our method’s effectiveness in classifying TCM compound decoction duration. [ABSTRACT FROM AUTHOR]

The tunnel construction area poses significant challenges for the use of vision technology due to the presence of nonhomogeneous haze fields and low-contrast targets. However, existing dehazing algorithms display weak generalization, leading to dehazing failures, incomplete dehazing, or color distortion in this scenario. Therefore, an adversarial dual-branch convolutional neural network (ADN) is proposed in this paper to deal with the above challenges. The ADN utilizes two branches of the knowledge transfer sub-network and the multi-scale dense residual sub-network to process the hazy image and then aggregate the channels. This input is then passed through a discriminator to judge true and false, motivating the network to improve performance. Additionally, a tunnel haze field simulation dataset (Tunnel-HAZE) is established based on the characteristics of nonhomogeneous dust distribution and artificial light sources in the tunnel. Comparative experiments with existing advanced dehazing algorithms indicate an improvement in both PSNR (Peak Signal-to-Noise Ratio) and SSIM (Structural Similarity) by 4.07 dB and 0.032 dB, respectively. Furthermore, a binocular measurement experiment conducted in a simulated tunnel environment demonstrated a reduction in the relative error of measurement results by 50.5% when compared to the haze image. The results demonstrate the effectiveness and application potential of the proposed method in tunnel construction. [ABSTRACT FROM AUTHOR]

Because of the two sequenced methods stated above, SG and AMP, are being used in different ways, present a deep learning methodology for taxonomic categorization of the metagenomic information which could be utilized for either. To place the suggested pipeline to a trial, 1000 16 S full-length genomes were used to generate either SG or AMP short-reads. Then, to map sequencing as matrices into such a number space, used a k-mer model. Our analysis of the existing approaches revealed several drawbacks, including limited ability to handle complex hierarchical representations of data and suboptimal feature extraction from grid-like structures. To overcome these limitations, we introduce DBNs for feature learning and dimensionality reduction, and CNNs for efficient processing of grid-like metagenomic data. Finally, a training set for every taxon was obtained by training two distinct deep learning constructions, specifically deep belief network (DBN) and convolutional neural network (CNN). This examined the proposed methodology to determine the best factor that determines and compared findings to the classification abilities offered by the RDP classifier, a standard classifier for bacterium identification. These designs outperform using RDP classifiers at every taxonomic level. So, at the genetic level, for example, both CNN and DBN achieved 91.4% accuracy using AMP short-reads, but the RDP classifier achieved 83.9% with the same information. This paper, suggested a classification method for 16 S short-read sequences created on k-mer representations and a deep learning structure, that every taxon creates a classification method. The experimental findings validate the suggested pipelines as a realistic strategy for classifying bacterium samples; as a result, the technique might be included in the most commonly used tools for the metagenomic research. According to the outcomes, it could be utilized to effectively classify either SG or AMP information. [ABSTRACT FROM AUTHOR]

A Brain–Computer Interface (BCI) is a medium for communication between the human brain and computers, which does not rely on other human neural tissues, but only decodes Electroencephalography (EEG) signals and converts them into commands to control external devices. Motor Imagery (MI) is an important BCI paradigm that generates a spontaneous EEG signal without external stimulation by imagining limb movements to strengthen the brain's compensatory function, and it has a promising future in the field of computer-aided diagnosis and rehabilitation technology for brain diseases. However, there are a series of technical difficulties in the research of motor imagery-based brain–computer interface (MI-BCI) systems, such as: large individual differences in subjects and poor performance of the cross-subject classification model; a low signal-to-noise ratio of EEG signals and poor classification accuracy; and the poor online performance of the MI-BCI system. To address the above problems, this paper proposed a combined virtual electrode-based EEG Source Analysis (ESA) and Convolutional Neural Network (CNN) method for MI-EEG signal feature extraction and classification. The outcomes reveal that the online MI-BCI system developed based on this method can improve the decoding ability of multi-task MI-EEG after training, it can learn generalized features from multiple subjects in cross-subject experiments and has some adaptability to the individual differences of new subjects, and it can decode the EEG intent online and realize the brain control function of the intelligent cart, which provides a new idea for the research of an online MI-BCI system. [ABSTRACT FROM AUTHOR]

The automatic reading of pointer meters is significantly important to data monitoring and efficient measurement in the industrial field. However, the existing automatic reading method can not obtain accurate performance in natural scenarios and present no satisfactory application effects in industrial fields (such as power stations and gas stations). In this paper, a novel automatic reading method for pointer meters based on deep learning is proposed, which contains five stages. Stage-1: the object detection algorithm Yolov4 and the feature optimization module IFF are used to locate the target meter. Stage-2: Semantic segmentation model is applied to extract the pointer area based on Anam-Net. Stage-3: the character detection algorithm CRAFT and the text recognition algorithm E2E-MLT are combined and used to recognize the scale text and unit on the meter. Stage-4: the scale area of the meter is converted to the polar coordinate system, and a lightweight convolutional neural network is designed to locate the main scale line. And finally in Stage-5: the reading data are calculated according to the outputs of the above-mentioned deep learning models. The experiment results show that the reading method proposed in this paper has higher accuracy and robustness than those of the existing approaches and obtains satisfactory application effects in the industrial field. [ABSTRACT FROM AUTHOR]

In recent years, research work on intelligent data-driven bearing fault diagnosis methods has received increasing attention. The detection of a fault, whether incipient or moderate, and the monitoring of its evolution are a major challenge in the field of fault diagnosis and are of great industrial interest. For an efficient identification of this type of fault, we propose in this paper a new method of bearing fault diagnosis ("novel BiLSTM" method). This new approach contributes to the improvement of fault diagnosis methods based on BiLSTM networks. The performance was tested under sixteen conditions and for different loads using the Case Western Reserve University (CWRU) bearing dataset under conditions higher than those proposed in the literature dealing with the same problem. The experimental results obtained show that the proposed method has excellent performance. Subsequently, the proposed method was experimentally compared with the CNN model. The results of this comparison showed that the model developed in this paper not only has a higher accuracy rate in the test set but also in the learning process. [ABSTRACT FROM AUTHOR]

The application of Transformer in computer vision has had the most significant influence of all the deep learning developments over the past five years. In addition to the exceptional performance of convolutional neural networks (CNN) in hyperspectral image (HSI) classification, Transformer has begun to be applied to HSI classification. However, for the time being, Transformer has not produced satisfactory results in HSI classification. Recently, in the field of image classification, the creators of Sequencer have proposed a Sequencer structure that substitutes the Transformer self-attention layer with a BiLSTM2D layer and achieves satisfactory results. As a result, this paper proposes a unique network called SquconvNet, that combines CNN with Sequencer block to improve hyperspectral classification. In this paper, we conducted rigorous HSI classification experiments on three relevant baseline datasets to evaluate the performance of the proposed method. The experimental results show that our proposed method has clear advantages in terms of classification accuracy and stability. [ABSTRACT FROM AUTHOR]

With the continuous advancement of target detection technology in remote sensing, target detection technology in images captured by drones has performed well. However, object detection in drone imagery is still a challenge under rainy conditions. Rain is a common severe weather condition, and rain streaks often degrade the image quality of sensors. The main issue of rain streaks removal from a single image is to prevent over smoothing (or underclearing) phenomena. Aiming at the above problems, this paper proposes a deep learning (DL)-based rain streaks removal framework called GSDerainNet, which properly formulates the single image rain streaks removal problem; rain streaks removal is aptly described as a Gaussian Shannon (GS) filter-based image decomposition problem. The GS filter is a novel filter proposed by us, which consists of a parameterized Gaussian function and a scaled Shannon function. Two-dimensional GS filters exhibit high stability and effectiveness in dividing an image into low- and high-frequency parts. In our framework, an input image is first decomposed into a low-frequency part and a high-frequency part by using the GS filter. Rain streaks are located in the high-frequency part. We extract and separate the rain features of the high-frequency part through a deep convolutional neural network (CNN). The experimental results obtained on synthetic data and real data show that the proposed method can better suppress the morphological artifacts caused by filtering. Compared with state-of-the-art single image rain streaks removal methods, the proposed method retains finer image object structures while removing rain streaks. [ABSTRACT FROM AUTHOR]

Synthetic aperture radar (SAR) sensor often produces a shadow in pairs with the target due to its slant-viewing imaging. As a result, shadows in SAR images can provide critical discriminative features for classifiers, such as target contours and relative positions. However, shadows possess unique properties that differ from targets, such as low intensity and sensitivity to depression angles, making it challenging to extract depth features from shadows directly using convolutional neural networks (CNN). In this paper, we propose a new SAR image-classification framework to utilize target and shadow information comprehensively. First, we design a SAR image segmentation method to extract target regions and shadow masks. Second, based on SAR projection geometry, we propose a data-augmentation method to compensate for the geometric distortion of shadows due to differences in depression angles. Finally, we introduce a feature-enhancement module (FEM) based on depthwise separable convolution (DSC) and convolutional block attention module (CBAM), enabling deep networks to fuse target and shadow features adaptively. The experimental results on the Moving and Stationary Target Acquisition and Recognition (MSTAR) dataset show that when only using target and shadow information, the published deep-learning models can still achieve state-of-the-art performance after embedding the FEM. [ABSTRACT FROM AUTHOR]

Due to the rapid development of satellite technology, high‐spatial‐resolution remote sensing (HRRS) images have highly complex spatial distributions and multiscale features, making the classification of such images a challenging task. The key to scene classification is to accurately understand the main semantic information contained in images. Convolutional neural networks (CNNs) have outstanding advantages in this field. Deep CNNs (D‐CNNs) with better performance tend to have more parameters and higher complexity. However, shallow CNNs have difficulty extracting the key features of complex remote sensing images. In this paper, we propose a lightweight network with a random depth strategy for remote sensing scene classification (LRSCM). We construct a convolutional feature extraction module, DCAB, which incorporates depthwise separable convolutional and inverted residual structures, effectively reducing the numbers of required parameters and computations, and retains and utilizes low‐level features. In addition, coordinate attention (CA) is integrated into the module, thereby further improving the network's ability to extract key local information. To further reduce the complexity of model training, the residual module adopts a stochastic depth strategy, providing the network with a random depth. Comparative experiments on five public datasets show that the LRSCM network can achieve results comparable to those of other state‐of‐the‐art methods. [ABSTRACT FROM AUTHOR]

Hyperspectral image (HSI) classification has been extensively applied for analyzing remotely sensed images. HSI data consist of multiple bands that provide abundant spatial information. Convolutional neural networks (CNNs) have emerged as powerful deep learning methods for processing visual data. In recent work, CNNs have shown impressive results in HSI classification. In this paper, we propose a hierarchical neural network architecture called feature extraction with hybrid spectral CNN (FE-HybridSN) to extract superior spectral–spatial features. FE-HybridSN effectively captures more spectral–spatial information while reducing computational complexity. Considering the prevalent issue of class imbalance in experimental datasets (IP, UP, SV) and real-world hyperspectral datasets, we apply the focal loss to mitigate these problems. The focal loss reconstructs the loss function and facilitates effective achievement of the aforementioned goals. We propose a framework (FEHN-FL) that combines FE-HybridSN and the focal loss for HSI classification and then conduct extensive HSI classification experiments using three remote sensing datasets: Indian Pines (IP), University of Pavia (UP), and Salinas Scene (SV). Using cross-entropy loss as a baseline, we assess the hyperspectral classification performance of various backbone networks and examine the influence of different spatial sizes on classification accuracy. After incorporating focal loss as our loss function, we not only compare the classification performance of the FE-HybridSN backbone network under different loss functions but also evaluate their convergence rates during training. The proposed classification framework demonstrates satisfactory performance compared to state-of-the-art end-to-end deep-learning-based methods, such as 2D-CNN, 3D-CNN, etc. [ABSTRACT FROM AUTHOR]