Search

Monitoring and managing litter on the roadways is important not only for preserving the cleanliness and esthetic appeal of our cities but also for safeguarding the overall health and sanitary environment of citizens. With the development of artificial intelligence, it is now possible to design algorithms capable of autonomously assessing the sanitation status of roadways. In this paper, we propose a method for detecting garbage on roads as our solution to tackle the issue. The proposed model is a deep learning model with an attention mechanism introduced to detect garbage in real-time scenarios. Furthermore, the object recognition capability of the model is enhanced through transfer learning to mitigate the influence of irrelevant content during training. The refined network can detect rubbish on roads with higher efficiency than the existing models. Also, compared with other methods, it consumes less amount of data for training. The experimental results demonstrate the efficiency of our proposed model, with a performance boost of 7.62% over the state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Accurate prediction of wind power is crucial for the efficient operation and risk management of wind farms. This paper introduces a deep learning model for wind power prediction that integrates an Attention mechanism with a convolutional neural network (CNN) and a gated recurrent unit (GRU) neural network. Addressing the randomness, intermittency, volatility and uncertainty of wind speed, we first apply swarm decomposition (SWD) to preprocess the original wind power data into subsequences. Subsequently, the CNN extracts spatial features, and the GRU identifies temporal correlations. The Attention mechanism enhances feature significance, further optimizing prediction accuracy. Complex error sequences generated by the CNN–GRU–Attention (CGA) model are corrected using the autoregressive integrated moving average (ARIMA). We evaluated the model’s performance using three wind power datasets against 16 other models, employing six evaluation indices (MSE, RMSE, MAPE, Theil’s U, TIC and SPL) and the Diebold–Mariano (DM) test and model confidence set (MCS) for model testing. Our results demonstrate the proposed model’s superior accuracy and efficiency in predicting wind power. [ABSTRACT FROM AUTHOR]

This paper suggests a text emotion analysis approach built on the BMCBMA model for use in an online education environment aiming at the issues of poor text utilization, challenge in effective information extraction, and a failure to effectively recognize word polysemy in existing text emotion analysis task research. Initially, a language model is constructed using Bidirectional Encoder Representations from Transformers (BERT) pre-training. The word vector trained by BERT pre-training is selected to supplant the word vector trained in the conventional manner, and the semantic vector is generated dynamically using the context of the word. Second, the Bi-directional Long Short-Term Memory (BiLSTM) model is employed to record semantic information by simultaneously integrating both positive and negative orientations to assess the emotional polarity information for every text in its entirety. The Multi-channel Convolutional Neural Networks (CNN) model is then utilized to derive textual local feature information of text. Lastly, the attention mechanism is used to cause all types of features to interact and to derive a deeper semantic association within the context. Experiments indicate that the suggested method has accuracy, F1, recall, and precision values of 0.915, 0.911, 0.915 and 0.908, correspondingly. The suggested approach performs significantly better in text emotion analysis than the comparison method. [ABSTRACT FROM AUTHOR]

The recognition of steel microstructure images plays a crucial role in the metallographic analysis process. Although some progress has been made through the application of artificial intelligence algorithms, several challenges remain. First, existing algorithms exhibit weak nonlinear feature extraction capabilities and noticeable limitations. Second, they overlook the intrinsic noise and redundant interference present in microscopic images. To address these issues, this paper investigates the automatic recognition of metallographic tissues by leveraging residual structures in deep neural networks. An enhanced residual network model based on transfer learning is proposed, which utilizes the pre-trained weights from the ImageNet dataset to facilitate learning with small sample data. This network offers higher classification accuracy and higher F1 scores. In addition, a deep residual shrinkage network model based on an attention mechanism is proposed. This model incorporates an attention sub-network into the original residual module and employs a soft threshold function to eliminate redundant features, including noise. The proposed algorithms are evaluated against various convolutional neural networks using 20 types of metallographic test sets. The experimental results showed that both methods have high accuracy rates of 95% and 94.44%, respectively, and F1 scores of 0.9464 and 0.9419. While maintaining the complexity of the model, there has been a significant improvement in accuracy, and the models exhibit strong generalization capabilities. Our research contributes to enhancing production efficiency, strengthening quality control, and improving material performance through computer vision technology. [ABSTRACT FROM AUTHOR]

The recognition of steel microstructure images plays a crucial role in the metallographic analysis process. Although some progress has been made through the application of artificial intelligence algorithms, several challenges remain. First, existing algorithms exhibit weak nonlinear feature extraction capabilities and noticeable limitations. Second, they overlook the intrinsic noise and redundant interference present in microscopic images. To address these issues, this paper investigates the automatic recognition of metallographic tissues by leveraging residual structures in deep neural networks. An enhanced residual network model based on transfer learning is proposed, which utilizes the pre-trained weights from the ImageNet dataset to facilitate learning with small sample data. This network offers higher classification accuracy and higher F1 scores. In addition, a deep residual shrinkage network model based on an attention mechanism is proposed. This model incorporates an attention sub-network into the original residual module and employs a soft threshold function to eliminate redundant features, including noise. The proposed algorithms are evaluated against various convolutional neural networks using 20 types of metallographic test sets. The experimental results showed that both methods have high accuracy rates of 95% and 94.44%, respectively, and F1 scores of 0.9464 and 0.9419. While maintaining the complexity of the model, there has been a significant improvement in accuracy, and the models exhibit strong generalization capabilities. Our research contributes to enhancing production efficiency, strengthening quality control, and improving material performance through computer vision technology. [ABSTRACT FROM AUTHOR]

Accurate identification of vehicles and estimating density in traffic surveillance systems is a challenging task, particularly in scenarios with closely spaced lanes. Single Shot MultiBox Detector (SSD) is introduced in vehicle detection and classification due to its speed and accuracy. It utilizes a transfer learning technique that enables them to utilize features from pretrained Convolutional Neural Networks (CNNs). Although the utilization of multi-scale feature maps in SSD has achieved efficient results in vehicle detection, it struggles to identify key features of vehicles due to its one-stage detection approach. Furthermore, the use of VGG16 as the backbone network in these approaches leads to the loss of fine-grained details, posing challenges in accurately localizing and classifying small vehicles. Also, there is no interaction between high- and low-level features, which restricts the networks ability to effectively integrate and utilize both features for accurate vehicle detection. To overcome these limitations, an improved SSD approach is introduced in this paper, leveraging interactive multi-scale attention characteristics to accurately detect and classify vehicles. This approach utilizes ResNet50 as the network backbone to overcome the limitations of traditional SSDs in detecting small vehicles. Also, an attention block is incorporated into it to focus on key details and assign higher attention to relevant pixels within the feature map. Also, the network employs a parallel detection framework and shares multi-scale layers (both high and low), enabling efficient detection of vehicles with various sizes. Then, traffic density is estimated based on the weights assigned to the categorized vehicles obtained from the improved SSD and the recorded area. Finally, traffic is classified as high, low, or moderate by comparing the estimated density to a threshold value. By adding attention characteristics of different scales to the original detection branch and replacing the VGG16 with ResNet50 of the SSD technique using our method, the feature representation capability and detection accuracy are both significantly improved. [ABSTRACT FROM AUTHOR]

To address the issues of blurred details and distortion of color in the images recovered by the original AOD-Net dehazing method, this paper proposes a CPAD-Net dehazing network model based on attention mechanism and dense residual blocks. The network is improved on the basis of AOD-Net, which can reduce the errors arising from the separately determined transmittance and atmospheric light values. A new dense residual block structure is designed to replace the traditional convolution method, which effectively improves the detail processing capability and the representation ability of the network model for image feature information. On this basis, the attention module determines how to learn the weights according to the feature importance of distinct channels and distinct pixels, and then obtain the recovery of images in terms of color and texture. The experiments showed that the dehazing efficiency of our method are richer in texture detail information and more natural in color recovery. Compared with other algorithms, the PSNR and SSIM indexes of our method are considerably superior to those listed algorithms, which definitively demonstrates that the dehazing effect of our method is more effective, and the recovered images are more realistic and natural. [ABSTRACT FROM AUTHOR]

The demands of high-quality videos captured by camera become bigger due to the rapid development of pattern recognition and artificial intelligence. Video denoising is the key technology to obtain clear videos. However, the research on video denoising is far from enough now. In this paper, we propose a video denoising method based on convolutional neural network architecture to reduce the noise from the sensor system. We improve the loss function of noise estimation by imposing adaptive penalty on under-estimation error of noise level which makes our method perform robustly. Furthermore, we make use of multi-level features to guide the spatial denoising, where multilayer semantic information of the image is regarded as the perceptual loss. Instead of relying on Optical Flow solving the characterization of inter-frame information, we utilize U-Net-like structure to handle motion implicitly. It is less computationally expensive and avoids distortions caused by inaccurate flow and object occlusion. In order to locate temporal features and suppress useless information, the attention mechanism is introduced to the skip connections of the U-Net-like structure. Experimental results demonstrate that the proposed algorithm outputs more convincing results in both peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) indexes when processing Gaussian noise, synthetic real noise, and real noise compared with selected approaches. [ABSTRACT FROM AUTHOR]

Deep learning has become a primary choice in medical image analysis due to its powerful representation capability. However, most existing deep learning models designed for medical image classification can only perform well on a specific disease. The performance drops dramatically when it comes to other diseases. Generalizability remains a challenging problem. In this paper, we propose an evolutionary attention-based network (EDCA-Net), which is an effective and robust network for medical image classification tasks. To extract task-related features from a given medical dataset, we first propose the densely connected attentional network (DCA-Net) where feature maps are automatically channel-wise weighted, and the dense connectivity pattern is introduced to improve the efficiency of information flow. To improve the model capability and generalizability, we introduce two types of evolution: intra- and inter-evolution. The intra-evolution optimizes the weights of DCA-Net, while the inter-evolution allows two instances of DCA-Net to exchange training experience during training. The evolutionary DCA-Net is referred to as EDCA-Net. The EDCA-Net is evaluated on four publicly accessible medical datasets of different diseases. Experiments showed that the EDCA-Net outperforms the state-of-the-art methods on three datasets and achieves comparable performance on the last dataset, demonstrating good generalizability for medical image classification. [ABSTRACT FROM AUTHOR]

Accurate traffic flow forecasting is a prerequisite guarantee for the realization of intelligent transportation, but due to the complex spatiotemporal characteristics of traffic flow, its forecasting has always been difficult. Deep learning can learn the deep spatiotemporal characteristics of traffic flow from a large amount of data. Deep learning can learn the deep spatiotemporal characteristics of traffic flow from a large amount of data. This paper establishes a novel combination forecasting model GGCN-SA based on deep learning for traffic flow to effectively capture the spatiotemporal characteristics of traffic flow and improve forecasting accuracy. The model captures the spatial correlation of the road traffic network through the graph convolutional network (GCN), captures the time dependence of the traffic flow through the gated recursive unit (GRU), and further introduces the soft attention mechanism (Soft Attention) to aggregate different neighborhoods Spatio-temporal information within the range to enhance the model's ability to characterize the temporal and spatial characteristics of traffic flow. A large number of experiments have been conducted on the METR-LA and SZ-taxi data sets. The experimental results show that the GGCN-SA model proposed in this paper has better forecasting performance compared with the baseline methods. [ABSTRACT FROM AUTHOR]

It is of great significance for individuals, enterprises, and government departments to analyze and excavate the sentiment in the comments. Many deep learning models are used for text sentiment analysis, and the BiTCN model has good efficacy on sentiment analysis. However, in the actual semantic expression, the contribution of each word to the sentiment tendency is different, BiTCN treats it fairly and does not pay more attention to the key sentiment words. For this problem, a sentiment analysis model based on the BiTCN-Attention is proposed in this paper. The Self-Attention mechanism and Multi-Head Self-Attention mechanism are added to BiTCN respectively to form BiTCN-SA and BiTCN-MHSA, which improve the weight of sentiment words and the accuracy of feature extraction, to increase the effect of sentiment analysis. The experimental results show that the model accuracies of BiTCN-SA and BiTCN-MHSA in the JingDong commodity review data set are 3.96% and 2.41% higher than that of BiTCN, respectively. In the comment data set of DianPing, the accuracy of BiTCN-SA and BiTCN-MHSA improved by 4.62% and 3.49%, respectively, compared with that of BiTCN. [ABSTRACT FROM AUTHOR]

In this paper, we propose a novel transformer-based deep neural network model to learn semantic bug patterns from a corpus of buggy/fixed codes, then generate correct ones automatically. Transformer is a deep learning model relying entirely on attention mechanism to model global dependencies between input and output. Although there are a few endeavors to repair programs by learning neural language models (NLM), many special program properties, such as structure and semantics of an identifier, are not considered in embedding input sequence and designing model effectively, which results in undesired performance. In the proposed Bug-Transformer, we design a novel context abstraction mechanism to better support neural language models. Specifically, it is capable of 1) compressing code information but preserving the key structure and semantics, which provides more thorough information for NLM models, 2) renaming identifiers and literals based on their lexical scopes, structural and semantic information, to reduce code vocabulary size and 3) reserving keywords and selected idioms (domain- or developer-specific vocabularies) for better understanding code structure and semantics. Hence, Bug-Transformer adequately embeds code structural and semantic information into input data and optimize attention-based transformer neural network to well handle code features in order to improve learning tasks for bug repair. We evaluate the performance of the proposed work comprehensively on three datasets (Java code corpora) and generate patches to buggy code using a beam search decoder. The experimental results show that our proposed work outperforms the-state-of-art techniques: Bug-Transformer can successfully predict 54.81%, 34.45%, and 42.40% of the fixed code in these three datasets, respectively, which outperform the baseline models. These success rates steadily increase along with the increase of beam size. Besides, the overall syntactic correctness of all patches remains above 97%, 96%, and 50% on the three benchmarks, respectively, regardless of the beam size. [ABSTRACT FROM AUTHOR]

When using deep learning methods to model natural language, a recurrent neural network that can map input sequences to output sequences is usually used. Considering that natural language contains more complicated syntactic structures, and the performance of cyclic neural networks in long sentence processing will decrease, scholars have introduced an attention mechanism into the model, which has improved the above problems to a certain extent. The existing attention mechanism still has some shortcomings, such as the inability to explicitly obtain the known syntactic structure information in the sentence, and the poor interpretability of the output probability. In response to the above problems, this article will improve the attention mechanism in the recurrent neural network model. Firstly, the prior information in the natural language sequence is constructed as a graph model through syntactic analysis and other means, and then the graph structure regularization term is introduced into the sparse mapping. A new function netmax is constructed to replace the softmax function in the traditional attention mechanism, thereby improving the performance of the model and making the degree of association. The input values corresponding to larger input samples are closer, making the output of the attention mechanism easier to understand. The innovation of this paper mainly lies in that the weight calculation method which can be widely used in the attention mechanism is proposed by combining the deep learning model with statistical knowledge, which opens a channel to introduce the prior information for the deep learning model in natural language processing tasks. [ABSTRACT FROM AUTHOR]

The goal of computer-aided diagnosis is to predict patient's diseases based on patient's clinical data. The development of deep learning technology provides new help for clinical diagnosis. In this paper, we propose a new sequence generation model for multi-disease diagnosis prediction based on numerical feature transformation. Our model simultaneously uses patient's laboratory test results and clinical text as input to diagnose and predict the disease that the patient may have. According to medical knowledge, our model can transform numerical features into descriptive text features, thereby enriching the semantic information of clinical texts. Besides, our model uses attention-based sequence generation methods to achieve the diagnosis of multiple diseases and better utilizes the correlation information between multiple diseases. We evaluate our model's performance on a dataset of respiratory diseases from the real world, and experimental results show that our model's accuracy reaches 42.75%, and the F 1 score reaches 65.65%, which is better than many other methods. It is suitable for the accurate diagnosis of multiple diseases. [ABSTRACT FROM AUTHOR]

Classification of brain tumors is one of the daunting tasks in medical imaging and incorrect decisions during the diagnosis process may lead to increased human fatality. Latest advances in artificial intelligence and deep learning have opened the path for the success of numerous medical image analysis tasks, including the recognition of brain tumors. In this paper, we propose a simple architecture based on deep learning that results in strong generalization without needing much preprocessing. The proposed Multi-modal Squeeze and Excitation model (MSENet) receives multiple representations of a given tumor image, learns end-to-end and effectively predicts the severity level of tumor. Convolution feature descriptors from multiple deep pre-trained models are used to effectively describe the tumor images and are supplied as input to the proposed MSENet. The squeeze and excitation blocks of the MSENet allow the model to prioritize tumor regions while giving less emphasis to the rest of the image, serving as an attention mechanism in the model. The proposed model is evaluated on the benchmark brain tumor dataset that is publicly accessible from the Figshare repository. Experimental studies reveal that in terms of model parameters, the proposed approach is simple and leads to competitive performance compared to those of existing complex models. By increasing complexity, the proposed model leads to generalize better and achieves state-of-the-art accuracy of 96.05% on Figshare dataset. Compared to the existing models, the proposed model neither uses segmentation nor uses augmentation techniques and without much pre-processing achieves competitive performance. [ABSTRACT FROM AUTHOR]

To improve the accuracy and automation of malware Uniform Resource Locator (URL) recognition, a joint approach of Convolutional neural network (CNN) and Long-short term memory (LSTM) based on the Attention mechanism (JCLA) is proposed to identify and detect malicious URL. Firstly, the URL features including texture information, lexical information and host information are extracted and filtered, and pre-processed with encode. Then, the feature matrix more relevant to the output are chose according to the weight of the attention mechanism and input to the constructed parallel processing model called CNN_LSTM, combinating CNN and LSTM to get local features. Next, the extracted local features are merged to calculate the global features of the URLs to be detected. Finally, the URLs are classified by the SoftMax classifier using global features, the accuracy of the model in malicious URL recgonition is 98.26%. The experimental results show that the JCLA model proposed in this paper is better than the traditional deep learning model or CNN_LSTM combined model for detecting malicious URLs. [ABSTRACT FROM AUTHOR]