Search

Brain–computer interfaces (BCIs) based on motor imagery (MI) enable the disabled to interact with the world through brain signals. To meet demands of real-time, stable, and diverse interactions, it is crucial to develop lightweight networks that can accurately and reliably decode multi-class MI tasks. In this paper, we introduce BrainGridNet, a convolutional neural network (CNN) framework that integrates two intersecting depthwise CNN branches with 3D electroencephalography (EEG) data to decode a five-class MI task. The BrainGridNet attains competitive results in both the time and frequency domains, with superior performance in the frequency domain. As a result, an accuracy of 80.26 percent and a kappa value of 0.753 are achieved by BrainGridNet, surpassing the state-of-the-art (SOTA) model. Additionally, BrainGridNet shows optimal computational efficiency, excels in decoding the most challenging subject, and maintains robust accuracy despite the random loss of 16 electrode signals. Finally, the visualizations demonstrate that BrainGridNet learns discriminative features and identifies critical brain regions and frequency bands corresponding to each MI class. The convergence of BrainGridNet's strong feature extraction capability, high decoding accuracy, steady decoding efficacy, and low computational costs renders it an appealing choice for facilitating the development of BCIs. [ABSTRACT FROM AUTHOR]

Myocardial Infarction (MI), commonly known as heart attack, is a cardiac condition characterized by damage to a portion of the heart, specifically the myocardium, due to the disruption of blood flow. Given its recurring and often asymptomatic nature, there is the need for continuous monitoring using wearable devices. This paper proposes a single-microcontroller-based system designed for the automatic detection of MI based on the Edge Computing paradigm. Two solutions for MI detection are evaluated, based on Machine Learning (ML) and Deep Learning (DL) techniques. The developed algorithms are based on two different approaches currently available in the literature, and they are optimized for deployment on low-resource hardware. A feasibility assessment of their implementation on a single 32-bit microcontroller with an ARM Cortex-M4 core was examined, and a comparison in terms of accuracy, inference time, and memory usage was detailed. For ML techniques, significant data processing for feature extraction, coupled with a simpler Neural Network (NN) is involved. On the other hand, the second method, based on DL, employs a Spectrogram Analysis for feature extraction and a Convolutional Neural Network (CNN) with a longer inference time and higher memory utilization. Both methods employ the same low power hardware reaching an accuracy of 89.40% and 94.76%, respectively. The final prototype is an energy-efficient system capable of real-time detection of MI without the need to connect to remote servers or the cloud. All processing is performed at the edge, enabling NN inference on the same microcontroller. [ABSTRACT FROM AUTHOR]

The characteristics of acoustic emission signals generated in the process of rock deformation and fission contain rich information on internal rock damage. The use of acoustic emissions monitoring technology can analyze and identify the precursor information of rock failure. At present, in the field of acoustic emissions monitoring and the early warning of rock fracture disasters, there is no real-time identification method for a disaster precursor characteristic signal. It is easy to lose information by analyzing the characteristic parameters of traditional acoustic emissions to find signals that serve as precursors to disasters, and analysis has mostly been based on post-analysis, which leads to poor real-time recognition of disaster precursor characteristics and low application levels in the engineering field. Based on this, this paper regards the acoustic emissions signal of rock fracture as a kind of speech signal generated by rock fracture uses this idea of speech recognition for reference alongside spectral analysis (STFT) and Mel frequency analysis to realize the feature extraction of acoustic emissions from rock fracture. In deep learning, based on the VGG16 convolutional neural network and AlexNet convolutional neural network, six intelligent real-time recognition models of rock fracture and key acoustic emission signals were constructed, and the network structure and loss function of traditional VGG16 were optimized. The experimental results show that these six deep-learning models can achieve the real-time intelligent recognition of key signals, and Mel, combined with the improved VGG16, achieved the best performance with 87.68% accuracy and 81.05% recall. Then, by comparing multiple groups of signal recognition models, Mel+VGG-FL proposed in this paper was verified as having a high recognition accuracy and certain recognition efficiency, performing the intelligent real-time recognition of key acoustic emission signals in the process of rock fracture more accurately, which can provide new ideas and methods for related research and the real-time intelligent recognition of rock fracture precursor characteristics. [ABSTRACT FROM AUTHOR]

This paper addresses the problem of fault identification in rotating machinery by analysing vibration data using a neural network approach. Temporal convolutional networks (TCNs) have attracted a lot of focus in the domain of fault identification; however, TCN convolution kernels are small and susceptible to high-frequency noise interference. Furthermore, the default weight coefficient of the internal residual connection is 1. When there are few residual blocks, the residual block characteristic extraction ability is suppressed and only the vibration signal collected at a single location is utilised for fault diagnosis as it contains incomprehensive fault information. To tackle the above issues, this paper proposes a multi-view feature fusion fault diagnosis algorithm with an adaptive residual coefficient assignment TCN with wide first-layer kernels (WD-ARCATCN). Firstly, a WD-ARCATCN feature extraction network is designed to extract deep state features from different views and the first layer of the TCN is set as a wide-kernel (WD) convolutional layer to suppress high-frequency noise. An adaptive residual coefficient assignment (ARCA) unit is designed in the residual connection to increase the characteristic learning capability of the residual blocks and the residual blocks with ARCA units are stacked to further extract multi-view deep fault features. In this paper, acceleration signals collected at different positions are used as the multi-view feature source for the first time and the fault information contained is more comprehensive. Then, based on a self-attention mechanism, the multi-view feature fusion method is improved and the view weights are adaptively assigned to effectively fuse different view characteristics and enhance the identification of the fault characteristics. Finally, the mapping between the multi-view fusion features and the labels is achieved using a softmax classifier. The algorithm has been tested using experimental data from the bearing vibration database at Case Western Reserve University (CWRU) and it performed much better compared to other diagnostic algorithms. [ABSTRACT FROM AUTHOR]

Remote sensing image (RSI) scene classification is a hot topic in the field of remote sensing and has garnered a lot of attention. The key issue in image classification is effectively understanding semantic content. Convolutional neural networks (CNNs) are generally recognized to significantly improve classification performance due to their powerful feature extraction capabilities. However, the overall structure of the model is complicated and has a large number of parameters, making it difficult to extract more efficient features. To address these problems, in this paper, we propose a lightweight skip-connected expansion Inception network called SEINet. To capture characteristics at a more granular level, we create a new lightweight backbone network with fewer parameters based on the existing network architecture. Additionally, the paper introduces a skip-connected expansion Inception (SEI) module for extracting context-dependent relationships. The ablation experiments verify the effectiveness of our proposed module. Experiment findings on two public datasets demonstrate that our method has advantages in classification accuracy and execution efficiency over state-of-the-art (SOTA) methods. [ABSTRACT FROM AUTHOR]

Facial beauty prediction (FBP) is an important and challenging problem in the fields of computer vision and machine learning. Not only it is easily prone to overfitting due to the lack of large-scale and effective data, but also difficult to quickly build robust and effective facial beauty evaluation models because of the variability of facial appearance and the complexity of human perception. Transfer Learning can be able to reduce the dependence on large amounts of data as well as avoid overfitting problems. Broad learning system (BLS) can be capable of quickly completing models building and training. For this purpose, Transfer Learning was fused with BLS for FBP in this paper. Firstly, a feature extractor is constructed by way of CNNs models based on transfer learning for facial feature extraction, in which EfficientNets are used in this paper, and the fused features of facial beauty extracted are transferred to BLS for FBP, called E-BLS. Secondly, on the basis of E-BLS, a connection layer is designed to connect the feature extractor and BLS, called ER-BLS. Finally, experimental results show that, compared with the previous BLS and CNNs methods existed, the accuracy of FBP was improved by E-BLS and ER-BLS, demonstrating the effectiveness and superiority of the method presented, which can also be widely used in pattern recognition, object detection and image classification. [ABSTRACT FROM AUTHOR]

Electroencephalography (EEG) is a complex signal that may require several years of training, advanced signal processing, and feature extraction methodologies to interpret correctly. Recently, many methods have been used to extract and classify EEG data. This study reviews 62 papers that used EEG signals to detect driver drowsiness, published between January 2018 and 2022. We extract trends and highlight interesting approaches from this large body of literature to inform future research and formulate recommendations. To find relevant papers published in scientific journals, conferences, and electronic preprint repositories, researchers searched major databases covering the domains of science and engineering. For each investigation, many data items about (1) the data, (2) the channels used, (3) the extraction and classification procedure, and (4) the outcomes were extracted. These items were then analyzed one by one to uncover trends. Our analysis reveals that the amount of EEG data used across studies varies. We saw that more than half the studies used simulation driving experimental. About 21% of the studies used support vector machine (SVM), while 19% used convolutional neural networks (CNN). Overall, we can conclude that drowsiness and fatigue impair driving performance, resulting in drivers who are more exposed to risky situations. [ABSTRACT FROM AUTHOR]

The main purpose of the research on map emotional semantics is to describe and express the emotional responses caused by people observing images through computer technology. Nowadays, map application scenarios tend to be diversified, and the increasing demand for emotional information of map users bring new challenges for cartography. However, the lack of evaluation of emotions in the traditional map drawing process makes it difficult for the resulting maps to reach emotional resonance with map users. The core of solving this problem is to quantify the emotional semantics of maps, it can help mapmakers to better understand map emotions and improve user satisfaction. This paper aims to perform the quantification of map emotional semantics by applying transfer learning methods and the efficient computational power of convolutional neural networks (CNN) to establish the correspondence between visual features and emotions. The main contributions of this paper are as follows: (1) a Map Sentiment Dataset containing five discrete emotion categories; (2) three different CNNs (VGG16, VGG19, and InceptionV3) are applied for map sentiment classification task and evaluated by accuracy performance; (3) six different parameter combinations to conduct experiments that would determine the best combination of learning rate and batch size; and (4) the analysis of visual variables that affect the sentiment of a map according to the chart and visualization results. The experimental results reveal that the proposed method has good accuracy performance (around 88%) and that the emotional semantics of maps have some general rules. A Map Sentiment Dataset with five discrete emotions is constructed Map emotional semantics are classified by deep learning approaches Visual variables Influencing map sentiment are analyzed. [ABSTRACT FROM AUTHOR]

Diabetes is a widely spread disease that significantly affects people's lives. The leading cause is uncontrolled levels of blood glucose, which develop eye defects over time, including Diabetic Retinopathy (DR), which results in severe visual loss. The primary factor causing blindness is considered to be DR in diabetic patients. DR treatment tries to control the disease's severity, as it is irreversible. The primary goal of this effort is to create a reliable method for automatically detecting the severity of DR. This paper proposes a new automated system (DR-NASNet) to detect and classify DR severity using an improved pretrained NASNet Model. To develop the DR-NASNet system, we first utilized a preprocessing technique that takes advantage of Ben Graham and CLAHE to lessen noise, emphasize lesions, and ultimately improve DR classification performance. Taking into account the imbalance between classes in the dataset, data augmentation procedures were conducted to control overfitting. Next, we have integrated dense blocks into the NASNet architecture to improve the effectiveness of classification results for five severity levels of DR. In practice, the DR-NASNet model achieves state-of-the-art results with a smaller model size and lower complexity. To test the performance of the DR-NASNet system, a combination of various datasets is used in this paper. To learn effective features from DR images, we used a pretrained model on the dataset. The last step is to put the image into one of five categories: No DR, Mild, Moderate, Proliferate, or Severe. To carry this out, the classifier layer of a linear SVM with a linear activation function must be added. The DR-NASNet system was tested using six different experiments. The system achieves 96.05% accuracy with the challenging DR dataset. The results and comparisons demonstrate that the DR-NASNet system improves a model's performance and learning ability. As a result, the DR-NASNet system provides assistance to ophthalmologists by describing an effective system for classifying early-stage levels of DR. [ABSTRACT FROM AUTHOR]

Deep learning has dominated the research field of traffic sign detection, but the traffic sign detection algorithms based on deep learning have difficulty in solving the two tasks of localization and classification simultaneously when performing traffic sign detection on realistic and complex traffic scene images, and the images or the types of traffic signs provided by the public dataset used by the relevant algorithm cannot meet the situations encountered in realistic traffic scenes.To solve the above problems, this paper creates a new road traffic sign dataset, and based on the YOLOv4 algorithm, designs a multi-size feature extraction module and an enhanced feature fusion module to improve the algorithm's ability to locate and classify traffic signs simultaneously, in view of the complexity of realistic traffic scene images and the large variation of traffic sign sizes in the images. The experimental results on the newly created dataset show that the improved algorithm achieves 83.63% mean Average Precision (mAP), which is higher than several major object detection algorithms based on deep learning for the same type of task at present. The newly created dataset in this paper is publicly available at . [ABSTRACT FROM AUTHOR]

Fault type and fault degree identification are the main aim in the bearing multi-task learning. However, a large number of on-site accidents have shown that the bearing working condition plays an important role in bearing service life and fault diagnosis. In current studies, the bearing working condition identification task is often used for auxiliary tasks and is easily ignored. Thus, this paper studies the bearing multi-task learning, which regards the working condition identification task as an equally important task. However, simply adding the working condition identification task to the frequently used multi-task model will lead to a reduction in the overall performance of the network. To solve the network performance degradation problem, a succinct and effective multi-task one-dimensional convolutional neural network with attention guidance mechanism and multi-scale feature extraction (MAM-1DCNN) is proposed. Firstly, the time-series signal is selected as the input of the MAM-1DCNN model. Secondly, the shared network of the MAM-1DCNN model applies a double-layer multi-scale convolutional neural network structure to extract more complete information. Finally, the MAM-1DCNN applies an improved attention guidance mechanism to enhance the feature application ability of different branch tasks. Through two general bearings datasets, this paper verifies the effectiveness and generalisation ability of the MAM-1DCNN model. [ABSTRACT FROM AUTHOR]

Chinese calligraphy is one of the excellent expressions of Chinese traditional art. But people without domain knowledge of calligraphy can hardly read, appreciate, or learn this art form, due to it contains many brush strokes with unique shapes and complicate structural topological relationship. In this paper, we explore the solution of text sequence recognition of calligraphy, which is a challenging task because traditional algorithms of text recognition can rarely obtain the satisfied results for the varied styles of calligraphy. Therefore, based on a trainable neural network, this paper proposes an easy recognition method, which combines feature sequence extraction based on DenseNet (Dense Convolutional Network) model, sequence modeling and transcription into a consolidated architecture. Compared with previous algorithms for text recognition, it has two distinctive properties: One is to acquire the artistic features on shapes and structures of different styles of calligraphic characters and the other is to handel sequences in arbitrary lengths without character segmentation. Our experimental results prove that in contrast with several common recognition methods, our method of Chinese calligraphic character in diverse styles demonstrates greater robustness, and the recognition accuracy rate reaches 84.70%. [ABSTRACT FROM AUTHOR]

In recent years, single-image super-resolution (SISR) has acquired tremendous progress with the development of deep learning. However, the majority of SISR methods based on deep learning focus on building more complex networks, which inevitably lead to the problems of computational and memory costs. Thus, these methods may fail to be applied in real-world scenarios. To solve this problem, this paper proposes a lightweight convolution network combined with transformer for SISR named as MMSR. Specifically, an efficient convolutional neural network (CNN) based on multi-scale feature fusion is designed for local feature extraction, which is called MFF-CNN. In addition, we propose a simple and efficient multiple attention block (MAB) to further utilize the context information in features. MAB incorporates channel attention and transformer to help network obtain similar features at a long-term dependence, making full use of global information to further refine texture details. Finally, this paper provides comprehensive results for different settings of the entire network. Experimental results on common used datasets demonstrate that the proposed method can achieve better performances at the 2 × , 3 × and 4 × scales than other state-of-the-art lightweight methods. [ABSTRACT FROM AUTHOR]

The paper introduces an innovative framework for rotating machinery fault recognition by combining Empirical Mode Decomposition (EMD) and Convolutional Neural Network (CNN). This novel approach integrates feature extraction and selection, utilizing deep learning for precise classification of transmission components faults. Our method achieves an impressive accuracy of 98,97 %. This robust technology significantly enhances the detection and diagnosis of transmission faults in metallurgical plant, providing an efficient solution for intelligent manufacturing applications. [ABSTRACT FROM AUTHOR]

Collecting and analyzing data from all devices to improve the efficiency of business processes is an important task of Industrial Internet of Things (IIoT). In the age of data explosion, extensive text data generated by the IIoT have given birth to a variety of text representation methods. The task of text representation is to convert the natural language to a form that computer can understand with retaining the original semantics. However, these methods are difficult to effectively extract the semantic features among words and distinguish polysemy in natural language. Combining the advantages of convolutional neural network (CNN) and variational autoencoder (VAE), this paper proposes an intelligent CNN-VAE text representation algorithm as an advanced learning method for social big data within next-generation IIoT, which help users identify the information collected by sensors and perform further processing. This method employs the convolution layer to capture the local features of the context and uses the variational technique to reconstruct feature space to make it conform to the normal distribution. In addition, the improved word2vec model based on topical word embedding (TWE) is utilized to add topical information to word vectors to distinguish polysemy. This paper takes the social big data as an example to illustrate the way of the proposed algorithm applied in the next-generation IIoT and utilizes Cnews dataset to verify the performance of proposed method with four evaluating metrics (i.e., recall, accuracy, precision, and F1-score). Experimental results indicate that the proposed method outperforms word2vec-avg and CNN-AE in K-nearest neighbor (KNN), random forest (RF), and support vector machine (SVM) classifiers and distinguishes polysemy effectively. [ABSTRACT FROM AUTHOR]

Visual signals are the upmost important source for robots, vehicles or machines to achieve human-like intelligence. Human beings heavily depend on binocular vision to understand the dynamically changing world. Similarly, intelligent robots or machines must also have the innate capabilities of perceiving knowledge from visual signals. Until today, one of the biggest challenges faced by intelligent robots or machines is the matching in stereovision. In this paper, we present the details of a new principle toward achieving a robust matching solution which leverages on the use and integration of top-down image sampling strategy, hybrid feature extraction, and Restricted Coulomb Energy (RCE) neural network for incremental learning (i.e., cognition) as well as robust match-maker (i.e., recognition). A preliminary version of the proposed solution has been implemented and tested with data from Maritime RobotX Challenge. The contribution of this paper is to attract more research interest and effort toward this new direction which may eventually lead to the development of robust solutions expected by future stereovision systems in intelligent robots, vehicles, and machines. [ABSTRACT FROM AUTHOR]

Gait phase recognition is of great importance in the development of rehabilitation devices. The advantages of Long Short-Term Memory (LSTM) and Convolutional Neural Network (CNN) are combined (LSTM-CNN) in this paper, then a gait phase recognition method based on LSTM-CNN neural network model is proposed. In the LSTM-CNN model, the LSTM layer is used to process temporal sequences and the CNN layer is used to extract features A wireless sensor system including six inertial measurement units (IMU) fixed on the six positions of the lower limbs was developed. The difference in the gait recognition performance of the LSTM-CNN model was estimated using different groups of input data collected by seven different IMU grouping methods. Four phases in a complete gait were considered in this paper including the supporting phase with the right hill strike (SU-RHS), left leg swimming phase (SW-L), the supporting phase with the left hill strike (SU-LHS), and right leg swimming phase (SW-R). The results show that the best performance of the model in gait recognition appeared based on the group of data from all the six IMUs, with the recognition precision and macro-F1 unto 95.03% and 95.29%, respectively. At the same time, the best phase recognition accuracy for SU-RHS and SW-R appeared and up to 96.49% and 95.64%, respectively. The results also showed the best phase recognition accuracy (97.22%) for SW-L was acquired based on the group of data from four IMUs located at the left and right thighs and shanks. Comparably, the best phase recognition accuracy (97.86%) for SU-LHS was acquired based on the group of data from four IMUs located at left and right shanks and feet. Ulteriorly, a novel gait recognition method based on Data Pre-Filtering Long Short-Term Memory and Convolutional Neural Network (DPF-LSTM-CNN) model was proposed and its performance for gait phase recognition was evaluated. The experiment results showed that the recognition accuracy reached 97.21%, which was the highest compared to Deep convolutional neural networks (DCNN) and CNN-LSTM. [ABSTRACT FROM AUTHOR]

In the field of image fusion, spatial detail blurring and color distortion appear in synthetic aperture radar (SAR) images and multispectral (MS) during the traditional fusion process due to the difference in sensor imaging mechanisms. To solve this problem, this paper proposes a fusion method for SAR images and MS images based on a convolutional neural network. In order to make use of the spatial information and different scale feature information of high-resolution SAR image, a dual-channel feature extraction module is constructed to obtain a SAR image feature map. In addition, different from the common direct addition strategy, an attention-based feature fusion module is designed to achieve spectral fidelity of the fused images. In order to obtain better spectral and spatial retention ability of the network, an unsupervised joint loss function is designed to train the network. In this paper, the Sentinel 1 SAR images and Landsat 8 MS images are used as datasets for experiments. The experimental results show that the proposed algorithm has better performance in quantitative and visual representation when compared with traditional fusion methods and deep learning algorithms. [ABSTRACT FROM AUTHOR]

Aiming at the problems of low recognition accuracy and large calculation amount of age estimation, this paper proposes a staged single aggregation backbone network VoVNetv4. In order to improve the feature extraction ability of the network, the Regional One-Shot Aggregation (ROSA) module is proposed in the network for regional encapsulation of the feature module. The classifier adopts the COnsistent RAnk Logits (CORAL) framework, which can solve the problem of inconsistency of classifiers in ordered regression CNNs for multiple binary classification tasks. This paper conducts experimental verification on the Asian Face Age Dataset (AFAD) and compares it with other research methods. The experimental results show that VoVNetv4 can effectively improve the feature extraction and detection ability of the network and improve the detection efficiency of age estimation. [ABSTRACT FROM AUTHOR]

The goal of this paper is to propose a method to achieve a higher classification rate in Polarimetric Synthetic Aperture Radar (PolSAR) image classification. In our work, PolSAR features are extracted from Convolutional Neural Networks (CNNs) and also Graph Convolutional Networks (GCNs). Due to the construction of the adjacency matrix on all the data, traditional GCNs usually suffer from a substantial computational cost, particularly in large‐scale remote sensing (RS) problems. To this end, first of all, we propose a new mini‐batch GCN (called Mini‐GCN), which allows to train large‐scale GCNs in a mini‐batch fashion. More significantly, our designed mini‐GCN is capable of inferring out‐of‐sample data without re‐training networks and improving classification performance. Furthermore, as CNNs and GCNs can extract different types of PolSAR features, an intuitive solution to break the performance bottleneck of a single model is to fuse them. Since mini‐GCNs can perform batch‐wise network training (enabling the combination of CNNs and GCNs), we can use the feature fusion strategy. Therefore, in this paper, a local graph‐based fusion method is proposed to couple dimension reduction and feature fusion of the information extracted from the designed CNN and Mini‐GCN. Experimental results on real PolSAR data are very encouraging. Compared to the methods using only single feature and stacking all the features together, the proposed feature fusion method improves the overall classification accuracy on the real PolSAR data sets for more than 5%. Moreover, the experiments conducted on PolSAR datasets, demonstrate the advantages of the used mini‐GCNs over the traditional GCNs and the superiority of the proposed feature fusion method with regards to the single CNN or GCN models. [ABSTRACT FROM AUTHOR]

Accurately detecting falls and providing clear directions for the fall can greatly assist medical staff in promptly developing rescue plans and reducing secondary injuries during transportation to the hospital. In order to facilitate portability and protect people's privacy, this paper presents a novel method for detecting fall direction during motion using the FMCW radar. We analyze the fall direction in motion based on the correlation between different motion states. The range–time (RT) features and Doppler–time (DT) features of the person from the motion state to the fallen state were obtained by using the FMCW radar. We analyzed the different features of the two states and used a two-branch convolutional neural network (CNN) to detect the falling direction of the person. In order to improve the reliability of the model, this paper presents a pattern feature extraction (PFE) algorithm that effectively eliminates noise and outliers in RT maps and DT maps. The experimental results show that the method proposed in this paper has an identification accuracy of 96.27% for different falling directions, which can accurately identify the falling direction and improve the efficiency of rescue. [ABSTRACT FROM AUTHOR]

A significant majority of the population in India makes their living through agriculture. Different illnesses that develop due to changing weather patterns and are caused by pathogenic organisms impact the yields of diverse plant species. The present article analyzed some of the existing techniques in terms of data sources, pre-processing techniques, feature extraction techniques, data augmentation techniques, models utilized for detecting and classifying diseases that affect the plant, how the quality of images was enhanced, how overfitting of the model was reduced, and accuracy. The research papers for this study were selected using various keywords from peer-reviewed publications from various databases published between 2010 and 2022. A total of 182 papers were identified and reviewed for their direct relevance to plant disease detection and classification, of which 75 papers were selected for this review after exclusion based on the title, abstract, conclusion, and full text. Researchers will find this work to be a useful resource in recognizing the potential of various existing techniques through data-driven approaches while identifying plant diseases by enhancing system performance and accuracy. [ABSTRACT FROM AUTHOR]

In recent years, the application of semantic segmentation methods based on the remote sensing of images has become increasingly prevalent across a diverse range of domains, including but not limited to forest detection, water body detection, urban rail transportation planning, and building extraction. With the incorporation of the Transformer model into computer vision, the efficacy and accuracy of these algorithms have been significantly enhanced. Nevertheless, the Transformer model's high computational complexity and dependence on a pre-training weight of large datasets leads to a slow convergence during the training for remote sensing segmentation tasks. Motivated by the success of the adapter module in the field of natural language processing, this paper presents a novel adapter module (ResAttn) for improving the model training speed for remote sensing segmentation. The ResAttn adopts a dual-attention structure in order to capture the interdependencies between sets of features, thereby improving its global modeling capabilities, and introduces a Swin Transformer-like down-sampling method to reduce information loss and retain the original architecture while reducing the resolution. In addition, the existing Transformer model is limited in its ability to capture local high-frequency information, which can lead to an inadequate extraction of edge and texture features. To address these issues, this paper proposes a Local Feature Extractor (LFE) module, which is based on a convolutional neural network (CNN), and incorporates multi-scale feature extraction and residual structure to effectively overcome this limitation. Further, a mask-based segmentation method is employed and a residual-enhanced deformable attention block (Deformer Block) is incorporated to improve the small target segmentation accuracy. Finally, a sufficient number of experiments were performed on the ISPRS Potsdam datasets. The experimental results demonstrate the superior performance of the model described in this paper. [ABSTRACT FROM AUTHOR]

Due to the complexity of electromechanical equipment and the difficulties in obtaining large-scale health monitoring datasets, as well as the long-tailed distribution of data, existing methods ignore certain characteristics of health monitoring data. In order to solve these problems, this paper proposes a method for the fault diagnosis of rolling bearings in electromechanical equipment based on an improved prototypical network—the weight prototypical networks (WPorNet). The main contributions of this paper are as follows: (1) the prototypical networks, which perform well on small-sample classification tasks, were improved by calculating the different levels of influence of support sample distributions in order to achieve the prototypical calculation. The change in sample influence was calculated using the Kullback–Leibler divergence of the sample distribution. The influence change in a specific sample can be measured by assessing how much the distribution changes in the absence of that sample; and (2) The Gramian Angular Field (GAF) algorithm was used to transform one-dimensional time series into two-dimensional vibration images, which greatly improved the application effect of the 2D convolutional neural network (CNN). Through experiments on MAFAULDA and CWRU bearing datasets, it was shown that this network effectively solves the shortcomings of a small number of valid samples and a long-tail distribution in health monitoring data, it enhances the dependency between the samples and the global data, it improves the model's feature extraction ability, and it enhances the accuracy of model classification. Compared with the prototypical network, the improved network model increased the performance of the 2-way 10-shot, 2-way 20-shot, and 2-way 50-shot classification tasks by 5.23%, 5.74%, and 4.37%, respectively, and it increased the performance of the 4-way 10-shot, 4-way 20-shot, and 4-way 50-shot classification tasks by 12.02%, 10.47%, and 4.66%, respectively. Experimental results show that the improved prototypical network model has higher sample classification accuracy and stronger anti-interference ability compared with traditional small-sample classification models. [ABSTRACT FROM AUTHOR]

The convolutional neural network has been proven to be a robust recognition and diagnosis model for modelling diseases. In general, a convolutional neural network consists of feature learning which is considered a vital process in terms of feature extraction and classifier algorithms used for decision-making. In recent years, various pooling operations considered the spine of the feature learning layer have been developed in the literature; unfortunately, few of them can be spread to tackle the overfitting problem. In this paper, a novel pooling approach termed whole image average pooling is proposed to hold over the most significant feature information on the learning layer. The proposed method consists of two main stages: in the first stage, the average of all the values of the input image is calculated, in the second stage, the input image is divided into regions that represent the feature set of the input image, and then, the values of the regions are calculated. While obtaining the values of these features, the average of all values of the input image is taken into account. The proposed whole image average pooling approach addresses the overfitting problem by processing all pixel values in the image data and is used to get the important feature information from the medical datasets. To evaluate the performance of the proposed whole image average pooling, four clinically applicable tumour datasets as medical datasets have been trained and tested on seven convolutional neural network models AlexNet, VGG16, ResNet18, GoogleNet, ResNet50, R-CNN, and Faster R-CNN. The experimental outcomes demonstrate that the proposed whole image average pooling consistently outperformed the state-of-the-art pooling operation in terms of accuracy, sensitivity, specificity, positive predictive value, false-positive rate, and F1-measure evaluation criteria in three datasets. [ABSTRACT FROM AUTHOR]

The pooling layer in convolutional neural networks plays a crucial role in reducing spatial dimensions, and improving computational efficiency. However, standard pooling operations such as max pooling or average pooling are not suitable for all applications and data types. Therefore, developing custom pooling layers that can adaptively learn and extract relevant features from specific datasets is of great significance. In this paper, we propose a novel approach to design and implement customizable pooling layers to enhance feature extraction capabilities in CNNs. The proposed T-Max-Avg pooling layer incorporates a threshold parameter T, which selects the K highest interacting pixels as specified, allowing it to control whether the output features of the input data are based on the maximum values or weighted averages. By learning the optimal pooling strategy during training, our custom pooling layer can effectively capture and represent discriminative information in the input data, thereby improving classification performance. Experimental results show that the proposed T-Max-Avg pooling layer achieves good performance on three different datasets. When compared to LeNet-5 model with average pooling, max pooling, and Avg-TopK methods, the T-Max-Avg pooling method achieves the highest accuracy on CIFAR-10, CIFAR-100, and MNIST datasets. [ABSTRACT FROM AUTHOR]

Accurate delineation of individual agricultural plots, the foundational units for agriculture-based activities, is crucial for effective government oversight of agricultural productivity and land utilization. To improve the accuracy of plot segmentation in high-resolution remote sensing images, the paper collects GF-2 satellite remote sensing images, uses ArcGIS10.3.1 software to establish datasets, and builds UNet, SegNet, DeeplabV3+, and TransUNet neural network frameworks, respectively, for experimental analysis. Then, the TransUNet network with the best segmentation effects is optimized in both the residual module and the skip connection to further improve its performance for plot segmentation in high-resolution remote sensing images. This article introduces Deformable ConvNets in the residual module to improve the original ResNet50 feature extraction network and combines the convolutional block attention module (CBAM) at the skip connection to calculate and improve the skip connection steps. Experimental results indicate that the optimized remote sensing plot segmentation algorithm based on the TransUNet network achieves an Accuracy of 86.02%, a Recall of 83.32%, an F1-score of 84.67%, and an Intersection over Union (IOU) of 86.90%. Compared to the original TransUNet network for remote sensing land parcel segmentation, whose F1-S is 81.94% and whose IoU is 69.41%, the optimized TransUNet network has significantly improved the performance of remote sensing land parcel segmentation, which verifies the effectiveness and reliability of the plot segmentation algorithm. [ABSTRACT FROM AUTHOR]

Lightweight ship detection is an important application of synthetic aperture radar (SAR). The prevailing trend in recent research involves employing a detection framework based on convolutional neural networks (CNNs) and horizontal bounding boxes (HBBs). However, CNNs with local receptive fields fall short in acquiring adequate contextual information and exhibit sensitivity to noise. Moreover, HBBs introduce significant interference from both the background and adjacent ships. To overcome these limitations, this paper proposes a lightweight transformer-based method for detecting arbitrarily oriented ships in SAR images, called LD-Det, which excels at promptly and accurately identifying rotating ship targets. First, light pyramid vision transformer (LightPVT) is introduced as a lightweight backbone network. Built upon PVT v2-B0-Li, it effectively captures the long-range dependencies of ships in SAR images. Subsequently, multi-scale deformable feature pyramid network (MDFPN) is constructed as a neck network, utilizing the multi-scale deformable convolution (MDC) module to adjust receptive field regions and extract ship features from SAR images more effectively. Lastly, shared deformable head (SDHead) is proposed as a head network, enhancing ship feature extraction with the combination of deformable convolution operations and a shared parameter structure design. Experimental evaluations on two publicly available datasets validate the efficacy of the proposed method. Notably, the proposed method achieves state-of-the-art detection performance when compared with other lightweight methods in detecting rotated targets. [ABSTRACT FROM AUTHOR]

This paper proposed a real-time fault diagnostic method for hydraulic systems using data collected from multiple sensors. The method is based on a proposed multi-sensor convolutional neural network (MS-CNN) that incorporates feature extraction, sensor selection, and fault diagnosis into an end-to-end model. Both the sensor selection process and fault diagnosis process are based on abstract fault-related features learned by a CNN deep learning model. Therefore, compared with the traditional sensor-and-feature selection method, the proposed MS-CNN can find the sensor channels containing higher-level fault-related features, which provides two advantages for diagnosis. First, the sensor selection can reduce the redundant information and improve the diagnostic performance of the model. Secondly, the reduced number of sensors simplifies the model, reducing communication burden and computational complexity. These two advantages make the MS-CNN suitable for real-time hydraulic system fault diagnosis, in which the multi-sensor feature extraction and the computation speed are both significant. The proposed MS-CNN approach is evaluated experimentally on an electric-hydraulic subsea control system test rig and an open-source dataset. The proposed method shows obvious superiority in terms of both diagnosis accuracy and computational speed when compared with traditional CNN models and other state-of-the-art multi-sensor diagnostic methods. [ABSTRACT FROM AUTHOR]

Automatic extraction of building contours from high-resolution images is of great significance in the fields of urban planning, demographics, and disaster assessment. Network models based on convolutional neural network (CNN) and transformer technology have been widely used for semantic segmentation of buildings from high resolution remote sensing images (HRSI). However, the fixed geometric structure and the local receptive field of the convolutional kernel are not good at global feature extraction, and the transformer technique with self-attention mechanism introduces computational redundancies and extracts local feature details poorly in the process of modeling the global contextual information. In this paper, a dual-branch fused reconstructive transformer network, DFRTNet, is proposed for efficient and accurate building extraction. In the encoder, the traditional transformer is reconfigured by designing the local and global feature extraction module (LGFE); the branch of global feature extraction (GFE) performs dynamic range attention (DRA) based on the idea of top-k attention for extracting global features; furthermore, the branch of local feature extraction (LFE) is used to obtain fine-grained features. The multilayer perceptron (MLP) is employed to efficiently fuse the local and global features. In the decoder, a simple channel attention module (CAM) is used in the up-sampling part to enhance channel dimension features. Our network achieved the best segmentation accuracy on both the WHU and Massachusetts building datasets when compared to other mainstream and state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Traffic time series anomaly detection has been intensively studied for years because of its potential applications in intelligent transportation. However, classical traffic anomaly detection methods often overlook the evolving dynamic associations between road network nodes, which leads to challenges in capturing the long-term temporal correlations, spatial characteristics, and abnormal node behaviors in datasets with high periodicity and trends, such as morning peak travel periods. In this paper, we propose a mirror temporal graph autoencoder (MTGAE) framework to explore anomalies and capture unseen nodes and the spatiotemporal correlation between nodes in the traffic network. Specifically, we propose the mirror temporal convolutional module to enhance feature extraction capabilities and capture hidden node-to-node features in the traffic network. Morever, we propose the graph convolutional gate recurrent unit cell (GCGRU CELL) module. This module uses Gaussian kernel functions to map data into a high-dimensional space, and enables the identification of anomalous information and potential anomalies within the complex interdependencies of the traffic network, based on prior knowledge and input data. We compared our work with several other advanced deep-learning anomaly detection models. Experimental results on the NYC dataset illustrate that our model works best compared to other models for traffic anomaly detection. [ABSTRACT FROM AUTHOR]

This paper introduces a novel method for satellite colour imagery retrieval, based on an adaptive Gaussian–Markov random field (AGMRF) model with the Bayes-driven deep convolutional neural network (AGMRF–BDCNN). The given input imagery is segregated into the structure, microstructure, and texture components, and the AGMRF-driven features and statistical features are extracted from the segregated components and are formulated as a feature vector of the query imagery. Cosine direction and Bhattacharyya distance measures are deployed to match the feature vector with the feature vector of the feature vector database. If the query imagery features match the feature-vector database's features, then the reference imagery in the database is marked and indexed. The indexed imageries are retrieved. Three different benchmark data sets, SceneSat, PatternNet, and UC Merced, have been used to validate the proposed AGMRF–BDCNN method. For the SceneSat data set, the AGMRF–BDCNN method results in 0.2319 scores for ANMRR and 0.7156 scores for mAP; for the UC Merced data set, it yields 0.2316 scores for ANMRR and 0.7816 scores for mAP; for PatternNet data set, it achieves 0.2405 scores for ANMRR and 0.6979 scores for mAP. The obtained results are comparable to state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Effectively evaluating the perceptual quality of dehazed images remains an under-explored research issue. In this paper, we propose a no-reference complex-valued convolutional neural network (CV-CNN) model to conduct automatic dehazed image quality evaluation. Specifically, a novel CV-CNN is employed that exploits the advantages of complex-valued representations, achieving better generalization capability on perceptual feature learning than real-valued ones. To learn more discriminative features to analyze the perceptual quality of dehazed images, we design a dual-stream CV-CNN architecture. The dual-stream model comprises a distortion-sensitive stream that operates on the dehazed RGB image, and a haze-aware stream on a novel dark channel difference image. The distortion-sensitive stream accounts for perceptual distortion artifacts, while the haze-aware stream addresses the possible presence of residual haze. Experimental results on three publicly available dehazed image quality assessment (DQA) databases demonstrate the effectiveness and generalization of our proposed CV-CNN DQA model as compared to state-of-the-art no-reference image quality assessment algorithms. [ABSTRACT FROM AUTHOR]

Single image super‐resolution (SISR) has been revolutionized by convolutional neural networks (CNN). However, existing SISR algorithms have feature extraction and adaptive adjustment limitations, leading to information duplication and unsatisfactory image reconstruction. In this paper, we propose a deep and adaptive feature extraction attention network (DAAN), which first fully extracts shallow features and then adaptively captures precise and fine‐scale features by a deep feature extraction block (DFEB). It includes multi‐dimensional feature extraction blocks (MFEBs) that combine large kernel and dynamic convolution layers to improve large‐scale information utilization effectively. Finally, an enhanced spatial attention block (ESAB) to further selectively reinforce the transmission of details. A large number of experimental results show that our proposed model reconstruction performance is superior to existing classical methods. [ABSTRACT FROM AUTHOR]

In the context of TinyML, many research efforts have been devoted to designing forward topologies to support On-Device Learning. Reaching this target would bring numerous advantages, including reductions in latency and computational complexity, stronger privacy, data safety and robustness to adversarial attacks, higher resilience against concept drift, etc. However, On-Device Learning on resource constrained devices poses severe limitations to computational power and memory. Therefore, deploying Neural Networks on tiny devices appears to be prohibitive, since their backpropagation-based training is too memory demanding for their embedded assets. Using Extreme Learning Machines based on Convolutional Neural Networks might be feasible and very convenient, especially for Feature Extraction tasks. However, it requires searching for a randomly initialized topology that achieves results as good as those achieved by the backpropagated model. This work proposes a novel approach for automatically composing an Extreme Convolutional Feature Extractor, based on Neural Architecture Search and Bayesian Optimization. It was applied to the CIFAR-10 and MNIST datasets for evaluation. Two search spaces have been defined, as well as a search strategy that has been tested with two surrogate models, Gaussian Process and Random Forest. A performance estimation strategy was defined, keeping the feature set computed by the MLCommons-Tiny benchmark ResNet as a reference model. In as few as 1200 search iterations, the proposed strategy was able to achieve a topology whose extracted features scored a mean square error equal to 0.64 compared to the reference set. Further improvements are required, with a target of at least one order of magnitude decrease in mean square error for improved classification accuracy. The code is made available via GitHub to allow for the reproducibility of the results reported in this paper. [ABSTRACT FROM AUTHOR]

Stereo matching is a fundamental technique for many vision and robotics applications. State-of-the-art methods either employ convolutional neural networks with spatially-shared kernels or utilize content-dependent interactions (e.g., local or global attention) to augment convolution operations. Despite of great improvements being made, existing methods could either suffer from a high computational cost arising from global attention operations or a suboptimal performance at edge regions due to spatially-shared convolutions. In this paper, we propose a CoAtRS stereo matching method to exert the complementary advantages of convolution and attention to the full via region separation. Our method can adaptively adopt the most suitable feature extraction and aggregation patterns for smooth and edge regions with less computational cost. In addition, we propose D-global attention which performs global filtering on the disparity dimension to better fuse cost volumes of different regions and alleviate the locality defects of convolutions. Our CoAtRS stereo matching method can also be embedded conveniently in various existing 3D CNN stereo networks. The resulting networks can achieve significant improvements in terms of both accuracy and efficiency. Furthermore, we design an accurate network (named CoAtRSNet) which achieves the state-of-the-art results on five public datasets. At the time of writing, CoAtRSNet ranks 1st–3rd on all the metrics published on the ETH3D website, ranks 2nd on Scene Flow, and ranks 1st for the Root-Mean-Square metric, 2nd for the average error metric and 3rd for the bad 0.5 metric on the Middlebury benchmark. [ABSTRACT FROM AUTHOR]

This paper proposes an unconstrained human gaze estimation approach for medium-distance scene based on monocular vision. A recurrent convolution neural network for gaze estimation is designed to construct the mapping relationship from the face image to the 3D gaze vector in the camera space, so as to complete the estimation of the human gaze. Firstly, based on the VICON system and a monocular camera, the face image sequence and gaze vector sequence of human gaze behavior are collected in different situations of medium-distance scenes to construct the time-synchronized gaze estimation dataset. Secondly, the recurrent convolutional gaze estimation neural network is designed, and the head pose feature and eye appearance feature are extracted from single frame image with monocular vision image sequences as input. Thirdly, the extracted gaze features are fused in the spatial dimension and the temporal dimension to estimate the direction of the human gaze. Finally, the cross-validation and experimental evaluation of the estimation errors of the constructed gaze estimation model are carried out. The results show that the Cross-Person experimental average error is 7.65°, and the Person-Specific experimental error is 3.88°. Compared with the Gaze360 method, the proposed approach reduces the average evaluation error of the gaze angle by 5.0% in the Cross-Person experiments and 16.6% with the Person-Specific experiments. These experiments verify the effectiveness of the proposed approach, and it has better generalization ability and robustness. [ABSTRACT FROM AUTHOR]

A pulse-like ground motion identification method is proposed based on the Siamese Convolutional Neural Networks (SCNNs). The wavelet coefficient graphs of pulse-like ground motions are used as the input data, and the features extracted by the SCNNs are used for the identification. Based on the time-domain features, pulse-like and non-pulse-like ground motions are classified into several classes. The results indicated that all the identified pulse-like ground motions have similar pulse features to the pre-selected training data. The principal advantage of the method is that the misclassification problem can be minimized by an updating procedure proposed by this paper. [ABSTRACT FROM AUTHOR]

Deep convolutional neural network (DCNN) has recently made significant strides in the classification and recognition of rice leaf disease. The majority of classification models perform disease image recognitions using collocation patterns including pooling layers, convolutional layers, and fully connected layers, followed by repeating this structure to complete depth increase. However, the key information of the lesion area is locally limited. That is to say, in the case of only performing feature extraction according to the above-mentioned model, redundant and low-correlation image feature information with the lesion area will be received, resulting in low accuracy of the model. For improvement of the network structure and accuracy promotion, here we proposed a double-branch DCNN (DBDCNN) model with a convolutional block attention module (CBAM). The results show that the accuracy of the classic models VGG-16, ResNet-50, ResNet50+CBAM, MobileNet-V2, GoogLeNet, EfficientNet-B1 and Inception-V2 is lower than the accuracy of the model in this paper (98.73%). Collectively, the DBDCNN model here we proposed might be a better choice for classification and identification of rice leaf diseases in the future, based on its novel identification strategy for crop disease diagnosis. [ABSTRACT FROM AUTHOR]

To satisfy the demand for real-time and high-precision recognition of mechanical water meter readings in natural scenes, a reading recognition method for mechanical water meters based on you only look once version 4 (YOLOv4) is proposed in this paper. First, a focus structure is introduced into the feature extraction network to expand the receptive field and reduce the loss of original information. Second, a ghost block cross stage partial module is constructed to improve the feature fusion of the network and enhance the feature representation. Finally, the loss function of YOLOv4 is improved to further enhance the detection accuracy of the network. Experimental results show that the mAP@0.5 and mAP@0.5:.95 of the proposed method are 97.9% and 77.3%, respectively, which are 1.6% and 6.0% higher, respectively, than those of YOLOv4. Additionally, the number of parameters and computation amount of the proposed method are 48.6% and 36.8% lower, respectively, whereas its inference speed is 27% higher. The proposed method is applied to assist meter reading, which significantly reduces the workload of on-site meter-reading personnel and improves work efficiency. The datasets used are available at https://github.com/914284382/Mechanical-water-meter. [ABSTRACT FROM AUTHOR]

The problem of intrusion detection has new solutions, thanks to the widespread use of machine learning in the field of network security, but it still has a few issues at this time. Traditional machine learning techniques to intrusion detection rely on expert experience to choose features, and deep learning approaches have a low detection efficiency. In this paper, an intrusion detection model based on feature selection and improved one-dimensional convolutional neural network was proposed. This model first used the extreme gradient boosting decision tree (XGboost) algorithm to sort the preprocessed data, and then it used comparison to weed out 55 features with a higher contribution. Then, the extracted features were fed into the improved one-dimensional convolutional neural network (I1DCNN), and this network training was used to complete the final classification task. The feature selection and improved one-dimensional convolutional neural network (FS-I1DCNN) intrusion detection model not only solved the traditional machine learning method of relying on expert experience to extract features but also improved the detection efficiency of the model, reduced the training time while reducing the dimension, and increased the overall accuracy. In comparison to the I1DCNN model without feature extraction and the conventional one-dimensional convolutional neural network (1DCNN) model, the experimental results demonstrate that the FS-I1DCNN model's overall accuracy increases by 0.67% and 2.94%, respectively. Its accuracy, precision, recall, and F 1 -score were significantly better than those of the other intrusion detection models, including SVM and DBN. [ABSTRACT FROM AUTHOR]

Nowadays, the issue of fluctuations in the price of digital Bitcoin currency has a striking impact on the profit or loss of people, international relations, and trade. Accordingly, designing a model that can take into account the various significant factors for predicting the Bitcoin price with the highest accuracy is essential. Hence, the current paper uses market sentiment and multiple feature extraction to present several Bitcoin price prediction models based on convolutional neural network and long short-term memory. In the proposed models, several parameters, including Twitter data, news headlines, news content, Google Trends, Bitcoin-based stock, and finance, are employed based on deep learning to make a more accurate prediction. Such parameters are the input data used to predict the Bitcoin price. Besides, the proposed model analyzes the Valence Aware Dictionary and Sentiment Reasoner sentiments to examine the market's latest news and cryptocurrencies. According to this study's various inputs and analyses, several effective feature selection methods, including mutual information regression, linear regression, correlation-based, and a combination of the feature selection models, are exploited to predict the price of Bitcoin. Finally, a careful comparison is made between the proposed models in terms of some performance criteria like mean square error (MSE), root-mean-square error, mean absolute error, median absolute error, and coefficient of determination (R2). The obtained results indicate that the proposed hybrid model based on sentiments analysis and combined feature selection with MSE value of 0.001 and R2 value of 0.98 provides better estimations with more minor errors regarding Bitcoin price. This proposed model can also be employed as an individual assistant for more informed trading decisions associated with Bitcoin. [ABSTRACT FROM AUTHOR]

Recently, many deep learning methods have achieved great results in the field of automated pavement distress detection, but most of them ignore other types of distresses beyond cracks. This paper proposes an efficient deep learning framework for automated asphalt pavement distress segmentation called pavement distress segmentation network (PDSNet). PDSNet can effectively segment multiple asphalt pavement distresses, including crack, pothole, raveling, patch, and sealed crack. It consists of two parallel feature extraction branches. One is the P branch to extract prior global information. The other is the U branch to obtain local information. By utilising the global and local features together, PDSNet can produce precise segmentation results under complicated circumstances. For deep learning purposes, a pavement distress dataset consisting of 4000 pavement images is collected and manually labelled at pixel level. Each image of the pavement dataset is a two-channel image, which is concatenated by a 2D pavement image and the correspondingly 3D pavement image. Particularly, it is the first pavement distress dataset that utilises two-channel pavement images. According to the experimental results, PDSNet yields a performance with a MIoU of 83.7%. Compared with the state-of-the-art networks, PDSNet achieves the best MIoU and has considerable parameter number and inference time. [ABSTRACT FROM AUTHOR]

Recently, convolutional neural network (CNN) has shown great power in single image super resolution (SISR) reconstruction, and achieving significant improvements over traditional methods. Despite the great success of these CNN‐based methods, direct application of these methods to some edge devices is impractical due to the large computational overhead required. To address this problem, a novel, lightweight SISR network focusing on speed and accuracy, called the multi‐path feedback fusion network (MFFN), has been designed in this paper. Specifically, in order to extract features more effectively, the authors propose a novel fusion attention feedback block (FAFB) as the main building block of MFFN. The FAFB consists of a backbone branch and several hierarchical branches. The backbone branch is composed of stacked enhanced pixel attentional blocks (EPAB), which are responsible for incremental deep feature learning on the feature map. And the hierarchical branches are responsible for extracting feature maps with different sizes of receptive fields and fusing these feature maps with the features extracted from the trunk branches to achieve multi‐scale feature learning, which the authors refer to this design as the multi‐scale fusion block (MSFB). Extra enhancement information (EIE) is added to each EPAB input, which enables the backbone branch to learn more effectively. On the other hand, the outputs of the cascade branches are further complemented by an additional feedback fusion enhancement block (FFEB) before being fused with the output of the trunk branches to achieve more comprehensive and accurate feature learning. Numerous experiments have shown that MFFN achieves higher accuracy than other state‐of‐the‐art methods on benchmark test sets. [ABSTRACT FROM AUTHOR]

Early rice disease detection is vital in preventing damage to agricultural product output and quantity in the agricultural field. Manual observations of rice diseases are tedious, costly, and time-consuming, especially when classifying disease patterns and color while dealing with non- native diseases. Hence, image processing and Machine Learning (ML) techniques are used to detect rice disease early and within a relatively brief time period. This article aims to demonstrate the performance of different ML algorithms in rice disease detection through image processing. We critically examined different techniques, and the outcomes of previous research have been reviewed to compare the performance of rice disease classifications. Performance has been evaluated based on the criteria of feature extraction, clustering, segmentation, noise reduction, and level of accuracy of disease detection techniques. This paper also showcases various algorithms for different datasets in terms of training methods, image preprocessing with clustering and filtering criteria, and testing with reliable outcomes. Through this review, we provide valuable insights into the current state of ML-based approaches for the early detection of rice diseases, and assist future research and improvement. In addition, we discuss several challenges that must be overcome in order to achieve effective identification of rice diseases. [ABSTRACT FROM AUTHOR]

The accurate classification of power quality disturbances (PQDs) is crucial for advancing real‐time monitoring and classification systems within the modern power grid. The proposed system must ensure dependable, safeguarded, and stable operating conditions amidst diverse power quality issues. This paper presents an approach to classifying power quality disturbances using a deep learning model that synergizes deep convolutional neural networks (DCNN) and Bidirectional Long Short‐Term Memory (BiLSTM). This amalgamation effectively extracts and classifies disturbance signals in real time, grounded on noise levels. The initial feature extraction from the signal is accomplished through a time‐frequency matrix. Subsequently, secondary extraction employs the BiLSTM layer to intricately and significantly classify disturbances in the power signal. This aids in transforming high‐dimensional matrices into a reduced set for enhanced performance. The detailed classification is facilitated by the softmax layer. The simulation results support the power quality evaluations under varied constraints and underscore the substantial classification of power quality disturbances through the DCNN‐BiLSTM algorithm, in comparison to alternative classification algorithms in terms of computational speed and accuracy. [ABSTRACT FROM AUTHOR]

The rapid expansion of coronavirus illness (COVID-19) became a global problem, with over 40 million confirmed individuals infected as of February 2022. Medical imaging, such as CT scans, can be used for diagnostics to counteract its spread. Automatic COVID detection tools are required to ease the process using CT scan images. This work categorizes the healthy and COVID patients based on CT scan images. As such, a GIL-CNN model is proposed to detect COVID patients in the present paper. The proposed model provides the global, intermediate, and local features that help better CT scan image feature representation by avoiding spatial loss. The support vector machine, a standard machine learning classifier, is used to classify the normal and COVID images using the GIL-CNN features. The proposed model is trained and tested on publicly available COVID-19 CT scan images. The proposed model has produced better results than state-of-the-art techniques. The proposed model can assist in the automated identification of COVID-19 patients, reducing the strain on healthcare systems. [ABSTRACT FROM AUTHOR]

Handwriting is an individual trait that serves as evidence to authenticate a particular writer. Identifying the writer of a handwritten text has shown encouraging results in examining historical and forensic documents. In this paper, we propose a novel offline writer identification system based on the challenging analysis of small amount of data to extract distinct patterns. In our deep network, the feature extraction process relies on a specially designed dual-path architecture, and the resulting embeddings are concatenated to produce the final learned features. To deal with a variety of uncertainties such as high intra-class variations and noises, we leverage the fuzzy logic in the design of a custom Convolutional Neural Network (CNN) with a type-2 fuzzy activation function for the first path. Additionally, the second path utilizes the transfer learning-based CNN to enhance the discriminability of the learned features. Our method allows for text-independent writer identification, eliminating the need for identical handwriting samples to train and test the model. Considering that various factors can influence the handwriting style, a dataset containing right-to-left handwriting samples is assembled. The proposed method is evaluated on our developed dataset and four widely-known public datasets, namely KHATT, CVL, Firemaker, and IAM. High accuracy values are achieved, with results of 99.85%, 99.83%, 99.79%, 99.64%, and 98.17% for each dataset, respectively. One noteworthy aspect of this study is that the evaluation results on diverse datasets demonstrate the applicability of the proposed model to various languages. Moreover, the model performs effectively in real-world scenarios with limited handwritten data. [ABSTRACT FROM AUTHOR]

Recognizing human activity is the process of using sensors and algorithms to identify and classify human actions based on the data collected. Human activity recognition in visible images can be challenging due to several factors of the lighting conditions can affect the quality of images and, consequently, the accuracy of activity recognition. Low lighting, for example, can make it difficult to distinguish between different activities. Thermal cameras have been utilized in earlier investigations to identify this issue. To solve this issue, we propose a novel deep learning (DL) technique for predicting and classifying human actions. In this paper, initially, to remove the noise from the given input thermal images using the mean filter method and then normalize the images using with min-max normalization method. After that, utilizing Deep Recurrent Convolutional Neural Network (DRCNN) technique to segment the human from thermal images and then retrieve the features from the segmented image So, here we choose a fully connected layer of DRCNN as the segmentation layer is utilized for segmentation, and then the multi-scale convolutional neural network layer of DRCNN is used to extract the features from segmented images to detect human actions. To recognize human actions in thermal pictures, the DenseNet-169 approach is utilized. Finally, the CapsNet technique is used to classify the human action types with Elephant Herding Optimization (EHO) algorithm for better classification. In this experiment, we select two thermal datasets the LTIR dataset and IITR-IAR dataset for good performance with accuracy, precision, recall, and f1-score parameters. The proposed approach outperforms "state-of-the-art" methods for action detection on thermal images and categorizes the items. [ABSTRACT FROM AUTHOR]