Search

In order to accurately estimate the period of X-ray pulsars to improve navigation performance, this paper proposes a pulsar period estimation method based on photon energy using reverse Hilbert coding and double Convolutional Neural Networks (CNNs) discrimination. This method uses photon energy information to perform epoch folding. It converts one-dimensional contour information into two-dimensional image signals through reverse Hilbert curve and recognizes contour image features through CNN models to determine the optimal period. According to the simulation results, the period estimation accuracy of this method is 0.5350 ns, which is 65.71% higher than the χ 2 epoch folding method. The contour phase accuracy is 0.0004767, which is 41.93% higher than the χ 2 epoch folding method. At the same time, the observation time and noise interference that may affect the accuracy of period estimation are also quantitatively analyzed. In addition, in order to simulate real navigation scenarios, this paper also conducts dynamic period estimation experiments on PSR B0531+21 pulsar in a specific period of time. The method proposed in this paper has the advantages of high precision, fast calculation speed, strong anti-interference ability and accurate dynamic period estimation, which can significantly improve the navigation performance of X-ray pulsars. • The proposed period estimation method uses photon energy information for contour weighted folding. • The proposed method uses reverse Hilbert curve to convert one-dimensional contour information into two-dimensional image information. • Convolutional Neural Network models are used to optimize pulsar period estimation. [Display omitted] [ABSTRACT FROM AUTHOR]

Delamination represents one of the most significant and dangerous damages in composite plates. Recently, many papers have presented the capability of structural health monitoring (SHM) techniques for the investigation of structural delamination with various shapes and thickness depths. However, few studies have been conducted regarding the utilization of convolutional neural network (CNN) methods for automating the non-destructive testing (NDT) techniques database to identify the delamination size and depth. In this paper, an automated system qualified for distinguishing between pristine and damaged structures and classifying three classes of delamination with various depths is presented. This system includes a proposed CNN model and the Lamb wave technique. In this work, a unidirectional composite plate with three samples of delamination inserted at different depths was prepared for numerical and experimental investigations. In the numerical part, the guided wave propagation and interaction with three samples of delamination were studied to observe how the delamination depth can affect the scattered and trapped waves over the delamination region. This numerical study was validated experimentally using an efficient ultrasonic guided waves technique. This technique involved piezoelectric wafer active sensors (PWASs) and a scanning laser Doppler vibrometer (SLDV). Both numerical and experimental studies demonstrate that the delamination depth has a direct effect on the trapped waves' energy and distribution. Three different datasets were collected from the numerical and experimental studies, involving the numerical wavefield image dataset, experimental wavefield image dataset, and experimental wavenumber spectrum image dataset. These three datasets were used independently with the proposed CNN model to develop a system that can automatically classify four classes (pristine class and three different delamination classes). The results of all three datasets show the capability of the proposed CNN model for predicting the delamination depth with high accuracy. The proposed CNN model results of the three different datasets were validated using the GoogLeNet CNN. The results of both methods show an excellent agreement. The results proved the capability of the wavefield image and wavenumber spectrum datasets to be used as input data to the CNN for the detection of delamination depth. [ABSTRACT FROM AUTHOR]

In recent years, with the rapid development of deep learning technology, a large number of excellent convolutional neural networks (CNNs) have been proposed, many of which are based on improvements to classical methods. Based on the Inception family of methods, depthwise separable convolution was applied to Xception to achieve lightweighting, and Inception-ResNet introduces residual connections to accelerate model convergence. However, existing improvements for the Inception module often neglect further enhancement of its receptive field, while increasing the receptive field of CNNs has been widely studied and proven to be effective in improving classification performance. Motivated by this fact, three effective expansion modules are proposed in this paper. The first expansion module, Inception expand (Inception-e) module, is proposed to improve the classification accuracy by concatenating more and deeper convolutional branches. To reduce the number of parameters for Inception e, this paper proposes a second expansion module—Equivalent Inception-e (Eception) module, which is equivalent to Inception-e in terms of feature extraction capability, but which suppresses the growth of the parameter quantity brought by the expansion by effectively reducing the redundant convolutional layers; on the basis of Eception, this paper proposes a third expansion module—Lightweight Eception (Lception) module, which crosses depthwise convolution with ordinary convolution to further effectively reduce the number of parameters. The three proposed modules have been validated on the Cifar10 dataset. The experimental results show that all these extensions are effective in improving the classification accuracy of the models, and the most significant effect is the Lception module, where Lception (rank = 4) on the Cifar10 dataset improves the accuracy by 1.5% compared to the baseline model (Inception module A) by using only 0.15 M more parameters. [ABSTRACT FROM AUTHOR]

The escalating worldwide power demand necessitates innovative solutions to address the emerging power crisis. Grid-synchronized electric vehicles (EVs) have emerged as a promising avenue for mitigating this crisis. The vehicle-to-grid technology is unique advanced smart grid concept by which the exchange of energy is allowed among grid and EV. The integration of EV and grid affects an entire power system causing imbalance in supply–demand, voltage and frequency. To minimize these issues, feasible optimization techniques are introduced in this paper. Lithium-ion batteries are initially charged via smart homes, and convolutional neural networks (CNN) are used to ascertain a battery's state of charge (SOC). A bidirectional SEPIC–zeta converter is employed in this paper by which voltage is either increased or decreased. The gating sequence for the converter is generated by means of adaptive neuro fuzzy inference system which depends on an estimated SOC. If the SOC is greater than 80%, battery is discharged using a SEPIC mode; if the SOC is lower than 80%, battery is charged by grid using the ZETA mode. By using a PI controller, active and reactive power are also controlled. Simulation results using MATLAB showcase the efficacy of the suggested approach. The bidirectional SEPIC–Zeta converter exhibits an impressive efficiency of 96% and a voltage gain ratio of 1:8 when compared to other converters. CNN-based SOC tracking achieves remarkable tracking efficiency of 92.3%, outperforming other tracking methods. The grid current total harmonic distortion is notably curtailed at 2.3%, and a power factor of 0.9 is achieved using PI-based grid synchronization. [ABSTRACT FROM AUTHOR]

The main purpose of this paper is to provide information on how to create a convolutional neural network (CNN) for extracting features from EEG signals. Our task was to understand the primary aspects of creating and fine-tuning CNNs for various application scenarios. We considered the characteristics of EEG signals, coupled with an exploration of various signal processing and data preparation techniques. These techniques include noise reduction, filtering, encoding, decoding, and dimension reduction, among others. In addition, we conduct an in-depth analysis of well-known CNN architectures, categorizing them into four distinct groups: standard implementation, recurrent convolutional, decoder architecture, and combined architecture. This paper further offers a comprehensive evaluation of these architectures, covering accuracy metrics, hyperparameters, and an appendix that contains a table outlining the parameters of commonly used CNN architectures for feature extraction from EEG signals. [ABSTRACT FROM AUTHOR]

The crucial part of the software development cycle is software maintenance. The demands included in the software management are fault fixes and request to change or bring a new feature. If priority is not given to these demands, then it may lead to customer dissatisfaction, inefficient planning, and software failure as well. Therefore, it is important to study the severity of the bug reports to maintain the efficiency of the software. Various research has been conducted in the past to predict the severity of the paper using text mining focusing only on the content of the bug reports. The sentiment of the user while reporting a bug also plays a vital role. In this study, we will be focusing on two aspects, that is, sentiment and content to improve the prediction. We propose a prediction model based on LDA to study the content aspect and emotion analysis to study the sentiment aspect. The model is validated on the datasets collected from the Eclipse project using Convolutional Neural Network (CNN). The results show that the CNN model effectively utilizes the content and sentiment aspect of the data to handle the severity prediction. CNN has weight sharing feature that decreases the number of parameters used for training. It also improves generalization and overfitting is avoided The Accuracy, Precision, Recall, and F‐measure are improved when both aspects are taken into account rather than considering only content. [ABSTRACT FROM AUTHOR]

Over the past decades, the software industry has expanded to include all industries. Since stakeholders tend to use it to get their work done, software houses seek to estimate the cost of the software, which includes calculating the effort, time, and resources required. Although many researchers have worked to estimate it, the prediction accuracy results are still inaccurate and unstable. Estimating it requires a lot of effort. Therefore, there is an urgent need for modern techniques that contribute to cost estimation. This paper seeks to present a model based on deep learning and machine learning techniques by combining convolutional neural networks (CNN) and the particle swarm algorithm (PSO) in the context of time series forecasting, which enables feature extraction and automatic tuning of hyperparameters, which reduces the manual effort of selecting parameters and contributes to fine-tuning. The use of PSO also enhances the robustness and generalization ability of the CNN model and its iterative nature allows for efficient discovery of hyperparameter similarity. The model was trained and tested on 13 different benchmark datasets and evaluated through six metrics: mean absolute error (MAE), mean square error (MSE), mean magnitude relative error (MMRE), root mean square error (RMSE), median magnitude relative error (MdMRE), and prediction accuracy (PRED). Comparative results reveal that the performance of the proposed model is better than other methods for all datasets and evaluation criteria. The results were very promising for predicting software cost estimation. [ABSTRACT FROM AUTHOR]

In this paper, we proposed a comparative research project on the classification of various objects in satellite images using some pre-trained models of CNN (VGG-19, ResNet-50, Inception-V3, EfficientNet-B7) and R-CNN. In this research work, we have used the DOTA dataset, which combines data from 14 classes. We have implemented above-mentioned pre-trained models of CNN and R-CNN to achieve optimal results for accuracy as well as productivity in detection of various objects such as ships, tennis courts, swimming pools, vehicles, and harbors from remotely accessed images. In this study, a convolutional neural network (CNN) is used as the base model. For complex computations and for speeding up results, transfer learning is used. With the help of experimental analysis, we have discovered that R-CNN and Inception-V3 performed best out of the five pre-trained models. [ABSTRACT FROM AUTHOR]

In this paper, an innovative cyclic noise reduction method and an improved CAPON algorithm (also the called minimum variance distortionless response (MVDR) algorithm) are proposed to improve the accuracy and reliability of DOA (direction of arrival) estimation. By processing the eigenvalues obtained from the covariance matrix of the received signal, the signal-to-noise ratio (SNR) can be increased by up to 5 dB by the cyclic noise reduction method, which will improve the DOA estimation accuracy. The improved CAPON algorithm has a convolution neural network (CNN) structure, whose input is the processed covariance matrix of the received signal, and the CAPON spectral value is used as the training label to obtain the estimated spatial spectrum. It retains the advantages of the CAPON algorithm, which can achieve blind source estimation, and simulations show that the proposed algorithm exhibits a better performance than the traditional algorithm in conditions of various SNRs and snapshot numbers. The simulation results show that, based on a certain SNR, the root mean square error (RMSE) of the improved CAPON algorithm can be reduced from 0.86° to 0.8° compared to traditional algorithms, and the angle estimation error can be decreased by up to about 0.3°. With the help of the cyclic noise reduction method, the angle estimation error decreases from 0.04° to 0.02°. [ABSTRACT FROM AUTHOR]

In biomedicine, the critical task is to decode Drug–Drug Interactions (DDIs) from complex biomedical texts. The scientific community employs Knowledge Graph Embedding (KGE) methods, enhanced with advanced neural network technologies, including capsule networks. However, existing methodologies primarily focus on the structural details of individual entities or relations within Biomedical Knowledge Graphs (BioKGs), overlooking the overall structural context of BioKGs, molecular structures, positional features of drug pairs, and their critical Relational Mapping Properties. To tackle the challenges identified, this study presents HSTrHouse an innovative hierarchical self-attention BioKGs embedding framework. This architecture integrates self-attention mechanisms with advanced neural network technologies, including Convolutional Neural Network (CNN) and Graph Neural Network (GNN), for enhanced computational modeling in biomedical contexts. The model bifurcates the BioKGs into entity and relation layers for structural analysis. It employs self-attention across these layers, utilizing PubMedBERT and CNN for position feature extraction, and a GNN for drug pair molecular structure analysis. Then, we connect the position and molecular structure features to integrate them into the self-attention calculation of entity and relation. After that, the output of the self-attention layer is combined with the connected vectors of the position feature and molecular structure feature to obtain the final representation vector, and finally, to model the Relational Mapping Properties (RMPs), the representation vector is embedded into the complex vector space using Householder projections to obtain the BioKGs model. The paper validates HSTrHouse's efficacy by comparing it with advanced models on three standard BioKGs for DDIs research. [ABSTRACT FROM AUTHOR]

Maintaining high-quality road markings is essential for both safety and traffic flow. However, there has been limited research on automating the process of evaluating the quality of these markings and identifying degraded ones that need to be fixed. Our paper introduces a new approach that uses uncertainty aware (UA) regression to evaluate the quality of road surface markings. The approach is based on deep learning models and a unique training method called "progressive pretraining (PPT)." We used a dataset of RGB images which we converted to binary masks. These masks were then augmented and used to train convolutional neural networks models with a PPT strategy. The results showed that both the hybrid and UA models managed to outperform the baseline model in some metrics such as mean average error which was at 24.38% and accuracy with 81.27%. Additionally, each model showed unique strengths across various performance metrics, highlighting the efficacy of integrating uncertainty and progressive learning in quality assessment tasks. This study presents a solid proof of concept for the application of UA methods in quality evaluation tasks in general, and surface marking quality evaluation in particular. [ABSTRACT FROM AUTHOR]

The measurement and analysis of vital signs are a subject of significant research interest, particularly for monitoring the driver's physiological state, which is of crucial importance for road safety. Various approaches have been proposed using contact techniques to measure vital signs. However, all of these methods are invasive and cumbersome for the driver. This paper proposes using a non-contact sensor based on continuous wave (CW) radar at 24 GHz to measure vital signs. We associate these measurements with distinct temporal neural networks to analyze the signals to detect and extract heart and respiration rates as well as classify the physiological state of the driver. This approach offers robust performance in estimating the exact values of heart and respiration rates and in classifying the driver's physiological state. It is non-invasive and requires no physical contact with the driver, making it particularly practical and safe. The results presented in this paper, derived from the use of a 1D Convolutional Neural Network (1D-CNN), a Temporal Convolutional Network (TCN), a Recurrent Neural Network particularly the Bidirectional Long Short-Term Memory (Bi-LSTM), and a Convolutional Recurrent Neural Network (CRNN). Among these, the CRNN emerged as the most effective Deep Learning approach for vital signal analysis. [ABSTRACT FROM AUTHOR]

Accurate urban land cover information is crucial for effective urban planning and management. While convolutional neural networks (CNNs) demonstrate superior feature learning and prediction capabilities using image-level annotations, the inherent mixed-category nature of input image patches leads to classification errors along object boundaries. Fully convolutional neural networks (FCNs) excel at pixel-wise fine segmentation, making them less susceptible to heterogeneous content, but they require fully annotated dense image patches, which may not be readily available in real-world scenarios. This paper proposes an object-based semi-supervised spatial attention residual UNet (OS-ARU) model. First, multiscale segmentation is performed to obtain segments from a remote sensing image, and segments containing sample points are assigned the categories of the corresponding points, which are used to train the model. Then, the trained model predicts class probabilities for all segments. Each unlabeled segment's probability distribution is compared against those of labeled segments for similarity matching under a threshold constraint. Through label propagation, pseudo-labels are assigned to unlabeled segments exhibiting high similarity to labeled ones. Finally, the model is retrained using the augmented training set incorporating the pseudo-labeled segments. Comprehensive experiments on aerial image benchmarks for Vaihingen and Potsdam demonstrate that the proposed OS-ARU achieves higher classification accuracy than state-of-the-art models, including OCNN, 2OCNN, and standard OS-U, reaching an overall accuracy (OA) of 87.83% and 86.71%, respectively. The performance improvements over the baseline methods are statistically significant according to the Wilcoxon Signed-Rank Test. Despite using significantly fewer sparse annotations, this semi-supervised approach still achieves comparable accuracy to the same model under full supervision. The proposed method thus makes a step forward in substantially alleviating the heavy sampling burden of FCNs (densely sampled deep learning models) to effectively handle the complex issue of land cover information identification and classification. [ABSTRACT FROM AUTHOR]

The network intrusion detection system (NIDS) plays a crucial role as a security measure in addressing the increasing number of network threats. The majority of current research relies on feature-ready datasets that heavily depend on feature engineering. Conversely, the increasing complexity of network traffic and the ongoing evolution of attack techniques lead to a diminishing distinction between benign and malicious network behaviors. In this paper, we propose a novel end-to-end intrusion detection framework based on a contrastive learning approach. We design a hierarchical Convolutional Neural Network (CNN) and Gated Recurrent Unit (GRU) model to facilitate the automated extraction of spatiotemporal features from raw traffic data. The integration of contrastive learning amplifies the distinction between benign and malicious network traffic in the representation space. The proposed method exhibits enhanced detection capabilities for unknown attacks in comparison to the approaches trained using the cross-entropy loss function. Experiments are carried out on the public datasets CIC-IDS2017 and CSE-CIC-IDS2018, demonstrating that our method can attain a detection accuracy of 99.9% for known attacks, thus achieving state-of-the-art performance. For unknown attacks, a weighted recall rate of 95% can be achieved. [ABSTRACT FROM AUTHOR]

In recent years, computer vision has witnessed remarkable advancements in image classification, specifically in the domains of fully convolutional neural networks (FCNs) and self-attention mechanisms. Nevertheless, both approaches exhibit certain limitations. FCNs tend to prioritize local information, potentially overlooking crucial global contexts, whereas self-attention mechanisms are computationally intensive despite their adaptability. In order to surmount these challenges, this paper proposes cross-and-diagonal networks (CDNet), innovative network architecture that adeptly captures global information in images while preserving local details in a more computationally efficient manner. CDNet achieves this by establishing long-range relationships between pixels within an image, enabling the indirect acquisition of contextual information. This inventive indirect self-attention mechanism significantly enhances the network's capacity. In CDNet, a new attention mechanism named "cross and diagonal attention" is proposed. This mechanism adopts an indirect approach by integrating two distinct components, cross attention and diagonal attention. By computing attention in different directions, specifically vertical and diagonal, CDNet effectively establishes remote dependencies among pixels, resulting in improved performance in image classification tasks. Experimental results highlight several advantages of CDNet. Firstly, it introduces an indirect self-attention mechanism that can be effortlessly integrated as a module into any convolutional neural network (CNN). Additionally, the computational cost of the self-attention mechanism has been effectively reduced, resulting in improved overall computational efficiency. Lastly, CDNet attains state-of-the-art performance on three benchmark datasets for similar types of image classification networks. In essence, CDNet addresses the constraints of conventional approaches and provides an efficient and effective solution for capturing global context in image classification tasks. [ABSTRACT FROM AUTHOR]

The need for efficient video coding technology is more important than ever in the current scenario where video applications are increasing worldwide, and Internet of Things (IoT) devices are becoming widespread. In this context, it is necessary to carefully review the recently completed MPEG-5 Essential Video Coding (EVC) standard because the EVC Baseline profile is customized to meet the specific requirements needed to process IoT video data in terms of low complexity. Nevertheless, the EVC Baseline profile has a notable disadvantage. Since it is a codec composed only of simple tools developed over 20 years, it tends to represent numerous coding artifacts. In particular, the presence of blocking artifacts at the block boundary is regarded as a critical issue that must be addressed. To address this, this paper proposes a post-filter using a block partitioning information-based Convolutional Neural Network (CNN). The proposed method in the experimental results objectively shows an approximately 0.57 dB for All-Intra (AI) and 0.37 dB for Low-Delay (LD) improvements in each configuration by the proposed method when compared to the pre-post-filter video, and the enhanced PSNR results in an overall bitrate reduction of 11.62% for AI and 10.91% for LD in the Luma and Chroma components, respectively. Due to the huge improvement in the PSNR, the proposed method significantly improved the visual quality subjectively, particularly in blocking artifacts at the coding block boundary. [ABSTRACT FROM AUTHOR]

Organizations managing high-performance computing systems face a multitude of challenges, including overarching concerns such as overall energy consumption, microprocessor clock frequency limitations, and the escalating costs associated with chip production. Evidently, processor speeds have plateaued over the last decade, persisting within the range of 2 GHz to 5 GHz. Scholars assert that brain-inspired computing holds substantial promise for mitigating these challenges. The spiking neural network (SNN) particularly stands out for its commendable power efficiency when juxtaposed with conventional design paradigms. Nevertheless, our scrutiny has brought to light several pivotal challenges impeding the seamless implementation of large-scale neural networks (NNs) on silicon. These challenges encompass the absence of automated tools, the need for multifaceted domain expertise, and the inadequacy of existing algorithms to efficiently partition and place extensive SNN computations onto hardware infrastructure. In this paper, we posit the development of an automated tool flow capable of transmuting any NN into an SNN. This undertaking involves the creation of a novel graph-partitioning algorithm designed to strategically place SNNs on a network-on-chip (NoC), thereby paving the way for future energy-efficient and high-performance computing paradigms. The presented methodology showcases its effectiveness by successfully transforming ANN architectures into SNNs with a marginal average error penalty of merely 2.65%. The proposed graph-partitioning algorithm enables a 14.22% decrease in inter-synaptic communication and an 87.58% reduction in intra-synaptic communication, on average, underscoring the effectiveness of the proposed algorithm in optimizing NN communication pathways. Compared to a baseline graph-partitioning algorithm, the proposed approach exhibits an average decrease of 79.74% in latency and a 14.67% reduction in energy consumption. Using existing NoC tools, the energy-latency product of SNN architectures is, on average, 82.71% lower than that of the baseline architectures. [ABSTRACT FROM AUTHOR]

Sentiment analysis has increasingly gained significance in commercial settings, driven by the rising impact of reviews on purchase decision-making in recent years. This research conducts a thorough examination of the suitability of machine learning and deep learning approaches for sentiment analysis, using Romanian reviews as a case study, with the aim of gaining insights into their practical utility. A comprehensive, multi-level analysis is performed, covering the document, sentence, and aspect levels. The main contributions of the paper refer to the in-depth exploration of multiple sentiment analysis models at three different textual levels and the subsequent improvements brought with respect to these standard models. Additionally, a balanced dataset of Romanian reviews from twelve product categories is introduced. The results indicate that, at the document level, supervised deep learning techniques yield the best outcomes (specifically, a convolutional neural network model that obtains an AUC value of 0.93 for binary classification and a weighted average F1-score of 0.77 in a multi-class setting with 5 target classes), albeit with increased resource consumption. Favorable results are achieved at the sentence level, as well, despite the heightened complexity of sentiment identification. In this case, the best-performing model is logistic regression, for which a weighted average F1-score of 0.77 is obtained in a multi-class polarity classification task with three classes. Finally, at the aspect level, promising outcomes are observed in both aspect term extraction and aspect category detection tasks, in the form of coherent and easily interpretable word clusters, encouraging further exploration in the context of aspect-based sentiment analysis for the Romanian language. [ABSTRACT FROM AUTHOR]

Transformers have been widely used in many computer vision challenges and have shown the capability of producing better results than convolutional neural networks (CNNs). Taking advantage of capturing long-range contextual information and learning more complex relations in the image data, Transformers have been used and applied to histopathological image processing tasks. In this survey, we make an effort to present a thorough analysis of the uses of Transformers in histopathological image analysis, covering several topics, from the newly built Transformer models to unresolved challenges. To be more precise, we first begin by outlining the fundamental principles of the attention mechanism included in Transformer models and other key frameworks. Second, we analyze Transformer-based applications in the histopathological imaging domain and provide a thorough evaluation of more than 100 research publications across different downstream tasks to cover the most recent innovations, including survival analysis and prediction, segmentation, classification, detection, and representation. Within this survey work, we also compare the performance of CNN-based techniques to Transformers based on recently published papers, highlight major challenges, and provide interesting future research directions. Despite the outstanding performance of the Transformer-based architectures in a number of papers reviewed in this survey, we anticipate that further improvements and exploration of Transformers in the histopathological imaging domain are still required in the future. We hope that this survey paper will give readers in this field of study a thorough understanding of Transformer-based techniques in histopathological image analysis, and an up-to-date paper list summary will be provided at https://github.com/S-domain/Survey-Paper. [ABSTRACT FROM AUTHOR]

Thanks to its richness in extractable features, Hyperspectral images (HSI) find an accelerated use in medical, industrial, agricultural, and environmental fields. In this paper, we present a wavelet-based reduction technique that creates a Hypercube containing the most significant features extracted from the original HSI and representing a multi-dimensional array that is utilized for training a Convolutional Neural Network (CNN), which is designed here to classify different types of surfaces or materials. The performance of this approach is tested and proved using two distinct datasets. Then, we compare the same approach with the PCA, a widely used reduction method. The most important contribution of this paper is the implementation of an FPGA-based parallel accelerator to train the same suggested CNN in only 10% of the computational time compared to the classical CPU-based techniques. The Microblaze will be explained and exploited here to play the role of an embedded microprocessor. • A Wavelet-based technique gives a reduced Hypercube rich in pixels spectrum features. • A CNN is designed to classify different types of surfaces or materials. • An FPGA-based parallel design is created to reduce 90% of the CNN training time. • The Microblaze is used to play the role of an embedded microprocessor. [ABSTRACT FROM AUTHOR]

Mineral particle size is an important parameter in the mineral beneficiation process. In industrial processes, the grinding process produces pulp with qualified particle size for subsequent flotation processes. In this paper, a hierarchical intelligent control method for mineral particle size based on machine learning is proposed. In the machine learning layer, artificial intelligence technologies such as long and short memory neural networks (LSTM) and convolution neural networks (CNN) are used to solve the multi-source ore blending prediction and intelligent classification of dry and rainy season conditions, and then the ore-feeding intelligent expert control system and grinding process intelligent expert system are used to coordinate the production of semi-autogenous mill and Ball mill and Hydrocyclone (SAB) process and intelligently adjust the control parameters of DCS layer. This paper presents the practical application of the method in the SAB production process of an international mine to realize automation and intelligence. The process throughput is increased by 6.05%, the power consumption is reduced by 7.25%, and the annual economic benefit has been significantly improved. [ABSTRACT FROM AUTHOR]

Sea ice is a significant factor in influencing environmental change on Earth. Monitoring sea ice is of major importance, and one of the main objectives of this monitoring is sea ice classification. Currently, synthetic aperture radar (SAR) data are primarily used for sea ice classification, with a single polarization band or simple combinations of polarization bands being common choices. While much of the current research has focused on optimizing network structures to achieve high classification accuracy, which requires substantial training resources, we aim to extract more information from the SAR data for classification. Therefore we propose a multi-featured SAR sea ice classification method that combines polarization features calculated by polarization decomposition and spectrogram features calculated by joint time-frequency analysis (JTFA). We built a convolutional neural network (CNN) structure for learning the multi-features of sea ice, which combines spatial features and physical properties, including polarization and spectrogram features of sea ice. In this paper, we utilized ALOS PALSAR SLC data with HH, HV, VH, and VV, four types of polarization for the multi-featured sea ice classification method. We divided the sea ice into new ice (NI), first-year ice (FI), old ice (OI), deformed ice (DI), and open water (OW). Then, the accuracy calculation by confusion matrix and comparative analysis were carried out. Our experimental results demonstrate that the multi-feature method proposed in this paper can achieve high accuracy with a smaller data volume and computational effort. In the four scenes selected for validation, the overall accuracy could reach 95%, 91%, 96%, and 95%, respectively, which represents a significant improvement compared to the single-feature sea ice classification method. [ABSTRACT FROM AUTHOR]

Recently, convolutional neural networks (CNNs) have been widely used in image denoising, and their performance has been enhanced through residual learning. However, previous research mostly focused on optimizing the network architecture of CNNs, ignoring the limitations of the commonly used residual learning. This paper identifies two of its limitations, which are the neglect of image information and the lack of effective consideration of image self-similarity. To solve these limitations, this paper proposes a compositional denoising network (CDN), which contains two sub-paths, the image information path (IIP) and the noise estimation path (NEP), respectively. IIP is trained via an image-to-image method to extract image information. For NEP, it utilizes image self-similarity from the perspective of training. This similarity-based training method constrains NEP to output similar estimated noise distributions for different image patches with a specific kind of noise. Finally, image information and noise distribution information are comprehensively considered for image denoising. Experimental results indicate that CDN outperforms other CNN-based methods in both synthetic and real-world image denoising, achieving state-of-the-art performance. [ABSTRACT FROM AUTHOR]

Tool wear condition monitoring is an important component of mechanical processing automation, and accurately identifying the wear status of tools can improve processing quality and production efficiency. This paper studied a new deep learning model, to identify the wear status of tools. The force signal was transformed into a two-dimensional image using continuous wavelet transform (CWT), short-time Fourier transform (STFT), and Gramian angular summation field (GASF) methods. The generated images were then fed into the proposed convolutional neural network (CNN) model for further analysis. The calculation results show that the accuracy of tool wear state recognition proposed in this paper was above 90%, which was higher than the accuracy of AlexNet, ResNet, and other models. The accuracy of the images generated using the CWT method and identified with the CNN model was the highest, which is attributed to the fact that the CWT method can extract local features of an image and is less affected by noise. Comparing the precision and recall values of the model, it was verified that the image obtained by the CWT method had the highest accuracy in identifying tool wear state. These results demonstrate the potential advantages of using a force signal transformed into a two-dimensional image for tool wear state recognition and of applying CNN models in this area. They also indicate the wide application prospects of this method in industrial production. [ABSTRACT FROM AUTHOR]

In this paper, the non-uniform illumination enhancement problem of underwater images under the artificial light sources conditions is investigated based on Convolution Neural Network (CNN). First, we propose a trainable end-to-end enhancer called NUIENet, for enhancing the non-uniform illumination of underwater images. The proposed model consists of correction network and fusion layers. The correction network adopts the encoder–decoder structure with skip connections to enhance the features of different channels in the HSV domain, and then these enhanced features are fused by the fusion layers to obtain the desired high-quality images. Second, we built an underwater images dataset using Generative Adversarial Network (GAN) and Gaussian Function. Finally, both qualitative and quantitative experimental results show that the proposed method can produce better performance compared to other state-of-the-art enhancement methods on both real-word and synthetic underwater dataset. • This paper proposes a non-uniform illumination enhancer CNN-based which uses the encoder–decoder structure with skip connections to enhance the underwater images with NUI to the desired high-quality images. • To boost underwater imaging processing, we construct a dataset of the underwater image with NUI based on the GAN and Gaussian function which contains NUI images and their corresponding high-quality reference image. • Compared with other state-of-the-art NUIE methods, the proposed network achieves a nature color correction and superior or equivalent visibility improvement. [Display omitted] [ABSTRACT FROM AUTHOR]

The popularity and demand for high-quality date palm fruits (Phoenix dactylifera L.) have been growing, and their quality largely depends on the type of handling, storage, and processing methods. The current methods of geometric evaluation and classification of date palm fruits are characterised by high labour intensity and are usually performed mechanically, which may cause additional damage and reduce the quality and value of the product. Therefore, non-contact methods are being sought based on image analysis, with digital solutions controlling the evaluation and classification processes. The main objective of this paper is to develop an automatic classification model for varieties of date palm fruits using a convolutional neural network (CNN) based on two fundamental criteria, i.e., colour difference and evaluation of geometric parameters of dates. A CNN with a fixed architecture was built, marked as DateNET, consisting of a system of five alternating Conv2D, MaxPooling2D, and Dropout classes. The validation accuracy of the model presented in this study depended on the selection of classification criteria. It was 85.24% for fruit colour-based classification and 87.62% for the geometric parameters only; however, it increased considerably to 93.41% when both the colour and geometry of dates were considered. [ABSTRACT FROM AUTHOR]

Lightning often causes death, injury, and damage to various facilities and equipment. Accurately detecting the spatial location of lightning occurrence by predicting thunderstorms and lightning is of great significance. Traditional lightning detection systems detect lightning by measuring the sound, light, and electromagnetic field information radiated by lightning. These methods typically have two problems. First, the detection process of lightning signals is susceptible to electromagnetic interference. Second, the equipment cost is high and is not friendly to some lightning detection tasks only targeted at specific scenarios. In order to detect lightning more conveniently, we propose a lightning detection model based on deep learning networks. With the increase in the use of cameras in modern society, designing lightning object detection networks based on deep learning is possible. However, two problems have been found in existing practice: (1) When strong lightning meteorological phenomena occur, the lightning features in the image are covered by bright electric lights, and convolutional neural networks cannot distinguish between strong lightning scenes and strong ultraviolet scenes. (2) The performance of convolutional neural networks is often related to the model's size. The larger the model, the stronger the performance of the network. However, in practical application scenarios, computing resources are insufficient to use sufficiently large networks. In this paper, we propose a simple and effective lightning object detection network (LD‐Net) and use a foreground‐background segmentation algorithm to locate frames containing lightning in the video. After using the knowledge distillation‐based model compression method, the mAP of the lightning object detection network with a backbone net of resnet with 18‐layer (LD‐Net‐18) can reach 82.4%. We hope that the proposed LD‐Net can serve as a simple and powerful alternative to traditional lightning detection methods, enhancing efficiency in lightning detection tasks. [ABSTRACT FROM AUTHOR]

Multivariate time series forecasting has an important role in many real-world domains. Especially, price prediction has always been on the focus of researchers. Yet, it is a challenging task that requires the capturing of intra-series and inter-series correlations. Most of the models in literature focus only on the correlation in temporal domain. In this paper, we have curated a new dataset from the official website of Turkish Ministry of Commerce. The dataset consists of daily prices and trade volume of vegetables and covers 1791 days between January 1, 2018 and November 26, 2022. A Spectral Temporal Graph Neural Network (StemGNN) is employed on the curated dataset and the results are given in comparison to Convolutional neural networks (CNN), Long short-term memory (LSTM) and Random Forest models. GNN architecture achieved a state-of-the-art result such as mean absolute error (MAE): 1,37 and root mean squared error (RMSE): 1.94). To our knowledge, this is one of the few studies that investigates GNN for time series analysis and the first study in architecture field. [ABSTRACT FROM AUTHOR]

Face manipulation technology is rapidly evolving, making it impossible for human eyes to recognize fake faces in photos. Convolutional Neural Network (CNN) discriminators, on the other hand, can quickly achieve high accuracy in distinguishing fake from real face photos. In this paper, we investigate how CNN models distinguish between fake and real faces. According to our findings, face forgery detection heavily relies on the variation in the texture of the images. As a result of the aforementioned discovery, we propose a deep texture variation network, a new model for robust face fraud detection based on convolution and pyramid pooling. Convolution combines pixel intensity and pixel gradient information to create a stationary representation of composition difference information. Simultaneously, multi-scale information fusion based on the pyramid pooling can prevent the texture features from being destroyed. The proposed deep texture variation network outperforms previous techniques on a variety of datasets, including Faceforensics++, DeeperForensics-1.0, Celeb-DF, and DFDC. The proposed model is less susceptible to image distortion, such as JPEG compression and blur, which is important in this field. [ABSTRACT FROM AUTHOR]

In recent years, the classification method of motor imagery(MI) electroencephalography(EEG) signals based on deep learning(DL) has become more and more mature in the field of brain-computer interface(BIC). However, most of the studies tend to use a single feature or two associated features when dealing with motor imagery EEG signal classification, while ignoring other features, resulting in poor classification performance. Therefore, this paper proposes a neural network feature fusion algorithm called Multi-feature Fusion Transformer(M-FFT). The network is built based on convolutional neural network (CNN) and Transformer. This method uses CNN and wavelet transform to extract the timefrequency and space-time features, and uses the converter to fuse the three feature domains contained in the two features to establish the information interaction between the three feature domains contained in the two features. Then, the global feature pooling is used to output the feature vector, and finally the softmax function is used to classify the feature vector. In the training process, we use cross entropy as the loss function. Finally, on the brain-computer interface competition IV data set 2a, the average classification accuracy is 85.66%, and the average kappa value is 0.833. The experimental results validate the algorithm performance. [ABSTRACT FROM AUTHOR]

COVID19 is becoming more and more threatening to human life since the appearance of many variants like Alpha, Omicron and Delta. These variants have dozens of mutations that can make their diagnosis more challenging. Despite the recent success of Convolutional Neural Networks (CNN) to detect COVID19 automatically using transfer learning techniques, they are not the most robust to accomplish this task since some translation, scale and hyperparameter variations can affect the accuracy. Newly, Vision Transformers (ViT) are becoming increasingly popular to handle similar tasks and to deal with the aforementioned variations. In this paper, we propose an enhanced ViT architecture for COVID19 detection referred to as COVID-Attention. The proposed ViT-based models are robust due to their capability to capture long-range dependencies within images thanks to the attention mechanism, which is the core of the transformer block. We compare the efficiency of our proposed method to top-performing CNN baselines using two different transfer learning modes. We further show in our experiments that adding a convolution block to the top of the ViT model (i.e. as an initial block) can avoid the collapse issue and enhance the ViT performance using the recent ViTC model. We finally show that ViT-based models give more explainable visualization compared to CNN models using the Grad-CAM technique in order to highlight the attention map that affects the classification decision. Our experiments have been conducted on two recent databases of X-ray images and show high performance compared to the state-of-the-art methods in three-class classifications. [ABSTRACT FROM AUTHOR]

Diabetic retinopathy (DR) is a complication of prolonged diabetic mellitus causing damage to the micro-vascular system in retina. Computer-aided detection of DR can significantly reduce time, effort, and cost in early diagnosis and thereby restrict further complications. In this paper, we present a deep learning based framework for automated DR stage classification from fundus retinal images.We design and develop a custom build Convolutional Neural Network (CNN) model named Model-IVS to extract meaningful and discriminative features from the retinal fundus images. The proposed hybrid-CNN combines the multi-scale pyramidal feature processing concept of inception model with the convolutional pipeline based feature extraction concept of VGG-Nets and adopts multi-scale feature concatenation based short-cut connections of DenseNet with learnable convolutions. For the binary classification tasks, we employ Model-IVS as a feature extractor and use Support Vector Machine (SVM) classifier on the reduced features obtained through principal component analysis. The proposed hybrid model is end-to-end trained incrementally on a class-balanced dataset curated from the train set of EyePACS dataset. The cross-dataset generalization of the proposed hybrid CNN based DR classification framework is evaluated on APTOS, MESSIDOR-1 and MESSIDOR-2 datasets. Experimental results demonstrate that our model has outperformed all the existing state-of-the-art methods for DR severity grading task on APTOS dataset. The proposed Model-IVS has achieved best accuracy, AUC-ROC, and kappa score of 84.33%, 0.978 and 0.899, respectively in DR severity grading task. In binary classification tasks like DR screening and referable DR predictions, our Model-IVS feature extraction network with SVM classifier on PCA features has also achieved comparable performance results w.r.t. the state-of-the-art methods. In DR screening task, we recorded an accuracy of 97.84%, 87.42%, and 89.67% on APTOS, MESSIDOR-1, and MESSIDOR-2 datasets, respectively. In referable DR prediction, we achieved AUC-ROC score of 0.987, 0.928, and 0.873 on APTOS, MESSIDOR-1, and MESSIDOR-2 datasets, respectively. [ABSTRACT FROM AUTHOR]

Self-driving cars are a fundamental research subject in recent years; the ultimate goal is to completely exchange the human driver with automated systems. On the other hand, deep learning techniques have revealed performance and effectiveness in several areas. The strength of self-driving cars has been deeply investigated in many areas including object detection, localization as well, and activity recognition. This paper provides an approach to deep learning; which combines the benefits of both convolutional neural network CNN together with Dense technique. This approach learns based on features extracted from the feature extraction technique which is linear discriminant analysis LDA combined with feature expansion techniques namely: standard deviation, min, max, mod, variance and mean. The presented approach has proven its success in both testing and training data and achieving 100% accuracy in both terms. [ABSTRACT FROM AUTHOR]

The powerful parallel computing capability of GPU and the development of matrix processing unit in recent years provide more possibilities to improve the performance of convolutional neural network (CNN) on GPU. For the Winograd convolution algorithm, which is the most widely used in CNN and has the best performance, there are already some tuning results, but they all ignore the utilization of the matrix operation unit and fail to make full use of the computing resources of GPU. This paper introduces a single precision accelerated solution on GPU for CNN. According to the indicators of architecture, the optimal data layout, grid division and block division methods are derived. In order to adapt to a variety of padding in practical application, an efficient dynamic scheme for filling is designed, and by the use of matrix cores, a pipeline algorithm with operator fusion is implemented. The deep learning accelerated library MIOpen in AMD is used as the baseline. Taking several convolutional layers of ResNet50 as the experimental input, the evaluation shows that our approach outperforms MIOpen with the speedup of 1.41x on MI210, and reaches 74% of the peak value of single precision calculations. Applying this method to the training and inference of ResNet50, the speedup of 1.68x is obtained. [ABSTRACT FROM AUTHOR]

In this paper, a method based on deep learning to detect abnormal traffic of IoTs in edge computing environment is proposed. Firstly, the data are preprocessed by data cleaning, normalization, oversampling and undersampling, and data set segmentation to obtain a data set with balanced data distribution. Secondly, a method of calculating feature information based on data increment is adopted, which can accurately extract feature information from the dynamic data flow. Finally, the convolution neural network (CNN) is used to extract the local features of the data, and the bi-directional gated loop unit (BiGRU) is used to extract the long sequence correlation of the data. The two networks work together to extract data features. The self-focus mechanism is introduced to deal with redundant data. Experiments show that the accuracy, recall and F 1 value of the proposed method are 97.36%, 98.38% and 97.16%, respectively, in the normal class, which are higher than the comparison algorithm. [ABSTRACT FROM AUTHOR]

The escalating global water usage and the increasing strain on major cities due to water shortages highlights the critical need for efficient water management practices. In water-stressed regions worldwide, significant water wastage is primarily attributed to leakages, inefficient use, and aging infrastructure. Undetected water leakages in buildings' pipelines contribute to the water waste problem. To address this issue, an effective water leak detection method is required. In this paper, we explore the application of edge computing in smart buildings to enhance water management. By integrating sensors and embedded Machine Learning models, known as TinyML, smart water management systems can collect real-time data, analyze it, and make accurate decisions for efficient water utilization. The transition to TinyML enables faster and more cost-effective local decision-making, reducing the dependence on centralized entities. In this work, we propose a solution that can be adapted for effective leakage detection in real-world scenarios with minimum human intervention using TinyML. We follow an approach that is similar to a typical machine learning lifecycle in production, spanning stages including data collection, training, hyperparameter tuning, offline evaluation and model optimization for on-device resource efficiency before deployment. In this work, we considered an existing water leakage acoustic dataset for polyvinyl chloride pipelines. To prepare the acoustic data for analysis, we performed preprocessing to transform it into scalograms. We devised a water leak detection method by applying transfer learning to five distinct Convolutional Neural Network (CNN) variants, which are namely EfficientNet, ResNet, AlexNet, MobileNet V1, and MobileNet V2. The CNN models were found to be able to detect leakages where a maximum testing accuracy, recall, precision, and F1 score of 97.45%, 98.57%, 96.70%, and 97.63%, respectively, were observed using the EfficientNet model. To enable seamless deployment on the Arduino Nano 33 BLE edge device, the EfficientNet model is compressed using quantization resulting in a low inference time of 1932 ms, a peak RAM usage of 255.3 kilobytes, and a flash usage requirement of merely 48.7 kilobytes. [ABSTRACT FROM AUTHOR]

In this paper, research was conducted on Deep Learning Wavefront Sensing (DLWS) neural networks using simulated atmospheric turbulence datasets, and a novel DLWS was proposed based on attention mechanisms and Convolutional Neural Networks (CNNs). The study encompassed both indoor experiments and kilometer-range laser transmission experiments employing DLWS. In terms of indoor experiments, data were collected and training was performed on the platform built by us. Subsequent comparative experiments with the Shack-Hartmann Wavefront Sensing (SHWS) method revealed that our DLWS model achieved accuracy on par with SHWS. For the kilometer-scale experiments, we directly applied the DLWS model obtained from the indoor platform, eliminating the need for new data collection or additional training. The DLWS predicts the wavefront from the beacon light PSF in real time and then uses it for aberration correction of the emitted laser. The results demonstrate a substantial improvement in the average peak intensity of the light spot at the target position after closed-loop correction, with a remarkable increase of 5.35 times compared to the open-loop configuration. [ABSTRACT FROM AUTHOR]

A hypoglossal nerve stimulator (HGNS) is an invasive device that is used to treat obstructive sleep apnea (OSA) through electrical stimulation. The conventional implantable HGNS device consists of a stimuli generator, a breathing sensor, and electrodes connected to the hypoglossal nerve via leads. However, this implant is bulky and causes significant trauma. In this paper, we propose a minimally invasive HGNS based on an electrocardiogram (ECG) sensor and wireless power transfer (WPT), consisting of a wearable breathing monitor and an implantable stimulator. The breathing external monitor utilizes an ECG sensor to identify abnormal breathing patterns associated with OSA with 88.68% accuracy, achieved through the utilization of a convolutional neural network (CNN) algorithm. With a skin thickness of 5 mm and a receiving coil diameter of 9 mm, the power conversion efficiency was measured as 31.8%. The implantable device, on the other hand, is composed of a front-end CMOS power management module (PMM), a binary-phase-shift-keying (BPSK)-based data demodulator, and a bipolar biphasic current stimuli generator. The PMM, with a silicon area of 0.06 mm 2 (excluding PADs), demonstrated a power conversion efficiency of 77.5% when operating at a receiving frequency of 2 MHz. Furthermore, it offers three-voltage options (1.2 V, 1.8 V, and 3.1 V). Within the data receiver component, a low-power BPSK demodulator was ingeniously incorporated, consuming only 42 μ W when supplied with a voltage of 0.7 V. The performance was achieved through the implementation of the self-biased phase-locked-loop (PLL) technique. The stimuli generator delivers biphasic constant currents, providing a 5 bit programmable range spanning from 0 to 2.4 mA. The functionality of the proposed ECG- and WPT-based HGNS was validated, representing a highly promising solution for the effective management of OSA, all while minimizing the trauma and space requirements. [ABSTRACT FROM AUTHOR]

Internet of Things (IoT) devices within smart cities, require innovative detection methods. This paper addresses this critical challenge by introducing a deep learning-based approach for the detection of network traffic attacks in IoT ecosystems. Leveraging the Kaggle dataset, our model integrates Convolutional Neural Networks (CNNs) and Gated Recurrent Units (GRUs) to capture both spatial and sequential features in network traffic data. We trained and evaluated our model over ten epochs, achieving an impressive overall accuracy rate of 99%. The classification report reveals the model's proficiency in distinguishing various attack categories, including 'Normal', 'DoS' (Denial of Service), 'Probe', 'U2R' (User to Root), and 'Sybil'. Additionally, the confusion matrix offers valuable insights into the model's performance across these attack types. In terms of overall accuracy, our model achieves an impressive accuracy rate of 99% across all attack categories. The weighted- average F1-score is also 99%, showcasing the model's robust performance in classifying network traffic attacks in IoT devices for smart cities. This advanced architecture exhibits the potential to fortify IoT device security in the complex landscape of smart cities, effectively contributing to the safeguarding of critical infrastructure [ABSTRACT FROM AUTHOR]

This paper presents a novel low-cost integrated system prototype, called School Violence Detection system (SVD), based on a 2D Convolutional Neural Network (CNN). It is used for classifying and identifying automatically violent actions in educational environments based on shallow cost hardware. Moreover, the paper fills the gap of real datasets in educational environments by proposing a new one, called Daily School Break dataset (DSB), containing original videos recorded in an Italian high school yard. The proposed CNN has been pre-trained with an ImageNet model and a transfer learning approach. To extend its capabilities, the DSB was enriched with online images representing students in school environments. Experimental results analyze the classification performances of the SVD and investigate how it performs through the proposed DSB dataset. The SVD, which achieves a recognition accuracy of 95%, is considered computably efficient and low-cost. It could be adapted to other scenarios such as school arenas, gyms, playgrounds, etc. [ABSTRACT FROM AUTHOR]

With the use of Convolutional Neural Network (CNN) in the application of sensor signal processing system, it usually faces the urgent requirements of system integration, high throughput, hardware resource and energy efficiency. This paper introduces a resource efficient accelerator with general two-dimensional multiply-add array operator to focus on the characteristic of sensor signal processing, which can be applied to standard CNN, depth-wise CNN, Fully Connected (FC) layer for varied networks. Meanwhile, resource estimation model is also constructed to provide the exploration of parallel parameters for computing efficiency. Finally, a board-level verification is implemented to demonstrate the efficiency of proposed accelerator with common scene of LeNet and complex scene of MobileNetV1. Experimental results show that the Inferences Per Second (IPS) of 332225 and 1498 is realized with 100 MHz frequency. The corresponding efficiency is 88.84% and 61.09%, which outperforms other related works about CNN accelerator design in terms of signal processing. This paper is also applicable and scalable to other fields about effective acceleration research. [ABSTRACT FROM AUTHOR]

Drivers undergo a lot of stress that might cause distraction and might lead to an unfortunate incident. Emotional recognition via facial expressions is one of the most important field in the human–machine interface. The goal of this paper is to analyze the drivers' facial expressions in order to monitor their stress levels. In this paper, we propose FERNET — a hybrid deep convolutional neural network model for driver stress recognition through facial emotion recognition. FERNET is an integration of two DCNNs, pre-trained ResNet101V2 CNN and a custom CNN, ConvNet4. The experiments were carried out on the widely used public datasets CK + , FER2013 and AffectNet, achieving the accuracies of 99.70%, 74.86% and 70.46%, respectively, for facial emotion recognition. These results outperform the recent state-of-the-art methods. Furthermore, since a few specific isolated emotions lead to higher stress levels, we analyze the results for stress- and nonstress-related emotions for each individual dataset. FERNET achieves stress prediction accuracies of 98.17%, 90.16% and 84.49% for CK + , FER2013 and AffectNet datasets, respectively. [ABSTRACT FROM AUTHOR]

Intracranial hemorrhage (ICH) is a serious medical condition that necessitates a prompt and exhaustive medical diagnosis. This paper presents a multi-label ICH classification issue with six different types of hemorrhages, namely epidural (EPD), intraparenchymal (ITP), intraventricular (ITV), subarachnoid (SBC), subdural (SBD), and Some. A patient may experience numerous hemorrhages at the same time in some situations. A CT scan of a patient's skull is used to detect and classify the type of ICH hemorrhage(s) present. First, our model determines whether there is a hemorrhage or not; if there is a hemorrhage, the model attempts to identify the type of hemorrhage(s). In this paper, we present a hybrid deep learning approach that combines convolutional neural network (CNN) and Long-Short Term Memory (LSTM) approaches (Conv-LSTM). In addition, to propose viable solutions for the problem, we used a Systematic Windowing technique with a Conv-LSTM. To ensure the efficacy of the proposed model, experiments are conducted on the RSNA dataset. The suggested model provides higher sensitivity (93.87%), specificity (96.45%), precision (95.21%), and accuracy (95.14%). In addition, the obtained F1 score results outperform existing deep neural network-based algorithms. [ABSTRACT FROM AUTHOR]

The survival rate for sudden cardiac arrest (SCA) is low, and patients with long-term risks of SCA are not adequately alerted. Understanding SCA's characteristics will be key to developing preventive strategies. Many lives could be saved if SCA's early onset could be detected or predicted. Monitoring heart signals continuously is essential for diagnosing sporadic cardiac dysfunction. An electrocardiogram (ECG) can be used to continuously monitor heart function without having to go to the hospital. A zeolite-based dry electrode can provide safe on-skin ECG acquisition while the subject is out-of-hospital and facilitate long-term monitoring. To the ECG signal, a low-power 1 μW read-out circuit was designed and implemented in our prior work. However, having long-term ECG monitoring outside the hospital, i.e., high battery life, and low power consumption while transmission and reception of ECG signal are crucial. This paper proposes a prototype with a 10-bit resolution ADC and nRF24L01 transceivers placed 5 m apart. The system uses the 2.4 GHz worldwide ISM frequency band with GFSK modulation to wirelessly transmit digitized ECG bits at 250 kbps data rate to a physician's computer (or similar) for continuous monitoring of ECG signals; the power consumption is only 11.2 mW and 4.62 mW during transmission and reception, respectively, with a low bit error rate of ≤0.1%. Additionally, a subject-wise cross-validated, three-fold, optimized convolutional neural network (CNN) model using the Physionet-SCA dataset was implemented on NVIDIA Jetson to identify the irregular heartbeats yielding an accuracy of 89% with a run time of 5.31 s. Normal beat classification has an F1 score of 0.94 and a ROC score of 0.886. Thus, this paper integrates the ECG acquisition and processing unit with low-power wireless transmission and CNN model to detect irregular heartbeats. [ABSTRACT FROM AUTHOR]

In recent years, lithium-ion batteries have gained significant attention due to their crucial role in various applications, such as electric vehicles and renewable energy storage. Accurate prediction of the remaining useful life (RUL) of these batteries is essential for optimizing their performance and ensuring reliable operation. In this paper, we propose a novel methodology for RUL prediction using an individual control chart (ICC) to identify and remove degraded data, a convolutional neural network (CNN) to smooth the noise of sensor data and long short-term memory (LSTM) networks to effectively capture both spatial and temporal dependencies within battery data, enabling accurate RUL estimation. We evaluate our proposed model using a comprehensive dataset, and experimental results demonstrate its superior performance compared to existing methods. Our findings highlight the potential of ICC-CNN-LSTM for RUL prediction in lithium-ion batteries and provide valuable insights for future research. [ABSTRACT FROM AUTHOR]

Medical image segmentation is crucial for medical image processing and the development of computer-aided diagnostics. In recent years, deep Convolutional Neural Networks (CNNs) have been widely adopted for medical image segmentation and have achieved significant success. UNet, which is based on CNNs, is the mainstream method used for medical image segmentation. However, its performance suffers owing to its inability to capture long-range dependencies. Transformers were initially designed for Natural Language Processing (NLP), and sequence-to-sequence applications have demonstrated the ability to capture long-range dependencies. However, their abilities to acquire local information are limited. Hybrid architectures of CNNs and Transformer, such as TransUNet, have been proposed to benefit from Transformer's long-range dependencies and CNNs' low-level details. Nevertheless, automatic medical image segmentation remains a challenging task due to factors such as blurred boundaries, the low-contrast tissue environment, and in the context of ultrasound, issues like speckle noise and attenuation. In this paper, we propose a new model that combines the strengths of both CNNs and Transformer, with network architectural improvements designed to enrich the feature representation captured by the skip connections and the decoder. To this end, we devised a new attention module called Three-Level Attention (TLA). This module is composed of an Attention Gate (AG), channel attention, and spatial normalization mechanism. The AG preserves structural information, whereas channel attention helps to model the interdependencies between channels. Spatial normalization employs the spatial coefficient of the Transformer to improve spatial attention akin to TransNorm. To further improve the skip connection and reduce the semantic gap, skip connections between the encoder and decoder were redesigned in a manner similar to that of the UNet++ dense connection. Moreover, deep supervision using a side-output channel was introduced, analogous to BASNet, which was originally used for saliency predictions. Two datasets from different modalities, a CT scan dataset and an ultrasound dataset, were used to evaluate the proposed UNet architecture. The experimental results showed that our model consistently improved the prediction performance of the UNet across different datasets. [ABSTRACT FROM AUTHOR]

To address the problems of insufficient training samples and unbalanced sample classes for intrusion detection in real network environments, this paper proposes an intrusion detection system TL-CNN-IDS based on transfer learning and ensemble learning. First, preprocessing using IG-FCBF feature engineering methods followed by conversion of the obtained dataset into an image form suitable for CNN model input. Secondly, three CNN models of VGG16, Inception, and Xception are selected as the basic learning model, and the hyperparameter optimization method of the Tree-Structured Parzen Estimator algorithm is adopted to search the best model on the target dataset. Finally, the optimized CNN model is integrated using the ensemble learning method of confidence averaging. Experiments were conducted on the CICIDS2017 dataset with accuracy, precision, recall, and F1-score exceeding 99.85% and validation of model effectiveness on the NSL-KDD dataset. The experimental results show that the proposed TL-CNN-IDS can achieve network intrusion detection and outperform other intrusion detection methods. [ABSTRACT FROM AUTHOR]

In recent years, deep neural networks have enabled countless innovations in the field of image classification. Encouraged by success in this field, researchers worldwide have demonstrated how to use Convolutional Neural Network techniques in medical imaging problems. In this article, the results were obtained through the use of the EfficientNet in the task of classifying 14 different diseases based on chest X-ray images coming from the NIH (National Institutes of Health) ChestX-ray14 dataset. The approach addresses dataset imbalances by introducing a custom split to ensure fair representation. Binary cross entropy loss is utilized to handle the multi-label difficulty. The model architecture comprises an EfficientNet backbone for feature extraction, succeeded by sequential layers including GlobalAveragePooling, Dense, and BatchNormalization. The main contribution of this paper is a proposed solution that outperforms previous state-of-the-art deep learning models average area under the receiver operating characteristic curve—AUC-ROC (score: 84.28%). The usage of the transfer-learning technique and traditional deep learning engineering techniques was shown to enable us to obtain such results on consumer-class GPUs (graphics processing units). [ABSTRACT FROM AUTHOR]

Alzheimer's disease (AD) is a neurodegenerative disease that can cause dementia and result in a severe reduction in brain function, inhibiting simple tasks, especially if no preventative care is taken. Over 1 in 9 Americans suffer from AD-induced dementia, and unpaid care for people with AD-related dementia is valued at USD 271.6 billion. Hence, various approaches have been developed for early AD diagnosis to prevent its further progression. In this paper, we first review other approaches that could be used for the early detection of AD. We then give an overview of our dataset and propose a deep convolutional neural network (CNN) architecture consisting of 7,866,819 parameters. This model comprises three different convolutional branches, each having a different length. Each branch is comprised of different kernel sizes. This model can predict whether a patient is non-demented, mild-demented, or moderately demented with a 99.05% three-class accuracy. In summary, the deep CNN model demonstrated exceptional accuracy in the early diagnosis of AD, offering a significant advancement in the field and the potential to improve patient care. [ABSTRACT FROM AUTHOR]

In comparison to other alternative energy sources, wind power is more affordable and environmentally friendly, making it one of the most significant energy sources in the world. It is vital to monitor the condition of each wind turbine in the farm and recognize the various states of alert since difficulties with the operation as well as maintenance of wind farms considerably contribute to the rise in their overall expenses. The Supervisory Control and Data Acquisition (SCADA) data-based continuous observation of wind turbine conditions is the most widely used existing strategy to detect the fault early by preventing the wind turbine from reaching a shutdown stage. Several parameters irrelevant to the faults are saved in the SCADA system while the wind turbine is operating. To increase the efficacy of wind turbine fault diagnostics, optimally selected SCADA data parameters are required for fault prediction. Hence, this paper introduces an optimized Convolutional Neural Network (CNN)-based wind turbine fault identification method. For more precise detection, a Self-Improved Slime Mould Algorithm (SI-SMA) is used for the optimal selection of SCADA parameters as well as weight optimization of CNN. The proposed SI-SMA method is an enhanced form of the standard Slime Mould Algorithm (SMA). Eventually, an error analysis and a stability analysis are carried out to check the overall effectiveness of the suggested approach. In particular, the root mean square error (RMSE) of the implemented algorithm is lower, and it is 0.69%, 1.58%, 0.81% and 1.71% better than the existing FF, GWO, WOA and SMA models. [ABSTRACT FROM AUTHOR]