Search

This document is a summary of a special issue of the journal Processes titled "Process Monitoring and Fault Diagnosis." The issue explores the application of data analytic techniques to enhance stable operation and safety in chemical processes and related industries. The collection of research papers covers various topics, including process fault detection, bearing fault diagnosis, remaining useful life prediction, and more. The papers introduce cutting-edge methodologies and demonstrate their reliability through validation. The issue aims to foster communication and the development of advanced process monitoring techniques. [Extracted from the article]

The occurrence of maize diseases is frequent but challenging to manage. Traditional identification methods have low accuracy and complex model structures with numerous parameters, making them difficult to implement on mobile devices. To address these challenges, this paper proposes a corn leaf disease recognition model SNMPF based on convolutional neural network ShuffleNetV2. In the down-sampling module of the ShuffleNet model, the max pooling layer replaces the deep convolutional layer to perform down-sampling. This improvement helps to extract key features from images, reduce the overfitting of the model, and improve the model's generalization ability. In addition, to enhance the model's ability to express features in complex backgrounds, the Sim AM attention mechanism was introduced. This mechanism enables the model to adaptively adjust focus and pay more attention to local discriminative features. The results on a maize disease image dataset demonstrate that the SNMPF model achieves a recognition accuracy of 98.40%, representing a 4.1 percentage point improvement over the original model, while its size is only 1.56 MB. Compared with existing convolutional neural network models such as EfficientNet, MobileViT, EfficientNetV2, RegNet, and DenseNet, this model offers higher accuracy and a more compact size. As a result, it can automatically detect and classify maize leaf diseases under natural field conditions, boasting high-precision recognition capabilities. Its accurate identification results provide scientific guidance for preventing corn leaf disease and promote the development of precision agriculture. [ABSTRACT FROM AUTHOR]

This document is the closing editorial for a special issue of the journal Applied Sciences on computer vision and pattern recognition based on deep learning. The issue includes 31 papers covering various topics such as image and video processing, object detection, object and scene recognition, visual application technologies, classification, segmentation, compression, and more. Each paper explores different methods and techniques to improve the performance and accuracy of deep learning models in these areas. The document provides a brief summary of each paper, highlighting their contributions and findings. [Extracted from the article]

This document is an editorial for a special issue titled "Machine Learning in Computer Vision and Image Sensing: Theory and Applications." The editorial highlights the diverse applications of machine learning (ML) models in various domains such as medical imaging, signal processing, remote sensing, and human activity detection. The special issue includes 11 papers that cover topics such as image segmentation, fluvial navigation, Alzheimer's disease classification, pneumothorax detection, lung cancer malignancy prediction, amniotic fluid volume detection, COVID-19 detection, and Parkinson's disease detection. The papers showcase the progress and potential of ML models in computer vision applications and provide valuable insights for future research. [Extracted from the article]

With the proliferation of the Internet, network complexities for both commercial and state organizations have significantly increased, leading to more sophisticated and harder-to-detect network attacks. This evolution poses substantial challenges for intrusion detection systems, threatening the cybersecurity of organizations and national infrastructure alike. Although numerous deep learning techniques such as convolutional neural networks (CNNs), recurrent neural networks (RNNs), and graph neural networks (GNNs) have been applied to detect various network attacks, they face limitations due to the lack of standardized input data, affecting model accuracy and performance. This paper proposes a novel preprocessing method for flow data from network intrusion detection systems (NIDSs), enhancing the efficacy of a graph neural network model in malicious flow detection. Our approach initializes graph nodes with data derived from flow features and constructs graph edges through the analysis of IP relationships within the system. Additionally, we propose a new graph model based on the combination of the graph neural network (GCN) model and SAGEConv, a variant of the GraphSAGE model. The proposed model leverages the strengths while addressing the limitations encountered by the previous models. Evaluations on two IDS datasets, CICIDS-2017 and UNSW-NB15, demonstrate that our model outperforms existing methods, offering a significant advancement in the detection of network threats. This work not only addresses a critical gap in the standardization of input data for deep learning models in cybersecurity but also proposes a scalable solution for improving the intrusion detection accuracy. [ABSTRACT FROM AUTHOR]

Understanding road conditions is essential for implementing effective road safety measures and driving solutions. Road situations encompass the day-to-day conditions of roads, including the presence of vehicles and pedestrians. Surveillance cameras strategically placed along streets have been instrumental in monitoring road situations and providing valuable information on pedestrians, moving vehicles, and objects within road environments. However, these video data and information are stored in large volumes, making analysis tedious and time-consuming. Deep learning models are increasingly utilized to monitor vehicles and identify and evaluate road and driving comfort situations. However, the current neural network model requires the recognition of situations using time-series video data. In this paper, we introduced a multi-directional detection model for road situations to uphold high accuracy. Deep learning methods often integrate long short-term memory (LSTM) into long-term recurrent network architectures. This approach effectively combines recurrent neural networks to capture temporal dependencies and convolutional neural networks (CNNs) to extract features from extensive video data. In our proposed method, we form a multi-directional long-term recurrent convolutional network approach with two groups equipped with CNN and two layers of LSTM. Additionally, we compare road situation recognition using convolutional neural networks, long short-term networks, and long-term recurrent convolutional networks. The paper presents a method for detecting and recognizing multi-directional road contexts using a modified LRCN. After balancing the dataset through data augmentation, the number of video files increased, resulting in our model achieving 91% accuracy, a significant improvement from the original dataset. [ABSTRACT FROM AUTHOR]

Cognitive radio networks enable the detection and opportunistic access to an idle spectrum through spectrum-sensing technologies, thus providing services to secondary users. However, at a low signal-to-noise ratio (SNR), existing spectrum-sensing methods, such as energy statistics and cyclostationary detection, tend to fail or become overly complex, limiting their sensing accuracy in complex application scenarios. In recent years, the integration of deep learning with wireless communications has shown significant potential. Utilizing neural networks to learn the statistical characteristics of signals can effectively adapt to the changing communication environment. To enhance spectrum-sensing performance under low-SNR conditions, this paper proposes a deep-learning-based spectrum-sensing method that combines multiple signal features, including energy statistics, power spectrum, cyclostationarity, and I/Q components. The proposed method used these combined features to form a specific matrix, which was then efficiently learned and detected through the designed 'SenseNet' network. Experimental results showed that at an SNR of −20 dB, the SenseNet model achieved a 58.8% spectrum-sensing accuracy, which is a 3.3% improvement over the existing convolutional neural network model. [ABSTRACT FROM AUTHOR]

Deep learning, a crucial technique for achieving artificial intelligence (AI), has been successfully applied in many fields. The gradual application of the latest architectures of deep learning in the field of time series forecasting (TSF), such as Transformers, has shown excellent performance and results compared to traditional statistical methods. These applications are widely present in academia and in our daily lives, covering many areas including forecasting electricity consumption in power systems, meteorological rainfall, traffic flow, quantitative trading, risk control in finance, sales operations and price predictions for commercial companies, and pandemic prediction in the medical field. Deep learning-based TSF tasks stand out as one of the most valuable AI scenarios for research, playing an important role in explaining complex real-world phenomena. However, deep learning models still face challenges: they need to deal with the challenge of large-scale data in the information age, achieve longer forecasting ranges, reduce excessively high computational complexity, etc. Therefore, novel methods and more effective solutions are essential. In this paper, we review the latest developments in deep learning for TSF. We begin by introducing the recent development trends in the field of TSF and then propose a new taxonomy from the perspective of deep neural network models, comprehensively covering articles published over the past five years. We also organize commonly used experimental evaluation metrics and datasets. Finally, we point out current issues with the existing solutions and suggest promising future directions in the field of deep learning combined with TSF. This paper is the most comprehensive review related to TSF in recent years and will provide a detailed index for researchers in this field and those who are just starting out. [ABSTRACT FROM AUTHOR]

Existing research in metasurface design was based on trial-and-error high-intensity iterations and requires deep acoustic expertise from the researcher, which severely hampered the development of the metasurface field. Using deep learning enabled the fast and accurate design of hypersurfaces. Based on this, in this paper, an integrated learning approach was first utilized to construct a model of the forward mapping relationship between the hypersurface physical structure parameters and the acoustic field, which was intended to be used for data enhancement. Then a dual-feature fusion model (DFCNN) based on a convolutional neural network was proposed, in which the first feature was the high-dimensional nonlinear features extracted using a data-driven approach, and the second feature was the physical feature information of the acoustic field mined using the model. A convolutional neural network was used for feature fusion. A genetic algorithm was used for network parameter optimization. Finally, generalization ability verification was performed to prove the validity of the network model. The results showed that 90% of the integrated learning models had an error of less than 3 dB between the real and predicted sound field data, and 93% of the DFCNN models could achieve an error of less than 5 dB in the local sound field intensity. [ABSTRACT FROM AUTHOR]

This paper investigates a method for precise mapping of human arm movements using sEMG signals. A multi-channel approach captures the sEMG signals, which, combined with the accurately calculated joint angles from an Inertial Measurement Unit, allows for action recognition and mapping through deep learning algorithms. Firstly, signal acquisition and processing were carried out, which involved acquiring data from various movements (hand gestures, single-degree-of-freedom joint movements, and continuous joint actions) and sensor placement. Then, interference signals were filtered out through filters, and the signals were preprocessed using normalization and moving averages to obtain sEMG signals with obvious features. Additionally, this paper constructs a hybrid network model, combining Convolutional Neural Networks and Artificial Neural Networks, and employs a multi-feature fusion algorithm to enhance the accuracy of gesture recognition. Furthermore, a nonlinear fitting between sEMG signals and joint angles was established based on a backpropagation neural network, incorporating momentum term and adaptive learning rate adjustments. Finally, based on the gesture recognition and joint angle prediction model, prosthetic arm control experiments were conducted, achieving highly accurate arm movement prediction and execution. This paper not only validates the potential application of sEMG signals in the precise control of robotic arms but also lays a solid foundation for the development of more intuitive and responsive prostheses and assistive devices. [ABSTRACT FROM AUTHOR]

Recent technological developments have enabled computers to identify and categorize facial expressions to determine a person's emotional state in an image or a video. This process, called "Facial Expression Recognition (FER)", has become one of the most popular research areas in computer vision. In recent times, deep FER systems have primarily concentrated on addressing two significant challenges: the problem of overfitting due to limited training data availability, and the presence of expression-unrelated variations, including illumination, head pose, image resolution, and identity bias. In this paper, a comprehensive survey is provided on deep FER, encompassing algorithms and datasets that offer insights into these intrinsic problems. Initially, this paper presents a detailed timeline showcasing the evolution of methods and datasets in deep facial expression recognition (FER). This timeline illustrates the progression and development of the techniques and data resources used in FER. Then, a comprehensive review of FER methods is introduced, including the basic principles of FER (components such as preprocessing, feature extraction and classification, and methods, etc.) from the pro-deep learning era (traditional methods using handcrafted features, i.e., SVM and HOG, etc.) to the deep learning era. Moreover, a brief introduction is provided related to the benchmark datasets (there are two categories: controlled environments (lab) and uncontrolled environments (in the wild)) used to evaluate different FER methods and a comparison of different FER models. Existing deep neural networks and related training strategies designed for FER, based on static images and dynamic image sequences, are discussed. The remaining challenges and corresponding opportunities in FER and the future directions for designing robust deep FER systems are also pinpointed. [ABSTRACT FROM AUTHOR]

As there is a lack of public mark samples of Tibetan historical document image characters at present, this paper proposes an unsupervised Tibetan historical document character recognition method based on deep learning (UD-CNN). Firstly, using the Tibetan historical document character component, the Tibetan historical document character sample data set is constructed for model-aided training. Then, the character baseline information is introduced, and a fine-grained feature learning strategy is proposed. For the samples above and below the baseline, the Up-CNN recognition model and Down-CNN recognition model are established. The convolution neural network model is trained and optimized for the samples above and below the baseline, respectively, to improve the recognition accuracy. The experimental results show that the proposed method obviously affects the unmarked character classification and recognition of real Tibetan historical document images. The recognition rate of Top5 can reach 92.94%, and the recognition rate of Top1 can be increased from 82.25% to 87.27% using the CNN model only. [ABSTRACT FROM AUTHOR]

Short-term load forecasting is a challenging research problem and has a tremendous impact on electricity generation, transmission, and distribution. A robust forecasting algorithm can help power system operators to better tackle the ever-changing electric power demand. This paper presents a novel deep neural network for short-term electric load forecasting for the St. John's campus of Memorial University of Newfoundland (MUN). The electric load data are obtained from the Memorial University of Newfoundland and combined with metrological data from St. John's. This dataset is used to formulate a multivariate time-series forecasting problem. A novel deep learning algorithm is presented, consisting of a 1D Convolutional Neural Network, which is followed by an encoder–decoder-based network with attention. The input used for this model is the electric load consumption and metrological data, while the output is the hourly prediction of the next day. The model is compared with Gated Recurrent Unit (GRU) and Long Short Term Memory (LSTM)-based Recurrent Neural Network. A CNN-based encoder–decoder model without attention is also tested. The proposed model shows a lower mean absolute error (MAE), mean squared error (MSE), mean absolute percentage error (MAPE), and higher R2 score. These evaluation metrics show an improved performance compared to GRU and LSTM-based RNNs as well as the CNN encoder–decoder model without attention. [ABSTRACT FROM AUTHOR]

In the context of accelerated urbanization, assessing the quality of the existing built environment plays a crucial role in urban renewal. In the existing research and use of deep learning models, most categories are urban construction areas, forest land, farmland, and other categories. These categories are not conducive to a more accurate analysis of the spatial distribution characteristics of urban green space, parking space, blue space, and square. A small sample of refined land use classification data for urban built-up areas was produced using remote sensing images. The large-scale remote sensing images were classified using deep learning models, with the objective of inferring the fine land category of each tile image. In this study, satellite remote sensing images of four cities, Handan, Shijiazhuang, Xingtai, and Tangshan, were acquired by Google Class 19 RGB three-channel satellite remote sensing images to establish a data set containing fourteen urban land use classifications. The convolutional neural network model EfficientNetV2 is used to train and validate the network framework that performs well on computer vision tasks and enables intelligent image classification of urban remote sensing images. The model classification effect is compared and analyzed through accuracy, precision, recall, and F1-score. The results show that the EfficientNetV2 model has a classification recognition accuracy of 84.56% on the constructed data set. The testing set accuracy increases sequentially after transfer learning. This paper verifies that the proposed research framework has good practicality and that the results of the land use classification are conducive to the fine-grained quantitative analysis of built-up environmental quality. [ABSTRACT FROM AUTHOR]

The three Ground Reaction Force (GRF) components can be estimated using pressure insole sensors. In this paper, we compare the accuracy of estimating GRF components for both feet using six methods: three Deep Learning (DL) methods (Artificial Neural Network, Long Short-Term Memory, and Convolutional Neural Network) and three Supervised Machine Learning (SML) methods (Least Squares, Support Vector Regression, and Random Forest (RF)). Data were collected from nine subjects across six activities: normal and slow walking, static with and without carrying a load, and two Manual Material Handling activities. This study has two main contributions: first, the estimation of GRF components (Fx, Fy, and Fz) during the six activities, two of which have never been studied; second, the comparison of the accuracy of GRF component estimation between the six methods for each activity. RF provided the most accurate estimation for static situations, with mean RMSE values of RMSE_Fx = 1.65 N, RMSE_Fy = 1.35 N, and RMSE_Fz = 7.97 N for the mean absolute values measured by the force plate (reference) RMSE_Fx = 14.10 N, RMSE_Fy = 3.83 N, and RMSE_Fz = 397.45 N. In our study, we found that RF, an SML method, surpassed the experimented DL methods. [ABSTRACT FROM AUTHOR]

The influence maximization problem is a hot issue in the research on social networks due to its wide application. The problem aims to find a small subset of influential nodes to maximize the influence spread. To tackle the challenge of striking a balance between efficiency and effectiveness in traditional influence maximization algorithms, deep learning-based influence maximization algorithms have been introduced and have achieved advancement. However, these algorithms still encounter two key problems: (1) Traditional deep learning models are not well-equipped to capture the latent topological information of networks with varying sizes and structures. (2) Many deep learning-based methods use the influence spread of individual nodes as labels to train a model, which can result in an overlap of influence among the seed nodes selected by the model. In this paper, we reframe the influence maximization problem as a regression task and introduce an innovative approach to influence maximization. The method adopts an adaptive graph convolution neural network which can explore the latent topology information of the network and can greatly improve the performance of the algorithm. In our approach, firstly, we integrate several network-level attributes and some centrality metrics into a vector as the presentation vector of nodes in the social network. Next, we propose a new label generation method to measure the influence of nodes by neighborhood discount strategy, which takes full account of the influence overlapping problem. Subsequently, labels and presentation vectors are fed into an adaptive graph convolution neural network model. Finally, we use the well-trained model to predict the importance of nodes and select top-K nodes as a seed set. Abundant experiments conducted on various real-world datasets have confirmed that the performance of our proposed algorithm surpasses that of several current state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]

Soil moisture is an important component of the hydrologic cycle and ecosystem functioning, and it has a significant impact on agricultural production, climate change and natural disasters. Despite the availability of machine-learning techniques for estimating soil moisture from high-resolution remote-sensing imagery, including synthetic aperture radar (SAR) data and optical remote sensing, comprehensive comparative studies of these techniques remain limited. This paper addresses this gap by systematically comparing the performance of four tree-based ensemble-learning models (random forest (RF), extreme gradient boosting (XGBoost), light gradient-boosting machine (LightGBM), and category boosting (CatBoost)) and three deep-learning models (deep neural network (DNN), convolutional neural network (CNN), and gated recurrent unit (GRU)) in terms of soil moisture estimation. Additionally, we introduce and evaluate the effectiveness of four different stacking methods for model fusion, an approach that is relatively novel in this context. Moreover, Sentinel-1 C-band dual-polarization SAR and Sentinel-2 multispectral data, as well as NASADEM and geographical code and temporal code features, are used as input variables to retrieve the soil moisture in the ShanDian River Basin in China. Our findings reveal that the tree-based ensemble-learning models outperform the deep-learning models, with LightGBM being the best individual model, while the stacking approach can further enhance the accuracy and robustness of soil moisture estimation. Moreover, the stacking all boosting classes ensemble-learning model (SABM), which integrates only boosting-type models, demonstrates superior accuracy and robustness in soil moisture estimation. The SHAP value analysis reveals that ensemble learning can utilize more complex features than deep learning. This study provides an effective method for retrieving soil moisture using machine-learning and high-resolution remote-sensing data, demonstrating the application value of SAR data and high-resolution optical remote-sensing data in soil moisture monitoring. [ABSTRACT FROM AUTHOR]

Forecasting energy demand is critical to ensure the steady operation of the power system. However, present approaches to estimating power load are still unsatisfactory in terms of accuracy, precision, and efficiency. In this paper, we propose a novel method, named ELFNet, for estimating short-term electricity consumption, based on the deep convolutional neural network model with a double-attention mechanism. The Gramian Angular Field method is utilized to convert electrical load time series into 2D image data for input into the proposed model. The prediction accuracy is greatly improved through the use of a convolutional neural network to extract the intrinsic characteristics from the input data, along with channel attention and spatial attention modules, to enhance the crucial features and suppress the irrelevant ones. The present ELFNet method is compared to several classic deep learning networks across different prediction horizons using publicly available data on real power demands from the Belgian grid firm Elia. The results show that the suggested approach is competitive and effective for short-term power load forecasting. [ABSTRACT FROM AUTHOR]

This paper identifies and analyzes the microstructure of a carburized layer by using a deep convolutional neural network, selecting different carburizing processes to conduct surface treatment on 23CrNi3Mo steel, collecting many metallographic pictures of the carburized layer based on laser confocal microscopy, and building a microstructure dataset (MCLD) database for training and testing. Five algorithms—a full convolutional network (FCN), U-Net, DeepLabv3+, pyramid scene parsing network (PSPNet), and image cascade network (ICNet)—are used to segment the self-built microstructural dataset (MCLD). By comparing the five deep learning algorithms, a neural network model suitable for the MCLD database is identified and optimized. The research results achieve recognition, segmentation, and statistic verification of metallographic microstructure images through a deep convolutional neural network. This approach can replace the high cost and complicated process of experimental testing of retained austenite and martensite. This new method is provided to identify and calculate the content of residual austenite and martensite in the carburized layer of low-carbon steel, which lays a theoretical foundation for optimizing the carburizing process. [ABSTRACT FROM AUTHOR]

With the increasing frequency and severity of disasters and accidents, there is a growing need for efficient emergency alert systems. The ultra-high definition (UHD) broadcasting service based on Advanced Television Systems Committee (ATSC) 3.0, a leading terrestrial digital broadcasting system, offers such capabilities, including a wake-up function for minimizing damage through early alerts. In case of a disaster situation, the emergency alert wake-up signal is transmitted, allowing UHD TVs to be activated, enabling individuals to receive emergency alerts and access emergency broadcasting content. However, conventional methods for detecting the bootstrap signal, essential for this function, typically require an ATSC 3.0 demodulator. In this paper, we propose a novel deep learning-based method capable of detecting an emergency wake-up signal without the need for an ATSC 3.0. The proposed method leverages deep learning techniques, specifically a deep neural network (DNN) structure for bootstrap detection and a convolutional neural network (CNN) structure for wake-up signal demodulation and to detect the bootstrap and 2 bit emergency alert wake-up signal. Specifically, our method eliminates the need for Fast Fourier Transform (FFT), frequency synchronization, and interleaving processes typically required by a demodulator. By applying a deep learning in the time domain, we simplify the detection process, allowing for the detection of an emergency alert signal without the full suite of demodulator components required for ATSC 3.0. Furthermore, we have verified the performance of the deep learning-based method using ATSC 3.0-based RF signals and a commercial Software-Defined Radio (SDR) platform in a real environment. [ABSTRACT FROM AUTHOR]

The latest survey results show an increase in accidents on the roads involving pedestrians and cyclists. The reasons for such situations are many, the fault actually lies on both sides. Equipping vehicles, especially autonomous vehicles, with frequency-modulated continuous-wave (FMCW) radar and dedicated algorithms for analyzing signals in the time–frequency domain as well as algorithms for recognizing objects in radar imaging through deep neural networks can positively affect safety. This paper presents a method for recognizing and distinguishing a group of objects based on radar signatures of objects and a special convolutional neural network structure. The proposed approach is based on a database of radar signatures generated on pedestrian, cyclist, and car models in a Matlab environment. The obtained results of simulations and positive tests provide a basis for the application of the system in many sectors and areas of the economy. Innovative aspects of the work include the method of discriminating between multiple objects on a single radar signature, the dedicated architecture of the convolutional neural network, and the use of a method of generating a custom input database. [ABSTRACT FROM AUTHOR]

This document is a summary of a special issue of the journal Electronics titled "AI-Driven Network Security and Privacy." The issue focuses on various topics related to network security and privacy, including malware detection, intrusion detection, malware classification, domain name detection, encryption schemes, model robustness evaluation, traffic obfuscation, APT attack event extraction, object detection, abnormal traffic detection, data management, sentiment analysis, deepfake dataset evaluation, evasion attacks, face recognition, remote sensing image object detection, and target tracking in UAV videos. Each contribution presents a specific method or approach to address the challenges in their respective areas. The summary provides a brief overview of each contribution's main findings and methodologies. The document also discusses the future directions of AI-driven network security and privacy, including secure data sharing, privacy protection, threat detection and prevention, and automated response and repair. The authors express their gratitude to the researchers, reviewers, and editorial staff involved in the publication of the articles. [Extracted from the article]

Alzheimer's Disease (AD) poses a significant health risk globally, particularly among the elderly population. Recent studies underscore its prevalence, with over 50% of elderly Japanese facing a lifetime risk of dementia, primarily attributed to AD. As the most prevalent form of dementia, AD gradually erodes brain cells, leading to severe neurological decline. In this scenario, it is important to develop an automatic AD-detection system, and many researchers have been working to develop an AD-detection system by taking advantage of the advancement of deep learning (DL) techniques, which have shown promising results in various domains, including medical image analysis. However, existing approaches for AD detection often suffer from limited performance due to the complexities associated with training hierarchical convolutional neural networks (CNNs). In this paper, we introduce a novel multi-stage deep neural network architecture based on residual functions to address the limitations of existing AD-detection approaches. Inspired by the success of residual networks (ResNets) in image-classification tasks, our proposed system comprises five stages, each explicitly formulated to enhance feature effectiveness while maintaining model depth. Following feature extraction, a deep learning-based feature-selection module is applied to mitigate overfitting, incorporating batch normalization, dropout and fully connected layers. Subsequently, machine learning (ML)-based classification algorithms, including Support Vector Machines (SVM), Random Forest (RF) and SoftMax, are employed for classification tasks. Comprehensive evaluations conducted on three benchmark datasets, namely ADNI1: Complete 1Yr 1.5T, MIRAID and OASIS Kaggle, demonstrate the efficacy of our proposed model. Impressively, our model achieves accuracy rates of 99.47%, 99.10% and 99.70% for ADNI1: Complete 1Yr 1.5T, MIRAID and OASIS datasets, respectively, outperforming existing systems in binary class problems. Our proposed model represents a significant advancement in the AD-analysis domain. [ABSTRACT FROM AUTHOR]

To overcome the time-consuming drawbacks of Computational Fluid Dynamics (CFD) numerical simulations, this paper proposes a hybrid model named PA-TLA (parallel architecture combining a TCN, LSTM, and an attention mechanism) based on the concept of intelligent aerodynamics and a parallel architecture. This model utilizes CFD data to drive efficient predictions of aircraft wake evolution at different initial altitudes during the approach phase. Initially, CFD simulations of continuous initial altitudes during the approach phase are used to generate aircraft wake evolution data, which are then validated against real-world LIDAR data to verify their reliability. The PA-TLA model is designed based on a parallel architecture, combining Long Short-Term Memory (LSTM) networks, Temporal Convolutional Networks (TCNs), and a tensor concatenation module based on the attention mechanism, which ensures computational efficiency while fully leveraging the advantages of each component in a parallel processing framework. The study results show that the PA-TLA model outperforms both the LSTM and TCN models in predicting the three characteristic parameters of aircraft wake: vorticity, circulation, and Q-criterion. Compared to the serially structured TCN-LSTM, PA-TLA achieves an average reduction in mean squared error (MSE) of 6.80%, in mean absolute error (MAE) of 7.70%, and in root mean square error (RMSE) of 4.47%, with an average increase in the coefficient of determination (R2) of 0.36% and a 35% improvement in prediction efficiency. Lastly, this study combines numerical simulations and the PA-TLA deep learning architecture to analyze the near-ground wake vortex evolution. The results indicate that the ground effect increases air resistance and turbulence as vortices approach the ground, thereby slowing the decay rate of the wake vortex strength at lower altitudes. The ground effect also accelerates the dissipation and movement of vortex centers, causing more pronounced changes in vortex spacing at lower altitudes. Additionally, the vortex center height at lower altitudes initially decreases and then increases, unlike the continuous decrease observed at higher altitudes. [ABSTRACT FROM AUTHOR]

This paper presents a novel approach to sentiment analysis specifically customized for predicting stock market movements, bypassing the need for external dictionaries that are often unavailable for many languages. Our methodology directly analyzes textual data, with a particular focus on context-specific sentiment words within neural network models. This specificity ensures that our sentiment analysis is both relevant and accurate in identifying trends in the stock market. We employ sophisticated mathematical modeling techniques to enhance both the precision and interpretability of our models. Through meticulous data handling and advanced machine learning methods, we leverage large datasets from Twitter and financial markets to examine the impact of social media sentiment on financial trends. We achieved an accuracy exceeding 75%, highlighting the effectiveness of our modeling approach, which we further refined into a convolutional neural network model. This achievement contributes valuable insights into sentiment analysis within the financial domain, thereby improving the overall clarity of forecasting in this field. [ABSTRACT FROM AUTHOR]

Accidents due to defective railway lines and derailments are common disasters that are observed frequently in Southeast Asian countries. It is imperative to run proper diagnosis over the detection of such faults to prevent such accidents. However, manual detection of such faults periodically can be both time-consuming and costly. In this paper, we have proposed a Deep Learning (DL)-based algorithm for automatic fault detection in railway tracks, which we termed an Ensembled Convolutional Autoencoder ResNet-based Recurrent Neural Network (ECARRNet). We compared its output with existing DL techniques in the form of several pre-trained DL models to investigate railway tracks and determine whether they are defective or not while considering commonly prevalent faults such as—defects in rails and fasteners. Moreover, we manually collected the images from different railway tracks situated in Bangladesh and made our dataset. After comparing our proposed model with the existing models, we found that our proposed architecture has produced the highest accuracy among all the previously existing state-of-the-art (SOTA) architecture, with an accuracy of 93.28% on the full dataset. Additionally, we split our dataset into two parts having two different types of faults, which are fasteners and rails. We ran the models on those two separate datasets, obtaining accuracies of 98.59% and 92.06% on rail and fastener, respectively. Model explainability techniques like Grad-CAM and LIME were used to validate the result of the models, where our proposed model ECARRNet was seen to correctly classify and detect the regions of faulty railways effectively compared to the previously existing transfer learning models. [ABSTRACT FROM AUTHOR]

The paper introduces a computer vision methodology for detecting pitting corrosion in gas pipelines. To achieve this, a dataset comprising 576,000 images of pipelines with and without pitting corrosion was curated. A custom-designed and optimized convolutional neural network (CNN) was employed for binary classification, distinguishing between corroded and non-corroded images. This CNN architecture, despite having relatively few parameters compared to existing CNN classifiers, achieved a notably high classification accuracy of 98.44%. The proposed CNN outperformed many contemporary classifiers in its efficacy. By leveraging deep learning, this approach effectively eliminates the need for manual inspection of pipelines for pitting corrosion, thus streamlining what was previously a time-consuming and cost-ineffective process. [ABSTRACT FROM AUTHOR]

Featured Application: The Deep Neural Network model employed in this work will help build a system for the pre-diagnosis of retinopathies that can lead to blindness. The main intention of this type of system is to support the work performed by ophthalmology specialists. Computer-based pre-diagnosis of diseases through medical imaging is a task worked on for many years. The so-called fundus images stand out since they do not have uniform illumination and are highly sensitive to noise. One of the diseases that can be pre-diagnosed through fundus images is age-related macular degeneration, which initially manifests as the appearance of lesions called drusen. Several ways of pre-diagnosing macular degeneration have been proposed, methods based entirely on the segmentation of drusen with prior image processing have been designed and applied, and methods based on image pre-processing and subsequent conversion to feature vectors, or patterns, to be classified by a Machine-Learning model have also been developed. Finally, in recent years, the use of Deep-Learning models, particularly Convolutional Networks, has been proposed and used in classification problems where the data are only images. The latter has allowed the so-called transfer learning, which consists of using the learning achieved in the solution of one problem to solve another. In this paper, we propose the use of transfer learning through the Xception Deep Convolutional Neural Network to detect age-related macular degeneration in fundus images. The performance of the Xception model was compared against six other state-of-the-art models with a dataset created from images available in public and private datasets, which were divided into training/validation and test; with the training/validation set, the training was made using 10-fold cross-validation. The results show that the Xception neural network obtained a validation accuracy that surpasses other models, such as the VGG-16 or VGG-19 networks, and had an accuracy higher than 80% in the test set. We consider that the contributions of this work include the use of a Convolutional Neural Network model for the detection of age-related macular degeneration through the classification of fundus images in those affected by AMD (drusen) and the images of healthy patients. The performance of this model is compared against other methods featured in the state-of-the-art approaches, and the best model is tested on a test set outside the training and validation set. [ABSTRACT FROM AUTHOR]

Diabetes is caused by insulin deficiency or impaired biological action, and long-term hyperglycemia leads to a variety of tissue damage and dysfunction. Therefore, the early prediction of diabetes and timely intervention and treatment are crucial. This paper proposes a robust framework for the prediction and diagnosis of type 2 diabetes (T2DM) to aid in diabetes applications in clinical diagnosis. The data-preprocessing stage includes steps such as outlier removal, missing value filling, data standardization, and assigning class weights to ensure the quality and consistency of the data, thereby improving the performance and stability of the model. This experiment used the National Health and Nutrition Examination Survey (NHANES) dataset and the publicly available PIMA Indian dataset (PID). For T2DM classification, we designed a convolutional neural network (CNN) and proposed a novel attention-oriented convolutional neural network (SECNN) through the channel attention mechanism. To optimize the hyperparameters of the model, we used grid search and K-fold cross-validation methods. In addition, we also comparatively analyzed various machine learning (ML) models such as support vector machine (SVM), logistic regression (LR), decision tree (DT), random forest (RF), and artificial neural network (ANN). Finally, we evaluated the performance of the model using performance evaluation metrics such as precision, recall, F1-Score, accuracy, and AUC. Experimental results show that the SECNN model has an accuracy of 94.12% on the NHANES dataset and an accuracy of 89.47% on the PIMA Indian dataset. SECNN models and CNN models show significant improvements in diabetes prediction performance compared to traditional ML models. The comparative analysis of the SECNN model and the CNN model has significantly improved performance, further verifying the advantages of introducing the channel attention mechanism. The robust diabetes prediction framework proposed in this article establishes an effective foundation for diabetes diagnosis and prediction, and has a positive impact on the development of health management and medical industries. [ABSTRACT FROM AUTHOR]

Data information security on wearable devices has emerged as a significant concern among users, so it becomes urgent to explore authentication methods based on wearable devices. Using PhotoPlethysmoGraphy (PPG) signals for identity authentication has been proven effective in biometric authentication. This paper proposes a convolutional neural network authentication method based on 2D PPG signals applied to wearable devices. This method uses Markov Transition Field technology to convert one-dimensional PPG signal data into two-dimensional image data, which not only retains the characteristics of the signal but also enriches the spatial information. Afterward, considering that wearable devices usually have limited resources, a lightweight convolutional neural network model is also designed in this method, which reduces resource consumption and computational complexity while ensuring high performance. It is proved experimentally that this method achieves 98.62% and 96.17% accuracy on the training set and test set, respectively, an undeniable advantage compared to the traditional one-dimensional deep learning method and the classical two-dimensional deep learning method. [ABSTRACT FROM AUTHOR]

Learning in neural networks with locally-tuned neuron models such as radial Basis Function (RBF) networks is often seen as instable, in particular when multi-layered architectures are used. Furthermore, universal approximation theorems for single-layered RBF networks are very well established; therefore, deeper architectures are theoretically not required. Consequently, RBFs are mostly used in a single-layered manner. However, deep neural networks have proven their effectiveness on many different tasks. In this paper, we show that deeper RBF architectures with multiple radial basis function layers can be designed together with efficient learning schemes. We introduce an initialization scheme for deep RBF networks based on k-means clustering and covariance estimation. We further show how to make use of convolutions to speed up the calculation of the Mahalanobis distance in a partially connected way, which is similar to the convolutional neural networks (CNNs). Finally, we evaluate our approach on image classification as well as speech emotion recognition tasks. Our results show that deep RBF networks perform very well, with comparable results to other deep neural network types, such as CNNs. [ABSTRACT FROM AUTHOR]

Maritime traffic is increasing more and more, creating more complex navigation environments for ships. Ship trajectory prediction based on historical AIS data is a vital method of reducing navigation risks and enhancing the efficiency of maritime traffic control. At present, employing machine learning or deep learning techniques to construct predictive models based on AIS data has become a focal point in ship trajectory prediction research. This paper systematically evaluates various trajectory prediction methods, spanning classical machine learning approaches and emerging deep learning techniques, to uncover their respective merits and drawbacks. In this work, a variety of studies were investigated that applied different algorithms in ship trajectory prediction, including regression models (RMs), artificial neural networks (ANNs), Kalman filtering (KF), and random forests (RFs) in machine learning, along with deep learning such as convolutional neural networks (CNNs), recurrent neural networks (RNNs), long short-term memory (LSTM), gate recurrent unit (GRU) networks, and sequence-to-sequence (Seq2seq) networks. The performance of predictive models based on different algorithms in trajectory prediction tasks was graded and analyzed. Among the existing studies, deep learning methods exhibit significant performance and considerable potential application value for maritime traffic systems, which can be assessed by future work on ship trajectory prediction research. [ABSTRACT FROM AUTHOR]

This paper delves into the realm of human activity recognition (HAR) by leveraging the capabilities of Siamese neural networks (SNNs), focusing on the comparative effectiveness of contrastive and triplet learning approaches. Against the backdrop of HAR's growing importance in healthcare, sports, and smart environments, the need for advanced models capable of accurately recognizing and classifying complex human activities has become paramount. Addressing this, we have introduced a Siamese network architecture integrated with convolutional neural networks (CNNs) for spatial feature extraction, bidirectional LSTM (Bi-LSTM) for temporal dependency capture, and attention mechanisms to prioritize salient features. Employing both contrastive and triplet loss functions, we meticulously analyze the impact of these learning approaches on the network's ability to generate discriminative embeddings for HAR tasks. Through extensive experimentation, the study reveals that Siamese networks, particularly those utilizing triplet loss functions, demonstrate superior performance in activity recognition accuracy and F1 scores compared with baseline deep learning models. The inclusion of a stacking meta-classifier further amplifies classification efficacy, showcasing the robustness and adaptability of our proposed model. Conclusively, our findings underscore the potential of Siamese networks with advanced learning paradigms in enhancing HAR systems, paving the way for future research in model optimization and application expansion. [ABSTRACT FROM AUTHOR]

Recently, data-driven approaches have become the dominant solution for prediction problems in agricultural industries. Several deep learning models have been applied to crop yield prediction in smart farming. In this paper, we proposed an efficient hybrid deep learning model that coordinates the outcomes of a classification model and a regression model in deep learning via the shared layers to predict the rice crop yield. Three statistical analyses on the features, including Pearson correlation coefficients (PCC), Shapley additive explanations (SHAP), and recursive feature elimination with cross-validation (RFECV), are proposed to select the most relevant ones for the predictive goal to reduce the model training time. The data preprocessing normalizes the features of the collected data into specific ranges of values and then reformats them into a three-dimensional matrix. As a result, the root-mean-square error (RMSE) of the proposed model in rice yield prediction has achieved 344.56 and an R-squared of 0.64. The overall performance of the proposed model is better than the other deep learning models, such as the multi-parametric deep neural networks (MDNNs) (i.e., RMSE = 370.80, R-squared = 0.59) and the artificial neural networks (ANNs) (i.e., RMSE = 550.03, R-squared = 0.09). The proposed model has demonstrated significant improvement in the predictive results of distinguishing high yield from low yield with 90% accuracy and 94% F1 score. [ABSTRACT FROM AUTHOR]

Real-time detection of workers is crucial in construction safety management. Deep learning-based detecting methods are valuable, but always challenged by the possibility of target missing or identity errors under complex scenarios. To address these limitations, previous research depended on re-training for new models or datasets, which are prohibitively time-consuming and incur high computing demands. However, we demonstrate that the better detecting model might not rely on more re-training of weights; instead, a training-free model can achieve even better performance by integrating head information. In this paper, a new head-detecting branch (55 MB) is added to the Keypoint Region-based Convolutional Network (Keypoint R-CNN, 226 MB) without altering its original weights, allowing for a less occluded head to aid in body detection. We also deployed motion information and anthropometric data through a post-processing module to calculate movement relationships. This study achieved an identity F1-score (IDF1) of 97.609%, recall (Rcll) of 98.173%, precision (Prcn) of 97.052%, and accuracy of 95.329% as a state-of-the-art (SOTA) method for worker detection. This exploration breaks the inertial attitudes of re-training dependency and accelerates the application of universal models, in addition to reducing the computational difficulty for most construction sites, especially in scenarios with an insufficient graphics processing unit (GPU). More importantly, this study can address occlusion challenges effectively in the worker detection field, making it of practical significance. [ABSTRACT FROM AUTHOR]

Hyperspectral remote sensing images (HSIs) have both spectral and spatial characteristics. The adept exploitation of these attributes is central to enhancing the classification accuracy of HSIs. In order to effectively utilize spatial and spectral features to classify HSIs, this paper proposes a method for the spatial feature extraction of HSIs based on a mutually guided image filter (muGIF) and combined with the band-distance-grouped principal component. Firstly, aiming at the problem that previously guided image filtering cannot effectively deal with the inconsistent information structure between the guided and target information, a method for extracting spatial features using muGIF is proposed. Then, aiming at the problem of the information loss caused by a single principal component as a guided image in the traditional GIF-based spatial–spectral classification, a spatial feature-extraction framework based on the band-distance-grouped principal component is proposed. The method groups the bands according to the band distance and extracts the principal components of each set of band subsets as the guide map of the current band subset to filter the HSIs. A deep convolutional neural network model and a generative adversarial network model for the filtered HSIs are constructed and then trained using samples for HSIs' spatial–spectral classification. Experiments show that compared with the traditional methods and several popular spatial–spectral HSI classification methods based on a filter, the proposed methods based on muGIF can effectively extract the spatial–spectral features and improve the classification accuracy of HSIs. [ABSTRACT FROM AUTHOR]

Accurate short-term load forecasting (STLF) is essential for power grid systems to ensure reliability, security and cost efficiency. Thanks to advanced smart sensor technologies, time-series data related to power load can be captured for STLF. Recent research shows that deep neural networks (DNNs) are capable of achieving accurate STLP since they are effective in predicting nonlinear and complicated time-series data. To perform STLP, existing DNNs use time-varying dynamics of either past load consumption or past power correlated features such as weather, meteorology or date. However, the existing DNN approaches do not use the time-invariant features of users, such as building spaces, ages, isolation material, number of building floors or building purposes, to enhance STLF. In fact, those time-invariant features are correlated to user load consumption. Integrating time-invariant features enhances STLF. In this paper, a fuzzy clustering-based DNN is proposed by using both time-varying and time-invariant features to perform STLF. The fuzzy clustering first groups users with similar time-invariant behaviours. DNN models are then developed using past time-varying features. Since the time-invariant features have already been learned by the fuzzy clustering, the DNN model does not need to learn the time-invariant features; therefore, a simpler DNN model can be generated. In addition, the DNN model only learns the time-varying features of users in the same cluster; a more effective learning can be performed by the DNN and more accurate predictions can be achieved. The performance of the proposed fuzzy clustering-based DNN is evaluated by performing STLF, where both time-varying features and time-invariant features are included. Experimental results show that the proposed fuzzy clustering-based DNN outperforms the commonly used long short-term memory networks and convolution neural networks. [ABSTRACT FROM AUTHOR]

Commercial buildings in hot and humid tropical climates rely significantly on cooling systems to maintain optimal occupant comfort. A well-accurate day-ahead load profile prediction plays a pivotal role in planning the energy requirements of cooling systems. Despite the pressing need for effective day-ahead cooling load predictions, current methodologies have not fully harnessed the potential of advanced deep-learning techniques. This paper aims to address this gap by investigating the application of innovative deep-learning models in day-ahead hourly cooling load prediction for commercial buildings in tropical climates. A range of multi-output deep learning techniques, including Deep Neural Networks (DNNs), Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and Long Short-Term Memory networks (LSTMs), are employed to enhance prediction accuracy. Furthermore, these individual deep learning techniques are synergistically integrated to create hybrid models, such as CNN-LSTM and Sequence-to-Sequence models. Experiments are conducted to choose the time horizons from the past that can serve as input to the models. In addition, the influence of various categories of input parameters on prediction performance has been assessed. Historical cooling load, calendar features, and outdoor weather parameters are found in decreasing order of influence on prediction accuracy. This research focuses on buildings located in Singapore and presents a comprehensive case study to validate the proposed models and methodologies. The sequence-to-sequence model provided better performance than all the other models. It offered a CV-RMSE of 7.4%, 10%, and 6% for SIT@Dover, SIT@NYP, and the simulated datasets, which were 2.3%, 3%, and 1% less, respectively, than the base Deep Neural Network model. [ABSTRACT FROM AUTHOR]

Artificial intelligence (AI) is one of the most promising technologies based on machine learning algorithms. In this paper, we propose a workflow for the implementation of deep neural networks. This workflow attempts to combine the flexibility of high-level compilers (HLS)-based networks with the architectural control features of hardware description languages (HDL)-based flows. The architecture consists of a convolutional neural network, SqueezeNet v1.1, and a hard processor system (HPS) that coexists with acceleration hardware to be designed. This methodology allows us to compare solutions based solely on software (PyTorch 1.13.1) and propose heterogeneous inference solutions, taking advantage of the best options within the software and hardware flow. The proposed workflow is implemented on a low-cost field programmable gate array system-on-chip (FPGA SOC) platform, specifically the DE10-Nano development board. We have provided systolic architectural solutions written in OpenCL that are highly flexible and easily tunable to take full advantage of the resources of programmable devices and achieve superior energy efficiencies working with a 32-bit floating point. From a verification point of view, the proposed method is effective, since the reference models in all tests, both for the individual layers and the complete network, have been readily available using packages well known in the development, training, and inference of deep networks. [ABSTRACT FROM AUTHOR]

Cognitive decline represents a significant public health concern due to its severe implications on memory and general health. Early detection is crucial to initiate timely interventions and improve patient outcomes. However, traditional diagnosis methods often rely on personal interpretations or biases, may not detect the early stages of cognitive decline, or involve invasive screening procedures; thus, there is a growing interest in developing non-invasive methods benefiting also from the technological advances. Wearable devices and Internet of Things sensors can monitor various aspects of daily life together with health parameters and can provide valuable data regarding people's behavior. In this paper, we propose a technical solution that can be useful for potentially supporting cognitive decline assessment in early stages, by employing advanced machine learning techniques for detecting higher activity fragmentation based on daily activity monitoring using wearable devices. Our approach also considers data coming from wellbeing assessment questionnaires that can offer other important insights about a monitored person. We use deep neural network models to capture complex, non-linear relationships in the daily activities data and graph learning for the structural wellbeing information in the questionnaire answers. The proposed solution is evaluated in a simulated environment on a large synthetic dataset, the results showing that our approach can offer an alternative as a support for early detection of cognitive decline during patient-assessment processes. [ABSTRACT FROM AUTHOR]

Compared to traditional industrial materials, composites have higher durability and compressive strength. However, some components may have flaws due to the manufacturing process. Traditional defect detection methods have low accuracy and cannot adapt to complex shooting environments. Aiming to address the issues of high computational requirements in traditional detection models and the lack of lightweight detection capabilities, the Ghost module is used instead of convolutional arithmetic to construct a lightweight model. To reduce the computational complexity of the feature extraction module, we have incorporated an improved Efficient Channel Attention mechanism to improve the model's feature extraction capabilities. A rapid defect classification method is implemented to determine whether there are defects in the image or not by comparing the performance and running speed of models such as AlexNet, VGGNet, and ResNet. And ablation experiments are conducted for each model. The results show that the Ghost module model, which incorporates the improved Efficient Channel Attention mechanism, has a significant optimization effect on the convolutional neural network model. It can achieve a high accuracy rate when constructing lightweight models. It improves the running speed of the model, making it more efficient to use and deploy. [ABSTRACT FROM AUTHOR]

This document is a summary of a special issue titled "Deep and Machine Learning for Image Processing: Medical and Non-medical Applications." The special issue explores the use of machine learning and deep learning technologies in image processing, with a focus on medical and non-medical applications. The contributions cover a wide range of topics, including the use of ensemble models for diagnosing myocardial infarction, camouflaged object detection, crime analysis using seasonal autoregressive integrated moving average models, monkeypox diagnosis using metaheuristic optimization algorithms, instance segmentation for power operation monitoring, long-distance person detection, hate-speech detection on social media, perceptual image quality prediction, material discrimination using colorization, compressed sensing magnetic resonance imaging, quantization for low-power accelerators, and computer-aided diagnosis for skin diseases. The document also highlights future research directions, such as refining integrated ML/DL models, broadening predictive modeling, enhancing data fusion, advancing imaging and material discrimination techniques, developing context-aware natural language processing models, improving object detection, optimizing for edge computing, innovating in medical imaging, and assessing multimedia content quality. The special issue aims to showcase the current state of research in ML and DL applications for image processing and inspire further advancements in the field. [Extracted from the article]

This paper addresses the critical issue of fault detection and prediction in electric motor machinery, a prevalent challenge in industrial applications. Faults in these machines, stemming from mechanical or electrical issues, often lead to performance degradation or malfunctions, manifesting as abnormal signals in vibrations or currents. Our research focuses on enhancing the accuracy of fault classification in electric motor facilities, employing innovative image transformation methods—recurrence plots (RPs), the Gramian angular summation field (GASF), and the Gramian angular difference field (GADF)—in conjunction with a multi-input convolutional neural network (CNN) model. We conducted comprehensive experiments using datasets encompassing four types of machinery components: bearings, belts, shafts, and rotors. The results reveal that our multi-input CNN model exhibits exceptional performance in fault classification across all machinery types, significantly outperforming traditional single-input models. This study not only demonstrates the efficacy of advanced image transformation techniques in fault detection but also underscores the potential of multi-input CNN models in industrial fault diagnosis, paving the way for more reliable and efficient monitoring of electric motor machinery. [ABSTRACT FROM AUTHOR]

Brain tumor detection and categorization of its subtypes are essential for early diagnosis and improving patient outcomes. This research presents a cutting-edge approach that employs advanced data augmentation and deep learning methodologies for brain tumor classification. For this work, a dataset of 6982 MRI images from the IEEE Data Port was considered, in which a total of 5712 images of four classes (1321 glioma, 1339 meningioma, 1595 no tumor, and 1457 pituitary) were used in the training set and a total of 1270 images of the same four classes were used in the testing set. A Wasserstein Generative Adversarial Network was implemented to generate synthetic images to address class imbalance, resulting in a balanced and consistent dataset. A comparison was conducted between various data augmentation metholodogies demonstrating that Wasserstein Generative Adversarial Network-augmented results perform excellently over traditional augmentation (such as rotation, shift, zoom, etc.) and no augmentation. Additionally, a Gaussian filter and normalization were applied during preprocessing to reduce noise, highlighting its superior accuracy and edge preservation by comparing its performance to Median and Bilateral filters. The classifier model combines parallel feature extraction from modified InceptionV3 and VGG19 followed by custom attention mechanisms for effectively capturing the characteristics of each tumor type. The model was trained for 64 epochs using model checkpoints to save the best-performing model based on validation accuracy and learning rate adjustments. The model achieved a 99.61% accuracy rate on the testing set, with precision, recall, AUC, and loss of 0.9960, 0.9960, 0.0153, and 0.9999, respectively. The proposed architecture's explainability has been enhanced by t-SNE plots, which show unique tumor clusters, and Grad-CAM representations, which highlight crucial areas in MRI scans. This research showcases an explainable and robust approach for correctly classifying four brain tumor types, combining WGAN-augmented data with advanced deep learning models in feature extraction. The framework effectively manages class imbalance and integrates a custom attention mechanism, outperforming other models, thereby improving diagnostic accuracy and reliability in clinical settings. [ABSTRACT FROM AUTHOR]

This study focused on exploring the utilization of a one-part geopolymer (OPG) as a sustainable alternative binder to ordinary Portland cement (OPC) in soil stabilization, offering significant environmental advantages. The unconfined compressive strength (UCS) was the key index for evaluating the efficacy of OPG in soil stabilization, traditionally demanding substantial resources in terms of cost and time. In this research, four distinct deep learning (DL) models (Artificial Neural Network [ANN], Backpropagation Neural Network [BPNN], Convolutional Neural Network [CNN], and Long Short-Term Memory [LSTM]) were employed to predict the UCS of OPG-stabilized soft clay, providing a more efficient and precise methodology. Among these models, CNN exhibited the highest performance (MAE = 0.022, R2 = 0.9938), followed by LSTM (MAE = 0.0274, R2 = 0.9924) and BPNN (MAE = 0.0272, R2 = 0.9921). The Wasserstein Generative Adversarial Network (WGAN) was further utilized to generate additional synthetic samples for expanding the training dataset. The incorporation of the synthetic samples generated by WGAN models into the training set for the DL models led to improved performance. When the number of synthetic samples achieved 200, the WGAN-CNN model provided the most accurate results, with an R2 value of 0.9978 and MAE value of 0.9978. Furthermore, to assess the reliability of the DL models and gain insights into the influence of input variables on the predicted outcomes, interpretable Machine Learning techniques, including a sensitivity analysis, Shapley Additive Explanation (SHAP), and 1D Partial Dependence Plot (PDP) were employed for analyzing and interpreting the CNN and WGAN-CNN models. This research illuminates new aspects of the application of DL models with training on real and synthetic data in evaluating the strength properties of the OPG-stabilized soil, contributing to saving time and cost. [ABSTRACT FROM AUTHOR]

This review explores the impact of Artificial Intelligence (AI) in dentistry, reflecting on its potential to reshape traditional practices and meet the increasing demands for high-quality dental care. The aim of this research is to examine how AI has evolved in dentistry over the past two decades, driven by two pivotal questions: "What are the current emerging trends and developments in AI in dentistry?" and "What implications do these trends have for the future of AI in the dental field?". Utilizing the Scopus database, a bibliometric analysis of the literature from 2000 to 2023 was conducted to address these inquiries. The findings reveal a significant increase in AI-related publications, especially between 2018 and 2023, underscoring a rapid expansion in AI applications that enhance diagnostic precision and treatment planning. Techniques such as Deep Learning (DL) and Neural Networks (NN) have transformed dental practices by enhancing diagnostic precision and reducing workload. AI technologies, particularly Convolutional Neural Networks (CNNs) and Artificial Neural Networks (ANNs), have improved the accuracy of radiographic analysis, from detecting dental pathologies to automating cephalometric evaluations, thereby optimizing treatment outcomes. This advocacy is underpinned by the need for AI applications in dentistry to be both efficacious and ethically sound, ensuring that they not only improve clinical outcomes but also adhere to the highest standards of patient care. [ABSTRACT FROM AUTHOR]

Simple Summary: In this study, a Common Objects in Context dataset of ovine pulmonary adenocarcinoma pathological images was constructed based on 7167 annotated typical lesions from 61,063 lung pathological images of ovine pulmonary adenocarcinoma. This study aimed to develop a mask regional convolutional neural network model for the localization and pathological diagnosis of ovine pulmonary adenocarcinoma lesions. The model achieved a mean average specificity of 0.573 and an average sensitivity of 0.745, with consistency rates of 100% for junior pathologists and 96.5% for senior pathologists in the diagnosis of ovine pulmonary adenocarcinoma. The successful development of this model not only facilitates the rapid diagnosis of ovine pulmonary adenocarcinoma by different personnel in practical applications but also lays a foundation for the transition from traditional pathology to digital pathology in the livestock industry. Ovine pulmonary adenocarcinoma (OPA) is a contagious lung tumour caused by the Jaagsiekte Sheep Retrovirus (JSRV). Histopathological diagnosis is the gold standard for OPA diagnosis. However, interpretation of traditional pathology images is complex and operator dependent. The mask regional convolutional neural network (Mask R-CNN) has emerged as a valuable tool in pathological diagnosis. This study utilized 54 typical OPA whole slide images (WSI) to extract 7167 typical lesion images containing OPA to construct a Common Objects in Context (COCO) dataset for OPA pathological images. The dataset was categorized into training and test sets (8:2 ratio) for model training and validation. Mean average specificity (mASp) and average sensitivity (ASe) were used to evaluate model performance. Six WSI-level pathological images (three OPA and three non-OPA images), not included in the dataset, were used for anti-peeking model validation. A random selection of 500 images, not included in the dataset establishment, was used to compare the performance of the model with assessment by pathologists. Accuracy, sensitivity, specificity, and concordance rate were evaluated. The model achieved a mASp of 0.573 and an ASe of 0.745, demonstrating effective lesion detection and alignment with expert annotation. In Anti-Peeking verification, the model showed good performance in locating OPA lesions and distinguished OPA from non-OPA pathological images. In the random 500-image diagnosis, the model achieved 92.8% accuracy, 100% sensitivity, and 88% specificity. The agreement rates between junior and senior pathologists were 100% and 96.5%, respectively. In conclusion, the Mask R-CNN-based OPA diagnostic model developed for OPA facilitates rapid and accurate diagnosis in practical applications. [ABSTRACT FROM AUTHOR]

Cogeneration is an important means for heat supply enterprises to obtain heat, and accurate load prediction is particularly crucial. The heat load of a centralized heat supply system is influenced by various factors such as outdoor meteorological parameters, the building envelope structure, and regulation control, which exhibit a strong coupling and nonlinearity. It is essential to identify the key variables affecting the heat load at different heating stages through data mining techniques and to use deep learning algorithms to precisely regulate the heating system based on load predictions. In this study, a heat station in a northern Chinese city is taken as the subject of research. We apply the Fuzzy Clustering based on Fourier distance (FCBD-FCM) algorithm to transform the factors influencing the long and short-term load prediction of heat supply from the time domain to the frequency domain. This transformation is used to analyze the degree of their impact on load changes and to extract factors with significant influence as the multifeatured input variables for the prediction model. Five neural network models for load prediction are established, namely, Backpropagation (BP), convolutional neural network (CNN), Long Short-Term Memory (LSTM), CNN-LSTM, and CNN-BiLSTM. These models are compared and analyzed for their performance in long-term, short-term, and ultrashort-term heating load prediction. The findings indicate that the load prediction accuracy is high when multifeatured input variables are based on fuzzy clustering. Furthermore, the CNN-BiLSTM model notably enhances the prediction accuracy and generalization ability compared to other models, with the Mean Absolute Percentage Error (MAPE) averaging within 3%. [ABSTRACT FROM AUTHOR]

Artificial Intelligence (AI) methods, including Artificial Neural Networks (ANNs), Adaptive Neuro-Fuzzy Inference Systems (ANFISs), Support Vector Machines (SVMs), Deep Learning (DL), Genetic Programming (GP) and Hybrid Algorithms, have proven to be important tools for accurate groundwater level (GWL) modelling. Through an analysis of the results obtained in numerous articles published in high-impact journals during 2001–2023, this comprehensive review examines each method's capabilities, their combinations, and critical considerations about selecting appropriate input parameters, using optimisation algorithms, and considering the natural physical conditions of the territories under investigation to improve the models' accuracy. For example, ANN takes advantage of its ability to recognise complex patterns and non-linear relationships between input and output variables. In addition, ANFIS shows potential in processing diverse environmental data and offers higher accuracy than alternative methods such as ANN, SVM, and GP. SVM excels at efficiently modelling complex relationships and heterogeneous data. Meanwhile, DL methods, such as Long Short-Term Memory (LSTM) and Convolutional Neural Networks (CNNs), are crucial in improving prediction accuracy at different temporal and spatial scales. GP methods have also shown promise in modelling complex and nonlinear relationships in groundwater data, providing more accurate and reliable predictions when combined with optimisation techniques and uncertainty analysis. Therefore, integrating these methods and optimisation techniques (Hybrid Algorithms), tailored to specific hydrological and hydrogeological conditions, can significantly increase the predictive capability of GWL models and improve the planning and management of water resources. These findings emphasise the importance of thoroughly understanding (a priori) the functionalities and capabilities of each potentially beneficial AI-based methodology, along with the knowledge of the physical characteristics of the territory under investigation, to optimise GWL predictive models. [ABSTRACT FROM AUTHOR]

This document is a correction notice for an article titled "Parking Lot Occupancy Detection with Improved MobileNetV3" published in the journal Sensors. The correction includes errors in figures and figure legends, as well as text corrections in various sections of the article. The article discusses different approaches to parking lot occupancy detection, including traditional machine learning approaches and deep learning approaches. It also mentions several studies that have proposed methods using feature extraction and machine learning methodologies. The article compares different deep neural networks and datasets used for parking occupancy classification. The correction notice provides updated figures and corrects errors in the text. This document is a correction to a previous article. It provides a revised list of references for the article, ensuring that the correct sources are cited. The correction does not affect the scientific conclusions of the original article. The document also includes three figures: Figure 6 shows a graph of empty and busy parking spaces, Figure 7 displays samples from the CNRPark-EXT dataset taken in different weather conditions, and Figure 8 shows examples of different parking lots and weather conditions from the PKLot dataset. The authors of the correction are Yusufbek Yuldashev, Mukhriddin Mukhiddinov, Akmalbek Bobomirzaevich Abdusalomov, Rashid Nasimov, and Jinsoo Cho. [Extracted from the article]