Search

Drying processes are among the most energy-intensive industrial processes. There is a need for development of the efficient methods needed for estimating, measuring, and reducing energy use. Different machine learning algorithms might provide some of the answers to these issues in a faster and less costly way, without the need for time-consuming and expensive experiments done at different scales of the dryers. The aim of this paper was to provide a comprehensive overview of machine learning applications for addressing energy-related challenges by exploration of different energy types and energy reduction opportunities. Also, the analysis of the applied algorithms, their specific applications and a critical evaluation of the obtained results are provided. The paper is based on the necessity of the improvements in energy use needed for drying related on the existing data. The overview of the ways for such achievements, and a general classification of machine learning algorithm are the background of the paper. The methods used are the machine learning techniques employed in different energy-related issues for drying processes. The paper focuses on the applications of artificial neural networks and other machine learning algorithms and models for different energy-related issues, including different energy types applications, challenges associated with energy consumption, and opportunities for energy reduction. Not only the applied algorithms, but also their specific applications, and the statistical analysis of the obtained results are also overviewed. Finally, a critical evaluation of the findings highlighting the potentials of machine learning algorithms in addressing energy-related challenges (such as estimation of energy consumption, opportunities for energy reduction, and use of different energy sources) is provided. The presented analysis underscored the effectiveness of machine learning applications for these purposes. [ABSTRACT FROM AUTHOR]

Electrical drive systems are commonly applied for the mechanisms of precise movement, where having a high-quality position and high-quality speed control is especially valuable. Very often, the mechanical part of these systems reveals resonant properties that are related to the limited stiffness of the interconnection between subsequent parts of the mechanism. In most cases, this sort of system may be described as a model of several linked masses. If only the structure of the mechanical part is known and the corresponding parameters are constant and identified, the demanded control quality may be obtained using a properly tuned ADRC or PID controller equipped with appropriate anti-resonance filtration. However, if the parameters of the mechanical part are variant, adaptive control may be considered as a solution. In this paper, artificial neural network (ANN) is considered to be a speed controller and its training method assures adaptation to the unknown mechanical parameters. The paper is particularly focused on a three-mass system, which possesses, due to its structure, two resonant frequencies. The unique property of the analyzed system is the application of drive units at both ends of the system, so that the controller has the ability to influence the resonant system from both sides. The coordination of the drive unit is performed by the aforementioned ANN, from which two outputs affect the drive units independently. The derivation of the mathematical model is followed by its implementation in a computer simulation and finally the evaluation in a dedicated laboratory setup, the construction of which is also presented in the paper. [ABSTRACT FROM AUTHOR]

This document is a preface to a special collection in honor of Freeman Dyson, a renowned mathematician and theoretical physicist. Dyson made significant contributions to various fields, including quantum electrodynamics, statistical mechanics, many-body quantum mechanics, stability of matter, quantum entropy, trace inequalities, and random matrix theory. The collection includes papers related to these topics, written by collaborators and former colleagues of Dyson. Dyson received numerous prestigious prizes and awards throughout his career. The preface also mentions a paper in the collection that applies mathematics to neuroscience, which Dyson would have appreciated. [Extracted from the article]

Attention deficit hyperactivity disorder (ADHD) is a common neurodevelopmental disorder that is characterized by inattention, hyperactivity, and impulsivity. The neural mechanisms underlying ADHD remain inadequately understood, and current approaches do not well link neural networks and attention networks within brain networks. Our objective is to investigate the neural mechanisms related to attention and explore neuroimaging biological tags that can be generalized within the attention networks. In this paper, we utilized resting-state functional magnetic resonance imaging data to examine the differential functional connectivity network between ADHD and typically developing individuals. We employed a graph convolutional neural network model to identify individuals with ADHD. After classification, we visualized brain regions with significant contributions to the classification results. Our results suggest that the frontal, temporal, parietal, and cerebellar regions are likely the primary areas of dysfunction in individuals with ADHD. We also explored the relationship between regions of interest and attention networks, as well as the connection between crucial nodes and the distribution of positively and negatively correlated connections. This analysis allowed us to pinpoint the most discriminative brain regions, including the right orbitofrontal gyrus, the left rectus gyrus and bilateral insula, the right inferior temporal gyrus and bilateral transverse temporal gyrus in the temporal region, and the lingual gyrus of the occipital lobe, multiple regions of the basal ganglia and the upper cerebellum. These regions are primarily involved in the attention executive control network and the attention orientation network. Dysfunction in the functional connectivity of these regions may contribute to the underlying causes of ADHD. [ABSTRACT FROM AUTHOR]

Recently, skin cancer is one of the spread and dangerous cancers around the world. Early detection of skin cancer can reduce mortality. Traditional methods for skin cancer detection are painful, time-consuming, expensive, and may cause the disease to spread out. Dermoscopy is used for noninvasive diagnosis of skin cancer. Artificial Intelligence (AI) plays a vital role in diseases' diagnosis especially in biomedical engineering field. The automated detection systems based on AI reduce the complications in the traditional methods and can improve skin cancer's diagnosis rate. In this paper, automated early detection system for skin cancer dermoscopic images using artificial intelligent is presented. Adaptive snake (AS) and region growing (RG) algorithms are used for automated segmentation and compared with each other. The results show that AS is accurate and efficient (accuracy = 96%) more than RG algorithm (accuracy = 90%). Artificial Neural networks (ANN) and support vector machine (SVM) algorithms are used for automated classification compared with each other. The proposed system with ANN algorithm shows high accuracy (94%), precision (96%), specificity (95.83%), sensitivity (recall) (92.30%), and F1-score (0.94). The proposed system is easy to use, time consuming, enables patients to make early detection for skin cancer and has high efficiency. [ABSTRACT FROM AUTHOR]

Phase-to-height mapping is one of the important processes in three dimensional phase measurement profilometry. But, in traditional phase-to-height mapping method, the measurement accuracy is affected by device attitude, so it needs saving a large amount of mapping equations to achieve high-quality phase-to-height mapping. In order to improve that, this paper proposes an improved phase-to-height mapping method combine with device attitude. Firstly, we get the unwrapped phase of the target. Then, using generalized regression neural network is used to reduce the offset of phase information at the same height due to the randomness of device attitude. Last, the phase-to-height mapping is completed by substituting the unwrapped phase (the difference between having detected object and no detected object) of eliminate the offset into improved phase-to-height mapping method. Experimental results show that the proposed method could achieve high-quality phase-to-height mapping with less mapping equation and less memory space. Compared with the nonlinear phase-to-height mapping method (probabilistic neural network to eliminate phase offset), its accuracy is improved by 44.30%. Compared with the nonlinear phase-to-height mapping method (radial basis function neural network to eliminate phase offset), the accuracy is improved by 39.58%. [ABSTRACT FROM AUTHOR]

Social emotion prediction aims to predict readers' emotion, for example, emotion distributions evoked by documents (e.g., news articles). It makes a significant contribution to social media applications, such as opinion summary, election prediction, and emotions investigation of society. While recent studies have focused on encoding consecutive word sequences in documents using neural network models and leveraging topical information, it is essential to acknowledge the influence of documents sharing similar topics or being related to similar events on evoking readers' emotions. The interactions among documents can significantly impact social emotion prediction. In this paper, we propose a novel approach to model the interactions among documents by constructing a heterogeneous graph. This graph captures the interaction among documents based on global word co-occurrence patterns in a corpus and the emotional scores of words obtained from emotion lexicons. Additionally, we develop heterogeneous graph convolution attention network (HGCA) to embed the heterogeneous graph. This network effectively captures the importance of different neighboring nodes and different node types, enabling comprehensive emotion prediction. Furthermore, we develop Taylor series expansion-based Transformer (Tayformer) to derive initialized node representations that can be co-trained with our graph network while having low memory complexity. Experimental results on four benchmark datasets show the effectiveness of our method. [ABSTRACT FROM AUTHOR]

Schedule maintenance activities for hydrogen fuel cell vehicles are aimed to keep them in better condition in long-term operation. In this paper, we develop a reinforcement learning based schedule maintenance strategy, which is used to comprehensively consider the balance between safety and maintenance cost, so as to find the optimal maintenance strategy. A multi-level framework is established with remaining useful life of key components, fault tree analysis, and logistics cost model to generate an exploration environment that can express the operational stability, the failure rate of components, and the cost of repair and storage. The trained agent combines a deep neural network to explore the optimal strategy under the dynamic reliability of key components. Finite steps are the constraints. Safety rates, maintenance cost, and episode of operation are incorporated into a multi-objective reward function. The hydrogen supply circuit of fuel cell vehicle is simulated via Python. The trained agent is compared with traditional time-based schedule maintenance strategy and corrective maintenance strategy. The results show that the reinforcement learning based schedule maintenance agent has optimized the total reward, cost control and accident rate by 77%, 59% and 5%, respectively, compared with the traditional time-based schedule maintenance strategy. In the safe operation management of fuel cell vehicles, efficient and stable decision-making ability has been achieved. • An adaptive maintenance strategy of deep reinforcement learning is proposed. • An exploration environment of FCV is established. • The deep Q network is proposed to solve the maintenance problem. • The efficient and stable decision-making ability is much better than time-based scheduled maintenance strategy. [ABSTRACT FROM AUTHOR]

In industrial applications, three-phase induction motors (IMs) are widely used, and they are subjected to many types of faults. One such fault is the loss of a motor phase caused by a blown fuse, a broken wire, mechanical damage, etc. When this fault occurs during motor operation, it continues to rotate but experiences rapid heating, which can ultimately lead to motor failure. Therefore, various protection devices are available to protect the motor against this fault, but most traditional protection devices do not offer a comprehensive classification of such a fault. So, in this paper, an efficient neural network model is presented for detecting and classifying 12 types of phase loss faults for a three-phase induction motor (IM) based on factors such as the unhealthy phase, fault location, and motor action modes (standstill, transient, and steady-state modes). Thus, the main goal of this work is to determine the motor mode during the fault, the defective phase, and its location to help the maintenance team repair the fault quickly. The system is simulated and tested using the "MATLAB/Simulink" software, employing a feed-forward neural network. The simulation results demonstrate that the proposed network achieves correct detection and classification of phase loss faults within a short time frame from the occurrence of the fault. Therefore, the proposed network model proves to be a simple and reliable solution for integration into the protection system of a three-phase IM, enabling the detection and classification of various phase loss faults. [ABSTRACT FROM AUTHOR]

An artificial neural network (ANN) in information technology is a system of hardware or software modeled after the operation of neurons in the human brain. ANNs, often known as "neural networks," are a form of deep learning technology that falls under the umbrella of Artificial Intelligence (AI). Commercial applications of these technologies typically focus on optimization and solving complex signal processing and pattern recognition problems. Multiple types of optimization techniques are utilized to determine the optimal neural network for a model. These procedures help determine and define the model's accuracy, dependability, functionality, and capacity. The convergence of the neural network helps determine the number of training iterations required to generate the fewest errors. In this paper, we investigate an activation function to help reduce the training time of the analog-to-digital converter (ADC). A new Hopfield ADC model is proposed by using the proteretic activation function property. We supported our research by simulating the new ADC converter and comparing the traditional Hopfield ADC, the hysteretic ADC, and the proteretic ADC. Experiment and simulation demonstrate that the proteretic function provides a faster rate of convergence than other functions, thereby enhancing the performance of the ADC application. [ABSTRACT FROM AUTHOR]

People with color vision deficiency (CVD) have difficulty in distinguishing differences between colors. To compensate for the loss of color contrast experienced by CVD individuals, a lot of image recoloring approaches have been proposed. However, the state-of-the-art methods suffer from the failures of simultaneously enhancing color contrast and preserving naturalness of colors [without reducing the Quality of Vision (QOV)], high computational cost, etc. In this paper, we propose an image recoloring method using deep neural network, whose loss function takes into consideration the naturalness and contrast, and the network is trained in an unsupervised manner. Moreover, Swin transformer layer, which has long-range dependency mechanism, is adopted in the proposed method. At the same time, a dataset, which contains confusing color pairs to CVD individuals, is newly collected in this study. To evaluate the performance of the proposed method, quantitative and subjective experiments have been conducted. The experimental results showed that the proposed method is competitive to the state-of-the-art methods in contrast enhancement and naturalness preservation and has a real-time advantage. The code and model will be made available at https://github.com/Ligeng-c/CVD_swin. [ABSTRACT FROM AUTHOR]

In recent studies, artificial intelligence models have been developed for the prediction of nitrogen oxide emissions from thermal power plants. This research utilizes an artificial intelligence prediction model with more coal input features than boiler features, including volatility, ash content, sulfur content, fixed carbon, total moisture, calorific value, grinding rate, fuel ratio, coal feeding rate, boiler efficiency, total air volume, and excess air volume. The paper delves into the importance analysis of input features for artificial intelligence models. Moreover, feature importance analysis is not only a prerequisite for predicting nitrogen oxide emissions but also a study providing insights into model performance. An artificial neural networks (ANN) regression model is employed to predict nitrogen oxide emissions, and the results demonstrate that the number of feature importance significantly impacts model performance. The best model performance is achieved with eight specific input features. Finally, after the training and validation processes, the ANN model yields the optimal coefficient of determination (R2) value. • Development of an artificial intelligence prediction model for nitrogen oxide emissions from thermal power plants. • A comprehensive set of input features is utilized for emissions prediction. • Importance analysis of input features significantly impacts model performance. • Optimal model performance was achieved with eight specific input features. • The robust coefficient of determination (R2) value demonstrates the accuracy of the ANN model. [ABSTRACT FROM AUTHOR]

This paper studies the flexible double shop scheduling problem (FDSSP) that considers simultaneously job shop and assembly shop. It brings about the problem of scheduling association of the related tasks. To this end, a reinforcement learning algorithm with a deep temporal difference network is proposed to minimize the makespan. Firstly, the FDSSP is defined as the mathematical model of the flexible job-shop scheduling problem joined to the assembly constraint level. It is translated into a Markov decision process that directly selects behavioral strategies according to historical machining state data. Secondly, the proposed ten generic state features are input into the deep neural network model to fit the state value function. Similarly, eight simple constructive heuristics are used as candidate actions for scheduling decisions. From the greedy mechanism, optimally combined actions of all machines are obtained for each decision step. Finally, a deep temporal difference reinforcement learning framework is established, and a large number of comparative experiments are designed to analyze the basic performance of this algorithm. The results showed that the proposed algorithm was better than most other methods, which contributed to solving the practical production problem of the manufacturing industry. [ABSTRACT FROM AUTHOR]

In the paper, the exponential synchronisation for delayed Clifford-valued coupled switched neural networks via static event-triggering rule is studied. Firstly, the drive-response systems for delayed Clifford-valued coupled neural network models are established. So as to avoid the non-commutativity issue of Clifford number multiplication, the original n-dimensional Clifford-valued models are decomposed into $ 2 ^mn $ 2 m n -dimensional real-valued models. On this basis, the error dynamics system is constructed, and then some new sufficient conditions are presented of the exponential synchronisation for the considered neural network models by using Lyapunov–Krasovskii (L-K) functional approach and the technique of linear matrix inequality. Finally, the effectiveness of the results are verified by numerical simulations. [ABSTRACT FROM AUTHOR]

In this paper, a lightweight deep neural network (DNN) for direction of arrival (DOA) estimation is proposed, of which the input vector is designed to remove data redundancy as well as remaining DOA information. By exploring the Vandermonde property of the steering vector of a uniform linear array (ULA), the size of the newly designed input vector is greatly reduced. Furthermore, the DOA estimation is designed as a regression problem instead of a classification problem; that is, the lightweight DNN designs the output vector as the estimated DOAs of sources, of which the size is much shorter than that of the spatial spectrum used as the output vector in the conventional DNN. The reductions in the sizes of input and output vectors lead to a reduction in the sizes of hidden layers, achieving lightweightness of the neural network. The analysis illustrates that when the number of sensors is 22, the number of parameters in the lightweight DNN is three orders of magnitude less than that in the conventional DNN. The simulation results demonstrate the lightweight DNN can provide high DOA estimation accuracy with the shortest testing time. It performs better than the conventional DNN. Furthermore, it is superior to traditional solutions such as the multiple signal classification (MUSIC) method and conventional beamforming (CBF) method in harsh conditions like low signal-to-noise ratios (SNRs), closely spaced sources, and few snapshots. [ABSTRACT FROM AUTHOR]

Stagnation at local optima represents a significant challenge in bio-inspired optimization algorithms, often leading to suboptimal solutions. This paper addresses this issue by proposing a hybrid model that combines the Orca predator algorithm with deep Q-learning. The Orca predator algorithm is an optimization technique that mimics the hunting behavior of orcas. It solves complex optimization problems by exploring and exploiting search spaces efficiently. Deep Q-learning is a reinforcement learning technique that combines Q-learning with deep neural networks. This integration aims to turn the stagnation problem into an opportunity for more focused and effective exploitation, enhancing the optimization technique's performance and accuracy. The proposed hybrid model leverages the biomimetic strengths of the Orca predator algorithm to identify promising regions nearby in the search space, complemented by the fine-tuning capabilities of deep Q-learning to navigate these areas precisely. The practical application of this approach is evaluated using the high-dimensional Heartbeat Categorization Dataset, focusing on the feature selection problem. This dataset, comprising complex electrocardiogram signals, provided a robust platform for testing the feature selection capabilities of our hybrid model. Our experimental results are encouraging, showcasing the hybrid strategy's capability to identify relevant features without significantly compromising the performance metrics of machine learning models. This analysis was performed by comparing the improved method of the Orca predator algorithm against its native version and a set of state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]

In this paper we present a method that allows leveraging 3D electron density information to train a deep neural network pipeline to segment regions of high, medium and low electronegativity and classify substances as health hazardous or non-hazardous. We show that this can be used for use-cases such as cosmetics and food products. For this purpose, we first generate 3D electron density cubes using semiempirical molecular calculations for a custom European Chemicals Agency (ECHA) subset consisting of substances labelled as hazardous and non-hazardous for cosmetic usage. Together with their 3-class electronegativity maps we train a modified 3D-UNet with electron density cubes to segment reactive sites in molecules and classify substances with an accuracy of 78.1%. We perform the same process on a custom food dataset (CompFood) consisting of hazardous and non-hazardous substances compiled from European Food Safety Authority (EFSA) OpenFoodTox, Food and Drug Administration (FDA) Generally Recognized as Safe (GRAS) and FooDB datasets to achieve a classification accuracy of 64.1%. Our results show that 3D electron densities and particularly masked electron densities, calculated by taking a product of original electron densities and regions of high and low electronegativity can be used to classify molecules for different use-cases and thus serve not only to guide safe-by-design product development but also aid in regulatory decisions. Scientific contribution: We aim to contribute to the diverse 3D molecular representations used for training machine learning algorithms by showing that a deep learning network can be trained on 3D electron density representation of molecules. This approach has previously not been used to train machine learning models and it allows utilization of the true spatial domain of the molecule for prediction of properties such as their suitability for usage in cosmetics and food products and in future, to other molecular properties. The data and code used for training is accessible at https://github.com/s-singh-ivv/eDen-Substances. [ABSTRACT FROM AUTHOR]

This paper proposes a methodology for the diagnosis of electrical system conditions using fractional-order integral transforms for feature extraction. This work proposes three feature extraction algorithms using the Fractional Fourier Transform (FRFT), the Fourier Transform combined with the Mittag-Leffler function, and the Wavelet Transform (WT). Each algorithm extracts data from an electrical system to obtain a set of features that are classified by an Artificial Neural Network to determine the system's condition. The algorithms are utilized in diagnosing two types of electrical machine faults, one in a photovoltaic system, and another in classifying the power quality disturbances (PQDs). An optimization algorithm is suggested to find the optimal orders of integral transforms. The obtained results demonstrate the system's effective diagnosis, displaying superior performance in classifying the faults and PQDs with complex signals. [ABSTRACT FROM AUTHOR]

Spiking neural networks (SNNs) are receiving increased attention because they mimic synaptic connections in biological systems and produce spike trains, which can be approximated by binary values for computational efficiency. Recently, the addition of convolutional layers to combine the feature extraction power of convolutional networks with the computational efficiency of SNNs has been introduced. This paper studies the feasibility of using a convolutional spiking neural network (CSNN) to detect anticipatory slow cortical potentials (SCPs) related to braking intention in human participants using an electroencephalogram (EEG). Data was collected during an experiment wherein participants operated a remote-controlled vehicle on a testbed designed to simulate an urban environment. Participants were alerted to an incoming braking event via an audio countdown to elicit anticipatory potentials that were measured using an EEG. The CSNN's performance was compared to a standard CNN, EEGNet and three graph neural networks via 10-fold cross-validation. The CSNN outperformed all the other neural networks, and had a predictive accuracy of 99.06% with a true positive rate of 98.50%, a true negative rate of 99.20% and an F1-score of 0.98. Performance of the CSNN was comparable to the CNN in an ablation study using a subset of EEG channels that localized SCPs. Classification performance of the CSNN degraded only slightly when the floating-point EEG data were converted into spike trains via delta modulation to mimic synaptic connections. [ABSTRACT FROM AUTHOR]

With the acceleration of urbanisation, urban areas are subject to the combined effects of the accumulation of various natural factors, such as changes in temperature leading to the thermal expansion or contraction of surface materials (rock, soil, etc.) and changes in precipitation and humidity leading to an increase in the self-weight of soil due to the infiltration of water along the cracks or pores in the ground. Therefore, the subsidence of urban areas has now become a serious geological disaster phenomenon. However, the use of traditional neural network prediction models has limitations when examining the causal relationships between time series surface deformation data and multiple influencing factors and when applying multiple influencing factors for predictive analyses. To this end, Sentinel-1A data from March 2017 to February 2023 were used as the data source in this paper, based on time series deformation data acquired using the small baseline subset interferometric synthetic aperture radar (SBAS-InSAR) technique. A sparrow search algorithm–convolutional neural network–long short-term memory (SSA-CNN-LSTM) neural network prediction model was built. The six factors of temperature, humidity, precipitation, and ground temperature at three different depths below the surface (5 cm, 10 cm, and 15 cm) were taken as the input of the model, and the surface deformation data were taken as the output of the neural network model. The correlation between the spatial and temporal evolution characteristics of the ground subsidence in urban areas and various influencing factors was analysed using grey correlation analysis, which proved that these six factors contribute to some extent to the deformation of the urban surface. The main urban area of Hohhot City, Inner Mongolia Autonomous Region, was used as the study area. In order to verify the efficacy of this neural network prediction model, the prediction effects of the multilayer perceptron (MLP), backpropagation (BP), and SSA-CNN-LSTM models were compared and analysed, with the values of the correlation coefficients of the feature points of A1, B1, and C1 being in the range of 0.92, 0.83, and 0.93, respectively. The results show that compared with the traditional MLP and BP neural network models, the SSA-CNN-LSTM model achieves a higher performance in predicting time series surface deformation data in urban areas, which provides new ideas and methods for this area of research. [ABSTRACT FROM AUTHOR]

This document provides summaries of various research papers published in the journal Sensors. The summaries cover a wide range of topics, including personalized medicine, laser ranging, memristive interfaces, face and person detection, IoT data visualization, monitoring elderly activities, auditory illusions, brain connectivity, corona discharges, thermal data analysis, vital signal detection, and eye-blink artifact removal. The document showcases the contributions and findings of each study, offering valuable insights for researchers and library patrons interested in these areas of study. [Extracted from the article]

This study aims to enhance diagnostic capabilities for optimising the performance of the anaerobic sewage treatment lagoon at Melbourne Water's Western Treatment Plant (WTP) through a novel machine learning (ML)-based monitoring strategy. This strategy employs ML to make accurate probabilistic predictions of biogas performance by leveraging diverse real-life operational and inspection sensor and other measurement data for asset management, decision making, and structural health monitoring (SHM). The paper commences with data analysis and preprocessing of complex irregular datasets to facilitate efficient learning in an artificial neural network. Subsequently, a Bayesian mixture density neural network model incorporating an attention-based mechanism in bidirectional long short-term memory (BiLSTM) was developed. This probabilistic approach uses a distribution output layer based on the Gaussian mixture model and Monte Carlo (MC) dropout technique in estimating data and model uncertainties, respectively. Furthermore, systematic hyperparameter optimisation revealed that the optimised model achieved a negative log-likelihood (NLL) of 0.074, significantly outperforming other configurations. It achieved an accuracy approximately 9 times greater than the average model performance (NLL = 0.753) and 22 times greater than the worst performing model (NLL = 1.677). Key factors influencing the model's accuracy, such as the input window size and the number of hidden units in the BiLSTM layer, were identified, while the number of neurons in the fully connected layer was found to have no significant impact on accuracy. Moreover, model calibration using the expected calibration error was performed to correct the model's predictive uncertainty. The findings suggest that the inherent data significantly contribute to the overall uncertainty of the model, highlighting the need for more high-quality data to enhance learning. This study lays the groundwork for applying ML in transforming high-value assets into intelligent structures and has broader implications for ML in asset management, SHM applications, and renewable energy sectors. [ABSTRACT FROM AUTHOR]

In cutting processes, tool condition affects the quality of the manufactured parts. As such, an essential component to prevent unplanned downtime and to assure machining quality is having information about the state of the cutting tool. The primary function of it is to alert the operator that the tool has reached or is reaching a level of wear beyond which behaviour is unreliable. In this paper, the tool condition is being monitored by analysing the electric current on the main spindle via an artificial intelligence model utilising an LSTM neural network. In the current study, the tool is monitored while working on a cylindrical raw piece made of AA6013 aluminium alloy with a custom polycrystalline diamond tool for the purposes of monitoring the wear of these tools. Spindle current characteristics were obtained using external measuring equipment to not influence the operation of the machine included in a larger production line. As a novel approach, an artificial intelligence model based on an LSTM neural network is utilised for the analysis of the spindle current obtained during a manufacturing cycle and assessing the tool wear range in real time. The neural network was designed and trained to notice significant characteristics of the captured current signal. The conducted research serves as a proof of concept for the use of an LSTM neural network-based model as a method of monitoring the condition of cutting tools. [ABSTRACT FROM AUTHOR]

The rapid development of deep neural networks has attracted significant attention in the infrared and visible image fusion field. However, most existing fusion models have many parameters and consume high computational and spatial resources. This paper proposes a fast and efficient recursive fusion neural network model to solve this complex problem that few people have touched. Specifically, we designed an attention module combining a traditional fusion knowledge prior with channel attention to extract modal-specific features efficiently. We used a shared attention layer to perform the early fusion of modal-shared features. Adopting parallel dilated convolution layers further reduces the network's parameter count. Our network is trained recursively, featuring minimal model parameters, and requires only a few training batches to achieve excellent fusion results. This significantly reduces the consumption of time, space, and computational resources during model training. We compared our method with nine SOTA methods on three public datasets, demonstrating our method's efficient training feature and good fusion results. [ABSTRACT FROM AUTHOR]

The maturity of fruits and vegetables such as tomatoes significantly impacts indicators of their quality, such as taste, nutritional value, and shelf life, making maturity determination vital in agricultural production and the food processing industry. Tomatoes mature from the inside out, leading to an uneven ripening process inside and outside, and these situations make it very challenging to judge their maturity with the help of a single modality. In this paper, we propose a deep learning-assisted multimodal data fusion technique combining color imaging, spectroscopy, and haptic sensing for the maturity assessment of tomatoes. The method uses feature fusion to integrate feature information from images, near-infrared spectra, and haptic modalities into a unified feature set and then classifies the maturity of tomatoes through deep learning. Each modality independently extracts features, capturing the tomatoes' exterior color from color images, internal and surface spectral features linked to chemical compositions in the visible and near-infrared spectra (350 nm to 1100 nm), and physical firmness using haptic sensing. By combining preprocessed and extracted features from multiple modalities, data fusion creates a comprehensive representation of information from all three modalities using an eigenvector in an eigenspace suitable for tomato maturity assessment. Then, a fully connected neural network is constructed to process these fused data. This neural network model achieves 99.4% accuracy in tomato maturity classification, surpassing single-modal methods (color imaging: 94.2%; spectroscopy: 87.8%; haptics: 87.2%). For internal and external maturity unevenness, the classification accuracy reaches 94.4%, demonstrating effective results. A comparative analysis of performance between multimodal fusion and single-modal methods validates the stability and applicability of the multimodal fusion technique. These findings demonstrate the key benefits of multimodal fusion in terms of improving the accuracy of tomato ripening classification and provide a strong theoretical and practical basis for applying multimodal fusion technology to classify the quality and maturity of other fruits and vegetables. Utilizing deep learning (a fully connected neural network) for processing multimodal data provides a new and efficient non-destructive approach for the massive classification of agricultural and food products. [ABSTRACT FROM AUTHOR]

The use of drones has recently gained popularity in a diverse range of applications, such as aerial photography, agriculture, search and rescue operations, the entertainment industry, and more. However, misuse of drone technology can potentially lead to military threats, terrorist acts, as well as privacy and safety breaches. This emphasizes the need for effective and fast remote detection of potentially threatening drones. In this study, we propose a novel approach for automatic drone detection utilizing the usage of both radio frequency communication signals and acoustic signals derived from UAV rotor sounds. In particular, we propose the use of classical and deep machine-learning techniques and the fusion of RF and acoustic features for efficient and accurate drone classification. Distinct types of ML-based classifiers have been examined, including CNN- and RNN-based networks and the classical SVM method. The proposed approach has been evaluated with both frequency and audio features using common drone datasets, demonstrating better accuracy than existing state-of-the-art methods, especially in low SNR scenarios. The results presented in this paper show a classification accuracy of approximately 91% at an SNR ratio of − 10 dB using the LSTM network and fused features. [ABSTRACT FROM AUTHOR]

This paper presents a naïve back propagation (NBP) based i cos ∅ technique implemented to a cascaded multilevel inverter (MLI) based shunt active power filter (SAPF). The recommended control algorithm is applied to extract the fundamental component of load current and to decide the compensating current reference for harmonic elimination. The performance of the SAPF using the proposed NBP-based i cos ∅ technique is compared with another two classical control techniques, such as, i d - i q technique and i cos ∅ technique. The accuracy of the proposed control technique depends on the tuned estimation of active and reactive weights. The performance study of the proposed SAPF with the proposed control technique is investigated under non-linear conditions, with balanced and unbalanced loading conditions. The results reveal that the recommended SAPF is efficient enough to reduce the harmonics from the source current with smooth variation in DC link voltage. The effectiveness of the proposed method is validated by simulation using MATLAB Simulink, and the real-time results are also validated by the experimental setup. [ABSTRACT FROM AUTHOR]

Based on the integrated model of Super-SBM model, spatial Durbin model (SDM) and Grey neural network model, this paper analyzes the panel data of various provinces in China from multiple angles and dimensions. It was found that there were significant differences in eco-efficiency between organic rice production and conventional rice production. The response of organic rice to climate change, the spatial distribution of ecological and economic benefits and the impact on carbon emission were analyzed. The results showed that organic rice planting not only had higher economic benefits, but also showed a rising trend of ecological benefits and a positive feedback effect. This finding highlights the importance of organic rice farming in reducing carbon emissions. Organic rice farming effectively reduces greenhouse gas emissions, especially carbon dioxide and methane, by improving soil management and reducing the use of fertilizers and pesticides. This has important implications for mitigating climate change and promoting soil health and biodiversity. With the acceleration of urbanization, the increase of organic rice planting area shows the trend of organic rice gradually replacing traditional rice cultivation, further highlighting the potential of organic agriculture in emission reduction, environmental protection and sustainable agricultural production. To this end, it is recommended that the Government implement a diversified support strategy to encourage technological innovation, provide guidance and training, and raise public awareness and demand for organic products. At the same time, private sector participation is stimulated to support the development of organic rice cultivation through a public-private partnership model. Through these measures, further promote organic rice cultivation, achieve the dual goals of economic benefits and environmental benefits, and effectively promote the realization of double carbon emission reduction targets. [ABSTRACT FROM AUTHOR]

For the past few years, sweat analysis for health monitoring has attracted increasing attention benefiting from wearable technology. In related research, the sensitive detection of uric acid (UA) in sweat with complex composition based on surface-enhanced Raman spectroscopy (SERS) for the diagnosis of gout is still a significant challenge. Herein, we report a visualized and intelligent wearable sweat platform for SERS detection of UA in sweat. In this wearable platform, the spiral channel consisted of colorimetric paper with Ag nanowires (AgNWs) that could capture sweat for SERS measurement. With the help of photos from a smartphone, the pH value and volume of sweat could be quantified intelligently based on the image recognition technique. To diagnose gout, SERS spectra of human sweat with UA are collected in this wearable intelligent platform and analyzed by artificial intelligence (AI) algorithms. The results indicate that the artificial neural network (ANN) algorithm exhibits good identification of gout with high accuracy at 97%. Our work demonstrates that SERS-AI in a wearable intelligent sweat platform could be a feasible strategy for diagnosis of gout, which expands research on sweat analysis for comfortable and noninvasive health monitoring. [ABSTRACT FROM AUTHOR]

Concrete-filled steel tube columns (CFSTCs) are important elements in the construction sector and predictive analysis of their behavior is essential. Recent works have revealed the potential of metaheuristic-assisted approximators for this purpose. The main idea of this paper, therefore, is to introduce a novel integrative model for appraising the axial compression capacity (Pu) of CFSTCs. The proposed model represents an artificial neural network (ANN) supervised by satin bowerbird optimizer (SBO). In other words, this metaheuristic algorithm trains the ANN optimally to find the best contribution of input parameters to the Pu. In this sense, column length and the compressive strength of concrete, as well as the characteristics of the steel tube (i.e., diameter, thickness, yield stress, and ultimate stress), are considered input data. The prediction results are compared to five ANNs supervised by backtracking search algorithm (BSA), earthworm optimization algorithm (EWA), social spider algorithm (SOSA), salp swarm algorithm (SSA), and wind-driven optimization. Evaluating various accuracy indicators showed that the proposed model surpassed all of them in both learning and reproducing the Pu pattern. The obtained values of mean absolute percentage error of the SBO-ANN was 2.3082% versus 4.3821%, 17.4724%, 15.7898%, 4.2317%, and 3.6884% for the BSA-ANN, EWA-ANN, SOSA-ANN, SSA-ANN and WDA-ANN, respectively. The higher accuracy of the SBO-ANN against several hybrid models from earlier literature was also deduced. Moreover, the outcomes of principal component analysis on the dataset showed that the yield stress, diameter, and ultimate stress of the steel tube are the three most important factors in Pu prediction. A predictive formula is finally derived from the optimized SBO-ANN by extracting and organizing the weights and biases of the ANN. Owing to the accurate estimation shown by this model, the derived formula can reliably predict the Pu of concrete-filled steel tube columns. [ABSTRACT FROM AUTHOR]

The low-bit quantization can effectively reduce the deep neural network storage as well as the computation costs. Existing quantization methods have yielded unsatisfactory results when being applied to lightweight networks. Additionally, following network quantization, the differences in data types between the operators can cause issues when deploying networks on Field Programmable Gate Arrays (FPGAs). Moreover, some operators cannot be accelerated heterogeneously on FPGAs, resulting in frequent switching between the Advanced RISC Machine (ARM) and FPGA environments for computation tasks. To address these problems, this paper proposes a custom network quantization approach. Firstly, an improved PArameterized Clipping Activation (PACT) method is employed during the quantization aware training to restrict the value range of neural network parameters and reduce the loss of precision arising from quantization. Secondly, the Consecutive Execution Of Convolution Operators (CEOCO) strategy is utilized to mitigate the resource consumption caused by the frequent environment switching. The proposed approach is validated on Xilinx Zynq Ultrascale+MPSoC 3EG and Virtex UltraScale+XCVU13P platforms. The MobileNetv1, MobileNetv3, PPLCNet, and PPLCNetv2 networks were utilized as testbeds for the validation. Moreover, experimental results are on the miniImageNet, CIFAR-10, and OxFord 102 Flowers public datasets. In comparison to the original model, the proposed optimization methods result in an average decrease of 1.2% in accuracy. Compared to conventional quantization method, the accuracy remains almost unchanged, while the frames per second (FPS) on FPGAs improves by an average of 2.1 times. [ABSTRACT FROM AUTHOR]

Medical image fusion aims to fuse multiple images from a single or multiple imaging modes to enhance their corresponding clinical applications in diagnosing and evaluating medical problems, a trend that has attracted increasing attention. However, most recent medical image fusion methods require prior knowledge, making it difficult to select image features. In this paper, we propose a novel deep medical image fusion method based on a deep convolutional neural network (DCNN) for directly learning image features from original images. Specifically, source images are first decomposed by low rank representation to obtain the principal and salient components, respectively. Following that, the deep features are extracted from the decomposed principal components via DCNN and fused by a weighted-average rule. Then, considering the complementary between the salient components obtained by the low rank representation, a simple yet effective sum rule is designed to fuse the salient components. Finally, the fused result is obtained by reconstructing the principal and salient components. The experimental results demonstrate that the proposed method outperforms several state-of-the-art medical image fusion approaches in terms of both objective indices and visual quality. [ABSTRACT FROM AUTHOR]

This paper delves into the specialized domain of human action recognition, focusing on the Identification of Indian classical dance poses, specifically Bharatanatyam. Within the dance context, a "Karana" embodies a synchronized and harmonious movement encompassing body, hands, and feet, as defined by the Natyashastra. The essence of Karana lies in the amalgamation of nritta hasta (hand movements), sthaana (body postures), and chaari (leg movements). Although numerous, Natyashastra codifies 108 karanas, showcased in the intricate stone carvings adorning the Nataraj temples of Chidambaram, where Lord Shiva's association with these movements is depicted. Automating pose identification in Bharatanatyam poses challenges due to the vast array of variations, encompassing hand and body postures, mudras (hand gestures), facial expressions, and head gestures. To simplify this intricate task, this research employs image processing and automation techniques. The proposed methodology comprises four stages: acquisition and pre-processing of images involving skeletonization and Data Augmentation techniques, feature extraction from images, classification of dance poses using a deep learning network-based convolution neural network model (InceptionResNetV2), and visualization of 3D models through mesh creation from point clouds. The use of advanced technologies, such as the MediaPipe library for body key point detection and deep learning networks, streamlines the identification process. Data augmentation, a pivotal step, expands small datasets, enhancing the model's accuracy. The convolution neural network model showcased its effectiveness in accurately recognizing intricate dance movements, paving the way for streamlined analysis and interpretation. This innovative approach not only simplifies the identification of Bharatanatyam poses but also sets a precedent for enhancing accessibility and efficiency for practitioners and researchers in the Indian classical dance. [ABSTRACT FROM AUTHOR]

Computed tomography perfusion (CTP) is a dynamic 4-dimensional imaging technique (3-dimensional volumes captured over approximately 1 min) in which cerebral blood flow is quantified by tracking the passage of a bolus of intravenous contrast with serial imaging of the brain. To diagnose and assess acute ischemic stroke, the standard method relies on summarizing acquired CTPs over the time axis to create maps that show different hemodynamic parameters, such as the timing of the bolus arrival and passage (Tmax and MTT), cerebral blood flow (CBF), and cerebral blood volume (CBV). However, producing accurate CTP maps requires the selection of an arterial input function (AIF), i.e. a time-concentration curve in one of the large feeding arteries of the brain, which is a highly error-prone procedure. Moreover, during approximately one minute of CT scanning, the brain is exposed to ionizing radiation that can alter tissue composition, and create free radicals that increase the risk of cancer. This paper proposes a novel end-to-end deep neural network that synthesizes CTP images to generate CTP maps using a learned LSTM Generative Adversarial Network (LSTM-GAN). Our proposed method can improve the precision and generalizability of CTP map extraction by eliminating the error-prone and expert-dependent AIF selection step. Further, our LSTM-GAN does not require the entire CTP time series and can produce CTP maps with a reduced number of time points. By reducing the scanning sequence from about 40 to 9 time points, the proposed method has the potential to minimize scanning time thereby reducing patient exposure to CT radiation. Our evaluations using the ISLES 2018 challenge dataset consisting of 63 patients showed that our model can generate CTP maps by using only 9 snapshots, without AIF selection, with an accuracy of 84.37 % . [ABSTRACT FROM AUTHOR]

The paper examines the implementation of neural network methods for predicting peak water levels during the period of spring ice drift by the example of the Sukhona, Northern Dvina, and Pechora rivers. All considered neural network methods have shown high efficiency according to the criteria recommended by the Hydrometcenter of Russia and surpassed regression dependencies in the skill of forecasts. When using the method of training artificial neural networks, the standard error of prediction is reduced by approximately 10–20% as compared with regression dependencies. [ABSTRACT FROM AUTHOR]

Due to high spatial and temporal resolution, geostationary meteorological satellite imagery is a valuable source of information on the development of deep convective clouds and related severe weather events. Some methods for automatic deep convection detection from satellite data provide a satisfactory probability of detection for independent datasets, but are characterized by a high false alarm rate. The paper gives a description of an algorithm for automatic detection of deep convective clouds with satellite imagery using gradient boosting, logistic regression, and artificial neural network models. The results of validation of the proposed method using dependent and independent data of ground-based observations for the period 2013–2020 are presented. A low false alarm rate and high probability of detection suggest that the algorithm can be used in the operational mode. [ABSTRACT FROM AUTHOR]

To achieve successful prevention of fire incidents originating from human activities, it is imperative to possess a thorough understanding. This paper introduces a machine learning approach, specifically utilizing deep neural networks (DNN), to develop predictive models for fire occurrence in Keelung City, Taiwan. It investigates ten factors across demographic, architectural, and economic domains through spatial analysis and thematic maps generated from geographic information system data. These factors are then integrated as inputs for the DNN model. Through 50 iterations, performance indices including the coefficient of determination (R2), root mean square error (RMSE), variance accounted for (VAF), prediction interval (PI), mean absolute error (MAE), weighted index (WI), weighted mean absolute percentage error (WMAPE), Nash–Sutcliffe efficiency (NS), and the ratio of performance to deviation (RPD) are computed, with average values of 0.89, 7.30 × 10−2, 89.21, 1.63, 4.90 × 10−2, 0.97, 2.92 × 10−1, 0.88, and 4.84, respectively. The model's predictions, compared with historical data, demonstrate its efficacy. Additionally, this study explores the impact of various urban renewal strategies using the DNN model, highlighting the significant influence of economic factors on fire incidence. This underscores the importance of economic factors in mitigating fire incidents and emphasizes their consideration in urban renewal planning. [ABSTRACT FROM AUTHOR]

Due to the fact that a memristor with memory properties is an ideal electronic component for implementation of the artificial neural synaptic function, a brand-new tristable locally active memristor model is first proposed in this paper. Here, a novel four-dimensional fractional-order memristive cellular neural network (FO-MCNN) model with hidden attractors is constructed to enhance the engineering feasibility of the original CNN model and its performance. Then, its hardware circuit implementation and complicated dynamic properties are investigated on multi-simulation platforms. Subsequently, it is used toward secure communication application scenarios. Taking it as the pseudo-random number generator (PRNG), a new privacy image security scheme is designed based on the adaptive sampling rate compressive sensing (ASR-CS) model. Eventually, the simulation analysis and comparative experiments manifest that the proposed data encryption scheme possesses strong immunity against various security attack models and satisfactory compression performance. [ABSTRACT FROM AUTHOR]

Data-driven approaches have made preliminary inroads into the area of transition–turbulence modeling, but are still in their infancy with regard to widespread industrial adoption. This paper establishes an artificial neural network (ANN)-based transition model to enhance the capacity of capturing the crossflow (CF) transition phenomena, which are frequently identified over a wide range of aerodynamic problems. By taking a new CF-extended shear stress transport (SST) transition-predictive (SST-γ) model as the baseline, a mapping from mean flow variables to transition intermittency factor (γ) is constructed by ANN algorithm at various Mach and Reynolds numbers of an infinite swept wing. Generalizability of the resulting ANN-based (SST- γ ANN ) model is fully validated in the same infinite swept wing, an inclined 6:1 prolate spheroid, and a finite swept wing in extensive experiment regimes, together with two effective a priori analysis strategies. Furthermore, the calculation efficiency, grid dependence, and performance of the present model in non-typical transitional flow are also assessed to inspect its industrial feasibility, followed by the elucidation of rationality behind the preliminary success and transferability of present framework. The results manifest that the SST- γ ANN model aligns well with the benchmark SST-γ model, and both can capture the CF transition accurately compared with their experiment counterpart, completely breaking through the disability of original SST-γ model without CF correction. In addition, good properties of efficiency, robustness, and generalizability are achieved for the ANN-alternative transition model, together with the usability of present framework across various transitional flows. [ABSTRACT FROM AUTHOR]

The rapid development of deep learning has significant implications for the advancement of computational fluid dynamics. Currently, most pixel-grid-based deep learning methods for flow field prediction exhibit significantly reduced accuracy in predicting boundary layer flows and poor adaptability to geometric shapes. Although graph neural network models for unstructured grid-based unsteady flow prediction have better geometric adaptability, these models suffer from error accumulation in long-term predictions of unsteady flows. More importantly, fully data-driven models often require extensive training time, greatly limiting the rapid update and iteration speed of deep learning models when facing more complex unsteady flows. Therefore, this paper aims to balance the demands for training overhead and prediction accuracy by integrating physical constraints based on the finite volume method into the loss function of the graph neural network. Additionally, it incorporates a twice-message aggregation mechanism inspired by the extended stencil method to enhance the unsteady flow prediction accuracy and geometric shape generalization ability of the graph neural network model on unstructured grids. We focus particularly on the model's predictive accuracy within the boundary layer. Compared to fully data-driven methods, our model achieves better predictive accuracy and geometric shape generalization ability in a shorter training time. [ABSTRACT FROM AUTHOR]

The reliability of thimble tubes plays a critical role for maintaining the safety of a nuclear power plant. The defect depth needs to be quantified and predicted to support the operational decision-making. This paper presents a method to quantify the defects on thimble tube wall based on the analyzation of eddy current testing (ECT) data. Then, a method using artificial neural network (ANN) to predict the detect depth is studied. The tubes are divided into 2 shapes and four regions according to their positions and the data of each region and each shape is expanded by mean interpolation. A prediction model based on ANN is constructed for each shape in each region. The experimental results show that the model can predict the signal of the next year according to the signal of the previous three years with mean absolute percentage error less than 16%. [ABSTRACT FROM AUTHOR]

The 3D point cloud deep neural network (3D DNN) has achieved remarkable success, but its black-box nature hinders its application in many safety-critical domains. The saliency map technique is a key method to look inside the black-box and determine where a 3D DNN focuses when recognizing a point cloud. Existing point-wise point cloud saliency methods are proposed to illustrate the point-wise saliency for a given 3D DNN. However, the above critical points are alternative and unreliable. The findings are grounded on our experimental results which show that a point becomes critical because it is responsible for representing one specific local structure. However, one local structure does not have to be represented by some specific points, conversely. As a result, discussing the saliency of the local structure (named patch-wise saliency) represented by critical points is more meaningful than discussing the saliency of some specific points. Based on the above motivations, this paper designs a black-box algorithm to generate patch-wise saliency map for point clouds. Our basic idea is to design the Mask Building-Dropping process, which adaptively matches the size of important/unimportant patches by clustering points with close saliency. Experimental results on several typical 3D DNNs show that our patch-wise saliency algorithm can provide better visual guidance, and can detect where a 3D DNN is focusing more efficiently than a point-wise saliency map. Finally, we apply our patch-wise saliency map to adversarial attacks and backdoor defenses. The results show that the improvement is significant. [ABSTRACT FROM AUTHOR]

Many test coverage metrics have been proposed to measure the deep neural network (DNN) testing effectiveness, including structural coverage and nonstructural coverage. These test coverage metrics are proposed based on the fundamental assumption: They are correlated with test effectiveness. However, the fundamental assumption is still not validated sufficiently and reasonably, which brings question on the usefulness of DNN test coverage. This paper conducted a revisiting study on the existing DNN test coverage from the test effectiveness perspective, to effectively validate the fundamental assumption. Here, we carefully considered the diversity of subjects, three test effectiveness criteria, and both typical and state‐of‐the‐art test coverage metrics. Different from all the existing studies that deliver negative conclusions on the usefulness of existing DNN test coverage, we identified some positive conclusions on their usefulness from the test effectiveness perspective. In particular, we found the complementary relationship between structural and nonstructural coverage and identified the practical usage scenarios and promising research directions for these existing test coverage metrics. [ABSTRACT FROM AUTHOR]

The safety and robustness of deep neural networks (DNNs) are currently of great concern. Adequate testing is commonly an effective technique to ensure the software's trustworthiness. However, existing DNN testing methods generate many invalid test inputs, which inevitably brings increased computational overhead and reduces the efficiency of DNN testing. In this paper, we focus on testing task‐specific DNN and investigating diverse, valid and natural test input generation based on data augmentation techniques. Specifically, we propose AugTest, a DNN testing method based on stochastic optimization with momentum, searching for optimal compositions of data augmentation parameters to efficiently generate diverse and valid test inputs. Experimental results show that our proposed method can effectively explore the data manifold space and find valid test inputs with high diversity and naturalness. Compared with the best‐performing baseline, AugTest can generate more test inputs with more average diversity and less average time. Furthermore, the generated test inputs have competitive generalizability to DNNs with different structures. The test error rates exceed 70% when testing other DNN models performing similar tasks using the test inputs generated by AugTest. This implies that our method can produce more valid and generalized data to unveil DNNs' errors. [ABSTRACT FROM AUTHOR]

In this paper, we propose SGEM, stochastic gradient with energy and momentum, to solve a class of general non-convex stochastic optimization problems, based on the AEGD method introduced in AEGD (adaptive gradient descent with energy) Liu and Tian (Numerical Algebra, Control and Optimization, 2023). SGEM incorporates both energy and momentum so as to inherit their dual advantages. We show that SGEM features an unconditional energy stability property and provide a positive lower threshold for the energy variable. We further derive energy-dependent convergence rates in the general non-convex stochastic setting, as well as a regret bound in the online convex setting. Our experimental results show that SGEM converges faster than AEGD and generalizes better or at least as well as SGDM in training some deep neural networks. [ABSTRACT FROM AUTHOR]

Despite significant progress has been made towards crop yield prediction with remote sensing, there exist knowledge gaps on (1) the impacts of temporal resolution of imaging frequencies on yield prediction, (2) transferability of the models among different genotypes and test sites, and (3) translation of these research developments to crop breeding that benefit farmers. Existing research predominantly provides an on-site perspective, frequently missing the complexities of real-world applications. The objectives of this paper are to investigate the transferability and generalization capabilities of yield prediction models for crop breeding across test sites located in North and South Americas. Toward that goal, we tested different machine learning techniques including Random Forest Regressor (RF), Gradient Boosting Regression (GB), and Deep Neural Networks (DNN) for soybean yield prediction with experiments conducted in different climate and growth conditions. A novel transfer learning approach was proposed for genotype selection and categorizing soybean yield for screening high-yield varieties. Furthermore, we studied the effect of temporal resolution on yield prediction, focusing on the critical development stages and optimal aerial survey frequencies for precise yield prediction using large 31,404 sample data. Results demonstrated that the combined dataset of Argentina and United States representing different climate regimes provided the highest performance with an R2 of 0.76 using RF and GB algorithms. The classification approach was proven to be most useful for crop breeding as demonstrated by accurately identifying the high-yielding genotypes. Increasing temporal sampling of key phenological stages significantly improved yield prediction. Although transfer learning yielded promising outcomes across trials within Argentina the efficacy of transferring models from Argentina to the United States was limited, attributed to significant seasonal and climate variations. This study pioneered the use of transfer learning for model adaptability in real-world breeding scenarios, training and transferring models within the South and North Americas, providing actionable insights and strategies for the breeding community, aiming to facilitate improved decision-making for agricultural productivity. [ABSTRACT FROM AUTHOR]

Airwakes are shed behind a ship's superstructure, and they represent a highly turbulent and rapidly distorting flow field. Because of this complexity, they require a baseline: A database of flow velocity points, preferably through experiments and also through high-fidelity computational fluid dynamics simulations. However the database is prohibitively costly, and in situ measurements, at a constant wind angle, are often affected by the weather. A previously developed perturbation scheme helps to generate the autospectrum in closed form from a given wind database, specifically, from the numerically extracted autospectrum for this database. The primary objective of this paper is to demonstrate how deep neural networks can be fruitfully exploited to reduce the dependence on a database of flow velocity points in generating the autospectra, by reducing the amount of in situ data required to achieve the same accuracy as established methods. Two machine learning approaches are developed to predict the autospectrum for a data set when provided with a subset of the wind data set at the input and are assessed using cross-validation. In the first, a neural network is applied to predict the perturbation scheme. Though this method did not predict the autospectrum better than the previously developed perturbation scheme, it laid the foundation for the second method. In the second, a neural network is applied to the autospectra which can be numerically extracted from a database. An improvement is found in the average error computed over all data sets for the model-predicted autospectrum compared to the average error in the autospectrum predicted using the conventional method. The model provided better results for 51.4% of the data sets compared to the conventional method, with many data sets showing marked improvement. The database measured from the Naval Academy YP676 training vessel is used for training and testing the neural network. [ABSTRACT FROM AUTHOR]

Integrated circuit (IC) testing presents complex problems that for large circuits are exceptionally difficult to solve by traditional computing techniques. To deal with unmanageable time complexity, engineers often rely on human "hunches" and "heuristics" learned through experience. Training computers to adopt these human skills is referred to as machine intelligence (MI) or machine learning (ML). This survey examines applications of such methods to test analog, radio frequency (RF), digital, and memory circuits. It also summarizes ML applications to hardware security and emerging technologies, highlighting challenges and potential research directions. The present work is an extension of a recent paper from IEEE VLSI Test Symposium (VTS'21), and includes recent applications of artificial neural network (ANN) and principal component analysis (PCA) to automatic test pattern generation (ATPG). [ABSTRACT FROM AUTHOR]

One of the predominant health issues affecting Saudi Arabia and leading to many complications is Type 2 diabetes (T2D). Early detection and significant preventative measures lead to curbing and controlling the health issue. There are fewer datasets in the literature for the detection of T2D in the Saudi population. Past studies using Saudi data have favoured machine learning algorithms to classify T2D. Although the application of this data in machine learning is evident, no studies exist in the literature that compare this data, especially those related to deep learning algorithms. This study's objective is to use specific Saudi data to develop multiple deep learning models that could be used to detect T2D. The research uses a Deep Neural Network (DNN), an Autoencoder (AE), and a Convolutional Neural Network (CNN) to create predictive models and compare their performance with a traditional machine learning classifier used on the same dataset that outperformed other machine learning algorithms such as a Decision Forest (DF). Various metrics were used to evaluate the effectiveness of the models, such as accuracy, precision, recall, F1 score and area under the ROC curve (AUC) where the ROC acts as a receiver operating characteristic curve. There are two cases in this paper: (i) uses all features of the dataset and (ii) uses six of the ten features, such as DF. In case (i), the results were shown that AE outperformed other models with the highest accuracy for imbalanced and balanced data 81.12% and 79.16%, respectively. The results for case (ii) showed that AE scored the highest 81.01% accuracy with imbalanced data compared to DF and DF achieved the highest accuracy of 82.1% with balanced data. As a result, both cases explored in this study revealed that AE has a constant superior performance if imbalanced data is used. In contrast, DF demonstrated the highest accuracy when a balanced dataset was used with a feature set reduction. They help to identify the undiagnosed T2D, and they are essential for professionals in Saudi Arabia in the health sector to promote health connections, identify risks and contain or improve their diabetes management. [ABSTRACT FROM AUTHOR]

Neuroimaging technology is considered a non-invasive method research the structure and function of the brain which have been widely used in neuroscience, psychiatry, psychology, and other fields. The development of Deep Learning Neural Network (DLNN), based on the deep learning algorithms of neural imaging techniques in brain disease diagnosis plays a more and more important role. In this paper, a deep neural network imaging technology based on Stack Auto-Encoder (SAE) feature extraction is constructed, and then Support Vector Machine (SVM) was used to solve binary classification problems (Alzheimer's disease [AD] and Mild Cognitive Impairment [MCI]). Four sets of experimental data were employed to perform the training and testing stages of DLNN. The number of neurons in each of the DLNNs was determined using the grid search technique. Overall, the results of DLNNs performance indicated that the SAE feature extraction was superior over (Accuracy Rate [AR] = 74.9% with structure of 93-171-49-22-93) shallow layer features extraction (AR = 70.8% with structure of 93-22-93) and primary features extraction (AR = 69.2%). [ABSTRACT FROM AUTHOR]