Search

• Enhanced cellulo-xylanolytic consortium production from Hypocrea lixii GGRK4 using MOGA-ANN is reported. • The production of CMCase (9.43 fold) and xylanase (4.40 fold) higher than un-optimized process. • The improved deinking efficiency and brightness is reported for photocopier paper and newspaper. • The physical strength of the waste papers were enhanced whereas double fold property was decreased proving its reusability. • A significant fungal enzyme consortium preparation for improved waste paper deinking achieved. This study reports the cellulo-xylanolytic cocktail production from Hypocrea lixii GGRK4 using multi-objective genetic algorithm-artificial neural network tool, resulting in 8.32 ± 1.07 IU/mL, 51.53 ± 3.78 IU/mL activity of CMCase and xylanase, respectively with more than 85 % residual activity at 60 °C and pH 6.0. Interestingly, metal ions viz. K+ and Ca2+ stimulated the enzyme activity, whereas Fe2+ and Cu2+ reduced the activity. Significant amounts of hydrophobic compounds, chromophores, and phenolics were released after wastepapers deinking. The deinking efficiency of 73.60 ± 2.45 % and 38.60 ± 1.34 % was obtained for photocopier paper and newspaper, respectively, whereas brightness of 89.90 ± 2.10 % ISO and 44.90 ± 1.63 % ISO was reported for both types of waste papers. The physical strength of deinked photocopier paper and newspapers, i.e., tensile index (3.10 and 0.50 %), tearing index (7.10 and 4.83 %), and burst factor (8.61) were enhanced whereas double fold property was decreased proving wastepaper reusability. This consortium showed effective and significant enzymatic deinking efficiency for recycled wastepapers. [ABSTRACT FROM AUTHOR]

An instrument-free, user-friendly, and cost-effective PAD colorimetric sensor that can quantitative detection of H 2 O 2 has been realized by using bimetallic nickel–cobalt selenides as highly active peroxidase mimic and smartphone integrated with dark cavity as detector. Integrated with an ANN model and a self-compiled easy-to-use smartphone APP, the intelligent and on-site detection of H 2 O 2 was constructed, which exhibited an ultra-wide dynamic range. [Display omitted] • An effective paper-based colorimetric sensor was prepared based on nanozyme. • The optimized Ni 0.75 Co 0.25 Se exhibited excellent peoxidase-mimetic activities. • The on-site detection of H 2 O 2 was constructed by a self-compiled smartphone APP. • The machine learning-assisted sensor can detect H 2 O 2 over a wide dynamic range. Paper-based analytical devices (PADs) integrated with smartphones have shown great potential in various fields, but they also face challenges such as single signal reading, complex data processing and significant environmental impacting. In this study, a colorimetric PAD platform has been proposed using bimetallic nickel–cobalt selenides as highly active peroxidase mimic, smartphone with 3D-printing dark-cavity as a portable detector and an artificial neural network (ANN) model as multi-signal processing tool. Notably, the optimized nickel–cobalt selenides (Ni 0.75 Co 0.25 Se with Ni to Co ratio of 3/1) exhibit excellent peoxidase-mimetic activities and are capable of catalyzing the oxidation of four chromogenic reagents in the presence of H 2 O 2. Using a smartphone with image capture function as a friendly signal readout tool, the Ni 0.75 Co 0.25 Se based four channel colorimetric sensing paper is used for multi-signal quantitative analysis of H 2 O 2 by determining the Grey, red (R), green (G) and blue (B) channel values of the captured pictures. An intelligent on-site detection method for H 2 O 2 has been constructed by combining an ANN model and a self-programmed easy-to-use smartphone APP with a dynamic range of 5 μM to 2 M. Noteworthy, machine learning-assisted smartphone sensing devices based on nanozyme and 3D printing technology provide new insights and universal strategies for visual ultrasensitive detection in a variety of fields, including environments monitoring, biomedical diagnosis and safety screening. [ABSTRACT FROM AUTHOR]

• Five Machine Learning (ML) models compared for wave height time series prediction. • Complex ML models do not outperform simple AR in wave height time series prediction. • Comment to related papers: signal decomposition in test set series is WRONG. Significant Wave Height (SWH) is crucial in many aspect of ocean engineering. The accurate prediction of SWH has therefore been of immense practical value. Recently, Artificial Intelligence (AI) time series prediction methods have been widely used for single-point short-term SWH time-series forecasting, resulting in many AI-based models claiming to achieve good results. However, the extent to which these complex AI models can outperform traditional methods has largely been overlooked. This study compared five different models - AutoRegressive (AR), eXtreme Gradient Boosting (XGB), Artificial Neural Network (ANN), Long Short-Term Memory (LSTM), and WaveNet - for their performance on SWH time series prediction at 16 buoy locations. Surprisingly, the results suggest that the differences of performance among different models are negligible, indicating that all these AI models have only "learned" the linear auto-regression from the data. Additionally, we noticed that many recent studies used signal decomposition method for such time series prediction, and most of them decomposed the test sets, which is WRONG. [ABSTRACT FROM AUTHOR]

• The indicators were collected based on three levels of situation awareness (SA). • The drivers' SA assessment system was built using grey correlation analysis. • The constructed backpropagation neural network model can effectively predict SA. Based on combining the relevant studies on situation awareness (SA), this paper integrated multiple indicators, including eye movement, electroencephalogram (EEG), and driving behavior, to evaluate SA. SA is typically divided into three stages: perception, understanding and prediction. This paper used eye movement indicators to represent perception, EEG indicators to represent understanding, and driving behavior indicators to represent prediction. After identifying indicators for evaluating SA, a driving simulation experiment was designed to collect data on the indicators. 41 subjects were recruited to participate in the investigation, and the experimenter collected data from each subject in a total of 9 groups. After removing 4 groups of invalid data, 365 groups of valid data were finally obtained. The grey correlation analysis was used to optimize the SA indicators, and 10 SA evaluation indicators were finally determined. There were the average fixation duration, the nearest neighbor index, pupil area, the percentage power spectral density values of the 3 rhythmic waves (θ, α, β), rhythmic wave energy combination parameters (α / θ), mean speed, SD of speed and acceleration. Taking the optimized 10 indicators as input and the SA scores as output, a backpropagation neural network model with a topological structure of 10-8-1 was constructed. 75% of the data were randomly selected for model training, and the final network training's mean square error was 0.0025. Using the remaining 25% of data for verification, the average absolute error and average relative error of the predicted results are 0.248 and 0.046, respectively. This showed that the model was effective, and it was feasible to evaluate the SA by using the data of eye movement, EEG and driving behavior parameters. [ABSTRACT FROM AUTHOR]

[Display omitted] • Large datasets of U and UP are constructed with 1526 and 743 fuel samples. • The effect of C, H, and O atomic ratios on HHV is investigated by ternary plots. • HHV of any type of waste and fuel is estimated by artificial neural networks. • Hyperparameter optimization is carried out to obtain best performing ANN models. • Ultimate analysis data is observed to be sufficient for HHV estimation of fuels. Higher heating value (HHV) is one of the most important parameters in determining the quality of the fuels. In this study, comparatively large datasets of ultimate and proximate analysis are constructed to be used in HHV estimation of several classes of fuels, including char & fossil fuels, agricultural wastes, manure (chicken, cow, horse, sheep, llama, and pig), sludge (like paper, paper-mil, sewage, and pulp), micro/macro-algae's, wastes (RDF and MSW), treated woods, untreated woods, and others (non-fossil pyrolysis oils) between the HHV range of 4.22–55.55 MJ/kg. The relationships of carbon, hydrogen, and oxygen atomic ratios for fuel classes are illustrated by using ternary plots, and the effects of elemental composition on HHV was analyzed with the extensive dataset. Then, the ultimate (U) and ultimate & proximate (UP) datasets were utilized separately to estimate the HHV by using artificial neural networks (ANN). Hyperparameter optimization was carried out and the best performing ANNs were determined for each dataset, which yielded R2 values of 0.9719 and 0.9715, respectively. The results indicated that while ANNs trained by both datasets perform remarkably well, utilization of U dataset is sufficient for HHV estimation. Finally, the best performing ANN models for both U and UP datasets are given in a directly utilizable format enabling the accurate estimation of HHV of any fuel for optimization of fuel processing and waste management operations. [ABSTRACT FROM AUTHOR]

Sintering performance index can reflect the quality of sintered ore, and the level of sintered ore performance directly affects the stability of blast furnace production. Accurate prediction of sinter performance metrics is essential to optimise sinter quality, improve production efficiency and reduce energy consumption. Based on the sintering big data, this paper proposes the Optuna-DFNN model by combining the fuzzy neural network algorithm, the deep neural network algorithm and the Optuna framework to address the problems of difficulty in tuning the parameter, lack of self-learning ability, and poor generalisation of the model of the traditional method when faced with the input of multiple parameters. The paper predicts the four prediction indexes of yield rate, return fines ratio, drum index and RDI +3.15 respectively. Among them, the relative error of the prediction of the yield rate is within 1.3 %, the relative error of the prediction of the return fines ratio is within 2.8 %, the relative error of the prediction of the drum index is within 0.32 %, and the relative error of the prediction of the RDI +3.15 is within 1.4 %. The results indicate that the Optuna-DFNN model has better performance in predicting sintering performance metrics. Based on the Optuna-DFNN sintered ore performance prediction model, the quality of sintered ore can be accurately predicted, the sintering process parameters can be adjusted in a timely manner, the sintering process can be optimized, and the utilization coefficient of sintering can be improved. Provide a reference for the optimisation of production processes, with a positive impact on cost reduction, environmental protection and increased sustainability of production. [ABSTRACT FROM AUTHOR]

• A model to explore the multiphysics characteristic of semiconductors is presented. • The model determines the thermal and mechanical properties of complex patterns. • Results show a strong correlation between thermal and mechanical properties. • Dielectric bands asymmetrically affect thermal and mechanical behavior. • Machine learning can predict one property from another. As semiconductor performance improves through advanced package designs, it becomes important to consider both thermal and mechanical properties. Better understanding their relationship enhances system design and optimization. This study has introduced a numerical method that takes into account both thermal and mechanical fluxes to construct thermal and mechanical property maps for practical application in semiconductor engineering. Furthermore, this paper investigated the relationship between the two properties using the constructed property maps in commercially available semiconductor packages. Owing to the complexity of packaging design patterns, a coupled isoparametric mapping and machine learning (ML) method was introduced to investigate their effects. The model then determines and investigates the anisotropic equivalent thermal and mechanical properties of the commercialized semiconductor packages with complex pattern designs, according to the package materials, volume fractions of each material, and design patterns. This approach pursues more sophistication and practicality compared to simplified composite structure property evaluation models. Additionally, all processes in the algorithm are automated based on ML methods, making them practically applicable in the semiconductor industry. The study shows that there is a strong correlation between the thermal and mechanical characteristics in the complex package patterns. This relationship was able to form a fairly clear category based on the shape of the dielectric band because the dielectric band had significantly different effects on the thermal and mechanical fluxes. The study discussed the physical implications of the similarities and differences between the two behaviors and validated the results of the equivalent properties through finite element (FE) analysis. Finally, the study cross-validates the relationship by showing that information from one flux behavior can be used to predict the other based on the ML method. Based on the results, this paper can provide a better understanding of thermal and mechanical fluxes in semiconductor package patterns for package design and optimization. [ABSTRACT FROM AUTHOR]

In order to accurately estimate the period of X-ray pulsars to improve navigation performance, this paper proposes a pulsar period estimation method based on photon energy using reverse Hilbert coding and double Convolutional Neural Networks (CNNs) discrimination. This method uses photon energy information to perform epoch folding. It converts one-dimensional contour information into two-dimensional image signals through reverse Hilbert curve and recognizes contour image features through CNN models to determine the optimal period. According to the simulation results, the period estimation accuracy of this method is 0.5350 ns, which is 65.71% higher than the χ 2 epoch folding method. The contour phase accuracy is 0.0004767, which is 41.93% higher than the χ 2 epoch folding method. At the same time, the observation time and noise interference that may affect the accuracy of period estimation are also quantitatively analyzed. In addition, in order to simulate real navigation scenarios, this paper also conducts dynamic period estimation experiments on PSR B0531+21 pulsar in a specific period of time. The method proposed in this paper has the advantages of high precision, fast calculation speed, strong anti-interference ability and accurate dynamic period estimation, which can significantly improve the navigation performance of X-ray pulsars. • The proposed period estimation method uses photon energy information for contour weighted folding. • The proposed method uses reverse Hilbert curve to convert one-dimensional contour information into two-dimensional image information. • Convolutional Neural Network models are used to optimize pulsar period estimation. [Display omitted] [ABSTRACT FROM AUTHOR]

During the COVID-19 pandemic, the healthcare sector faced unprecedented challenges in effectively managing hospital resources. A crucial aspect of resource planning and allocation is the ability to predict the expected length of a patient's stay. Detecting whether a patient requires extended hospitalization or a shorter stay becomes vital for efficient hospital resource allocation and utilization. This paper aims to build a deep learning-based analytical model named LoSNet that predicts the length of stay for each patient at the time of admission to the Hospital. The early prediction of the length of stay requirement would aid healthcare professionals in optimizing the utility of hospital beds and other resources. In this direction, this paper compares the prediction ability of various machine-learning models including Random Forest, Decision Tree, Logistic Regression, and Naïve Bayes with a customized deep neural network model. The dataset used for this analysis includes ground truth on 3,18,438 patients' length of stay categorized into eleven classes such as 0-10 days being one class, 11-20 days being another class, and so on to more than 100 days. The methodology employed in this study involves data collection, data transformation, and training LoSNet, a deep neural network with no attention mechanisms. The results indicate impressive performance over other models and a random classifier, with a cross-entropy loss of 1.531 and an accuracy of 0.408 in predicting hospitalization durations in an 11-class classification setup, highlighting the framework's effectiveness in healthcare management. [ABSTRACT FROM AUTHOR]

Machine learning performs well in many problems. However, the tendency to generate predictions that violate theoretical knowledge makes it difficult to apply to practical processing. To resolve this situation, this paper combines domain knowledge with a data-driven model, proposes a theory-guided machine learning framework based on a parameter transfer strategy, and applies it to the width prediction of plates after multiple passes of hot rolling. The framework applies a swarm optimization algorithm to the original theoretical model and generates numerous highly-physical consistent samples. The established deep neural network (DNN) model is trained with simulated data, and the parameters are fine-tuned using a parameter transfer strategy combined with actual data to ensure excellent adaptation to the actual environment based on adequate learning of theoretical knowledge. In tests, the proposed model had the best overall prediction performance in this paper. Meanwhile, the developed model is consistent with the existing perception of rolling theory. This allows for the quick and reliable application of machine learning models in production. [Display omitted] • A novel theory-guided machine learning framework for width prediction of rolled plates. • Pre-training of the model using the data generated by the optimized theoretical model. • The proposed model has the best accuracy in both sufficient and less actual samples. • The variable influence of the proposed model is consistent with theoretical perceptions. [ABSTRACT FROM AUTHOR]

Autonomous spacecraft relative navigation via monocular images became a hot topic in the past few years and, recently, received a further push thanks to the constantly growing field of artificial neural networks and the publication of several spaceborne image datasets. Despite the proliferation of spacecraft relative-state initialization algorithms developed, most architectures adopt computationally expensive solutions relying on convolutional neural networks (CNNs) that provide accurate output at the cost of a high computational burden that seems unfeasible for current spaceborne hardware. The paper addresses this issue by proposing a novel pose initialization algorithm based on lightweight CNNs. Inspired by previous state-of-the-art algorithms, the developed architecture leverages a fast and accurate target detection CNN followed by a line segment detection CNN capable of running with low inference time on mobile devices. The line segments and their junctions are grouped into complex geometrical groups, reducing the solution search space, and subsequently, they are adopted to extract the final pose estimate. As a main outcome, the analyses demonstrate that the lightweight architecture developed scores high accuracy in the pose estimation task, with a mean estimation error of less than 10 cm in translation and 2.5°in rotation. The baseline algorithm scores a mean SLAB error of 0.04552 with a standard deviation of 0.22972 in the test dataset. Detailed analyses demonstrate that the uncertainties on the overall pose score are driven mainly by errors in the relative attitude, which gives the highest contribution to the pose error metric adopted. The analyses on the error distributions point out that the uncertainties on the estimated relative position are higher in the camera boresight axis direction. Concerning the relative attitude, the algorithm proposed has higher uncertainties in estimating directions of the target x and y axes due to ambiguities related to the target geometry. Notably, the target detection CNN trained in this work outperforms the previous top scores in the benchmark dataset. The performances of the proposed algorithm have been investigated further by analyzing the effects on the accuracy due to the relative distance and the presence of background in the images. Lastly, the paper delves into the possibility of adopting a sub-portion of the 2D-to-3D match matrix made by the most complex perceptual groups identified that positively affects the overall run-time, pointing out the performances in terms of accuracy of the estimates and providing a comparison of both the baseline and the reduced match matrix versions against state-of-the-art algorithms concerning relative position and attitude errors and solution availability, highlighting the high accuracy and solution availability of the proposed architectures. • New relative pose initialization algorithm based on the detection of line segments. • Detailed literature review and description of available spaceborne image datasets. • Improvement of state of the art in spacecraft detection using lightweight CNN. • Assessment of accuracy of the proposed architecture and error sources analyses. • Proven feasibility of the approach via comparison with other architectures. [ABSTRACT FROM AUTHOR]

This paper presents a novel machine learning (ML) based approach to predict machining cycle (part program running) times for complex 5-axis machining. Typical 5-axis machining toolpaths consist of short-segmented discrete linear cutter location lines (CL-lines) with simultaneously varying tool center point (TCP) and orientation vectors (ORI). As the 5-axis machine tool NC (numerical control) system tries to interpolate such part programs smoothly, the TCP motion decelerates and accelerates repeatedly causing the actual feedrate to fluctuate. The actual observed (resultant) feedrate can be approximately 30 % lower than the user commanded one. Furthermore, if the toolpath requires the 5-axis machine tool to travel closer to its singular point, or if the workpiece placement on the table is not optimal, actual feedrate is even lowered further. This paper presents two ML-based approaches to accurately predict 5-axis machining toolpaths. The first strategy uses a bidirectional long short-term memory (Bi-LSTM) network to model the machine tool behavior and generates a direct final cycle time estimation for any given part program. This approach only uses the toolpath geometry to predict the cycle time, and for training it only needs the "final" cycle times of similar part programs making it practical on today's shop floors. The second strategy requires individual CL-line processing times for training. In return, it can provide highly accurate cycle time predictions. Both strategies can capture the interpolation dynamics of 5-axis machine tool NC systems accurately. Simulation studies and experimental validations are conducted on modern 5-axis machine tools with varying workpiece placements and interpolation parameters. Proposed approaches have shown to predict cycle times with 90–95 % accuracy on real-life complex 5-axis machining toolpaths. [ABSTRACT FROM AUTHOR]

With the rapidly evolving geo-political landscape and unceasing advancements in technology, sustainable energy security is a very important topic. Research indicates that electrochemical energy systems are quite promising to solve many of energy conversion, storage, and conservation challenges while offering high efficiencies and low pollution. The paper provides an overview of electrochemical energy devices and the various optimization techniques used to evaluate them. The optimization techniques include linear regression, factorial design, the Taguchi method, artificial neural networks, filters, and a combination of such methods to improve these systems. To support the growing interest in research, the bulk of this study focuses on a review of the most promising and highly researched electrochemical energy devices, such as fuel cells, batteries, and supercapacitors. The paper also provides modest commentary on hydrogen production technologies, electrochemical reactors, and membrane separation technologies, amongst other technologies. Building on a previous paper by the authors of this paper on artificial intelligence in hybrid renewable energy systems with fuel cells, this work provides a comparative review of optimization techniques for supercapacitors by highlighting key findings based on model accuracy. A summary of the advantages and disadvantages of the different major optimization techniques is presented. The paper concludes that a combination of optimization techniques is used to overcome the drawbacks of individual techniques, with adaptive filters being the most widely studied. This paper presents studies on the Design of Experiments (DoE) with the goal of building a better understanding of the relationships that exist between different operating variables in various electrochemical devices. • The electrochemical systems can be optimized for better performance with high accuracy. • The optimization techniques used are either model-based or data-driven. • Linear regression and artificial neural networks are the most common techniques studied. • Hybrid models could be applied to enhance systems' accuracy and minimize errors. [ABSTRACT FROM AUTHOR]

Large deep learning models are impressive, but they struggle when real-time data is not available. Few-shot class-incremental learning (FSCIL) poses a significant challenge for deep neural networks to learn new tasks from just a few labeled samples without forgetting the previously learned ones. This setup can easily leads to catastrophic forgetting and overfitting problems, severely affecting model performance. Studying FSCIL helps overcome deep learning model limitations on data volume and acquisition time, while improving practicality and adaptability of machine learning models. This paper provides a comprehensive survey on FSCIL. Unlike previous surveys, we aim to synthesize few-shot learning and incremental learning, focusing on introducing FSCIL from two perspectives, while reviewing over 30 theoretical research studies and more than 20 applied research studies. From the theoretical perspective, we provide a novel categorization approach that divides the field into five subcategories, including traditional machine learning methods, meta learning-based methods, feature and feature space-based methods, replay-based methods, and dynamic network structure-based methods. We also evaluate the performance of recent theoretical research on benchmark datasets of FSCIL. From the application perspective, FSCIL has achieved impressive achievements in various fields of computer vision such as image classification, object detection, and image segmentation, as well as in natural language processing and graph. We summarize the important applications. Finally, we point out potential future research directions, including applications, problem setups, and theory development. Overall, this paper offers a comprehensive analysis of the latest advances in FSCIL from a methodological, performance, and application perspective. • In-depth survey on FSCIL methods, applications, performance. • Categorizing FSCIL into five subcategories for clear analysis. • Evaluating FSCIL research on benchmarks for strengths, weaknesses. • FSCIL applications in computer vision, NLP, and graph. [ABSTRACT FROM AUTHOR]

Deep neural networks have achieved outstanding performance in computer vision tasks. Convolutional Neural Networks (CNNs) typically operate in the spatial domain with raw images, but in practice, images are usually stored and transmitted in their compressed representation where JPEG is one of the most widely used encoder. Also, these networks are computationally intensive and slow. This paper proposes performing the learning and inference processes in the compressed domain in order to reduce the computational complexity and improve the speed of popular CNNs. For this purpose, a novel graph-based frequency channel selection method is proposed to identify and select the most important frequency channels. The computational complexity is reduced by retaining the important frequency components and discarding the insignificant ones as well as eliminating the unnecessary layers of the network. Experimental results show that the modified ResNet-50 operating in the compressed domain is up to 70% faster than the spatial-based traditional ResNet-50 while resulting in similar classification accuracy. Moreover, this paper proposes a preprocessing step with partial encoding to improve the resilience to distortions caused by low-quality encoded images. Finally, we show that training a network with highly compressed data can achieve a good classification accuracy with up to 93% reduction in the storage requirements of the training data. [ABSTRACT FROM AUTHOR]

This paper analyzes global robust exponential stability of interval bidirectional associative memory (BAM) neural networks with multiple time-varying delays, proposes a direct method based on system solutions, and gives sufficient conditions under which interval BAM neural networks have a unique and globally robustly exponentially stable equilibrium point. This method not only avoids the difficult to set up any Lyapunov–Krasovskii functional, but also derives simpler global robust exponential stability criteria. Compared with the data from other literature, the robust exponential stability criteria obtained in this paper have been presented to have more merits theoretically and numerically. • A new method based on system solutions is proposed to investigate robust GES criteria. • The obtained robust GES criteria are more effective than the existing ones. • The method is applicable to several neural network models after a small change. [ABSTRACT FROM AUTHOR]

With the prevalence of hardware accelerators as an integral part of the modern systems on chip (SoCs), the ability to model accelerators quickly and accurately within the system in which it operates is critical. This paper presents gem5-SALAMv2 as a novel system architecture for LLVM-based modeling and simulation of custom hardware accelerators integrated into the gem5 framework. It overcomes the inherent limitations of state-of-the-art trace-based pre-register-transfer level (RTL) simulators by offering a truly "execute-in-execute" LLVM-based model. It enables scalable modeling of multiple dynamically interacting accelerators with full-system simulation support. To create long-term sustainable expansion compatible with the gem5 system framework, gem5-SALAM offers a general-purpose and modular communication interface and memory hierarchy integrated into the gem5 ecosystem, streamlining designing and modeling accelerators for new and emerging applications. gem5-SALAMv2 expands upon the framework established in gem5-SALAMv1 with improved LLVM-based elaboration and simulation, improved and more extensible system integration, and new automations to simplify rapid prototyping and design space exploration. 1 1 Conference Paper Extension: This work extends the work presented in gem5-SALAM: A System Architecture for LLVM-based Accelerator Modeling from MICRO 2020 (Rogers et al., 2020). This work expands on the aforementioned work by revamping the gem5-SALAM internals to provide more robust and extensible simulations, introducing new automation tools for expanding and simplifying design space exploration, and demonstrates the new capabilities of gem5-SALAMv2 by exploring multiple configurations of simple neural network architectures. Validation on the MachSuite (Reagen et al., 2014) benchmarks presents a timing estimation error of less than 1% against the Vivado High-Level Synthesis (HLS) tool. Results also show less than a 4% area and power estimation error against Synopsys Design Compiler. Additionally, system validation against implementations on an Ultrascale+ ZCU102 shows an average end-to-end timing error of less than 2%. Lastly, we demonstrate the upgraded capabilities of gem5-SALAMv2 by exploring accelerator platforms for two deep neural networks, LeNet5 and MobileNetv2. In these explorations, we demonstrate how gem5-SALAMv2 can simulate such systems and guide architectural optimizations for these types of accelerator-rich architectures. 2 2 The most up-to-date version of gem5-SALAMv2 is available at https://github.com/TeCSAR-UNCC/gem5-SALAM.. [ABSTRACT FROM AUTHOR]

To enhance solution accuracy and training efficiency in neural network approximation to partial differential equations, partitioned neural networks can be used as a solution surrogate instead of a single large and deep neural network defined on the whole problem domain. In such a partitioned neural network approach, suitable interface conditions or subdomain boundary conditions are combined to obtain a convergent approximate solution. However, there has been no rigorous study on the convergence and parallel computing enhancement on the partitioned neural network approach. In this paper, iterative algorithms are proposed to enhance parallel computation performance in the partitioned neural network approximation. Our iterative algorithms are based on classical additive Schwarz domain decomposition methods. For the proposed iterative algorithms, their convergence is analyzed under an error assumption on the local and coarse neural network solutions. Numerical results are also included to show the performance of the proposed iterative algorithms. [ABSTRACT FROM AUTHOR]

Forward–backward doubly stochastic differential equations (FBDSDEs) serve as a probabilistic interpretation of stochastic partial differential equations (SPDEs) with diverse applications. Coupled FBDSDEs encounter numerous challenges in numerical approximation compared to forward–backward stochastic differential equations (FBSDEs) and decoupled FBDSDEs, including ensuring the measurability of the numerical solutions, accounting for the mutual influences between forward and backward processes, and considering the relationship with respect to SPDEs rather than PDEs. This paper introduces, for the first time, a numerical method for solving multi-dimensional coupled FBDSDEs. By integrating an optimal control-based approach with deep neural networks, it effectively addresses the coupling-related challenges between forward and backward equations. Computational examples of coupled FBDSDEs with explicit solutions demonstrate that the proposed deep learning-based numerical algorithm achieves commendable performance in terms of both accuracy and efficiency. [ABSTRACT FROM AUTHOR]

Physics-informed neural networks (PINNs) have shown remarkable achievements in solving partial differential equations (PDEs). However, their performance is limited when encountering oscillatory part in the solutions of PDEs. Therefore, this paper proposes a multi-scale deep neural network with periodic activation function to achieve high-frequency to low-frequency conversion, which can capture the oscillation part of the solution of PDEs. Moreover, the use of adaptive sampling method can adaptively change the location and distribution of residual points, improving the performance of the network. Additionally, the gradient-enhanced strategy is also utilized to embed the gradient information of the PDEs into the loss function of the neural network, which further improves the accuracy of PINNs. Through the numerical experiments verification, it is found that our method is better than PINNs in terms of accuracy and efficiency. • A MscaleDNNs structure with periodic activation functions is proposed. • The proposed neural network has better stability and robustness. • The effectiveness of the method was verified through numerical experiments. [ABSTRACT FROM AUTHOR]

Change detection in high-resolution Earth observation is a fundamental Earth vision task to understand the subtle temporal dynamics of Earth's surface, significantly promoted by generic vision technologies in recent years. Vision Transformer is a powerful component to learning spatiotemporal representation but with enormous computation complexity, especially for high-resolution images. Besides, there is still lacking principles in designing macro architectures integrating these advanced vision components for various change detection tasks. In this paper, we present a deep probabilistic change model (DPCM) to provide a unified, interpretable, modular probabilistic change process modeling to address multiple change detection tasks, including binary change detection, one-to-many semantic change detection, and many-to-many semantic change detection. DPCM describes any complex change process as a probabilistic graphical model to provide theoretical evidence for macro architecture design and generic change detection task modeling. We refer to this probabilistic graphical model as the probabilistic change model (PCM), where DPCM is the PCM parameterized by deep neural networks. For parameterization, the PCM is factorized into many easy-to-solve distributions based on task-specific assumptions, and then we can use deep neural modules to parameterize these distributions to solve the change detection problem uniformly. In this way, DPCM has both theoretical macro architecture from PCM and strong representation capability of deep networks. We also present the sparse change Transformer for better parameterization. Inspired by domain knowledge, i.e., the sparsity of change and the local correlation of change, the sparse change Transformer computes self-attention within change regions to model spatiotemporal correlations, which has a quadratic computational complexity of the change region size but independent of image size, significantly reducing computation overhead for high-resolution image change detection. We refer to this instance of DPCM with sparse change Transformer as ChangeSparse to demonstrate their effectiveness. The experiments confirm ChangeSparse's superiority in speed and accuracy for multiple real-world application scenarios, such as disaster response and urban development monitoring. The code is available at https://github.com/Z-Zheng/pytorch-change-models. More resources can be found in http://rsidea.whu.edu.cn/resource_sharing.htm. [ABSTRACT FROM AUTHOR]

The scale of meteorological data products does not match the requirements of application scenarios, which limits their application. It is suggested that large-scale reanalysis data must be downscaled before use. Attention mechanism is the key to high-performance downscaling models. However, in different application scenarios and different locations on the network, the attention mechanism is not always beneficial. In this paper, we propose a dynamic attention module that can adaptively generate weights for each branch based on input features, thereby dynamically suppressing unnecessary attention adjustments. At the same time, we propose a layer attention module, which can independently and adaptively aggregate the feature representation of different network layers. In addition, we design a unique loss function based on homoscedasticity uncertainty, which can directly guide the model to learn the numerical mapping relationship from low resolution to high resolution at the pixel level, and implicitly motivate the model to better reconstruct the data distribution of each meteorological field by guiding the model to learn the distribution difference between different meteorological fields. Experiments show that our model is more robust in time dimension, with an MAE average reduction of about 40% compared to VDSR and other methods in downscaling composite meteorological data. It can more accurately reconstruct multivariate high-resolution meteorological fields. Codes available at https://github.com/HitKarry/SDDN. [ABSTRACT FROM AUTHOR]

This paper reports the prediction results of the ionospheric irregularities represented by the ROTI index close to the equatorial ionization anomaly's Northern peak. A feedforward backpropagation Neural Network (NN) approach is implemented using a time series Nonlinear Autoregressive approach with Exogenous inputs (NARX). We used the data from a dual frequency GPS-SCINDA station located at Helwan (geographic coordinates of 29.86°N, 31.32°E, and MLAT of 29.94°N) in Egypt. To allow the model to be independently tested during varying levels of solar activities, we collected a 5-minute resolution of ROTI data for the solar cycle 24 from 2009 to 2017. The factors that influence the development of ionospheric irregularities are involved in the established model representing the diurnal and seasonal variations as well as solar and geomagnetic activity parameters. To support learning, we included IRI-foF2 and IRI-hmF2 parameters in the input layer neurons to improve the model learning about the behavior of the ionospheric F layer. The results show that the NN-ROTI values precisely match the GPS-ROTI values with an RMSE of 0.106 TECU/min and a prediction efficiency of 95%. The predicted values are highly correlated with the originals, with a regression of 0.89. Furthermore, the irregularities were more prevalent during the equinox months than during the solstice months. It is also observed that predicted NN-ROTI values in all seasons have RMSEs less than 0.03 and 0.05 TECU/min for the low and high solar activity, respectively. The results also showed a clear correlation between solar activity and the occurrence percentage of ionospheric irregularities indicating a solar cycle dependency. The prediction values of the NN-ROTI occurrence % demonstrated a remarkable correlation with the observed GPS-ROTI occurrence % across SC24. [ABSTRACT FROM AUTHOR]

In Computer-Controlled Optical Surfacing technology, the precision of the removal function directly affects the accuracy of computer-aided processing software predictions, which in turn influences subsequent polishing machine processing. A key parameter for constructing the removal function is the material removal rate, which is often challenging to obtain accurately. Currently, the Preston equation is widely used to describe the principles of material removal. However, as a linear equation that omits many factors, it struggles to accurately model the removal function in complex machining scenarios. Therefore, this paper proposes a hybrid neural network model combining Convolutional Neural Networks and Bidirectional Long Short-Term Memory to predict the material removal rate. The model's parameters are optimized using an improved Grey Wolf Optimization algorithm, ultimately establishing a removal function closely consistent with an actual removal function. We first tested our method on the PHM2016 Data Challenge dataset, achieving a mean squared error of 6.19 and an R2 of 0.9949, outperforming other mainstream neural network prediction models developed in recent years. Additionally, we further validated the performance of the neural network using a small grinding head polishing dataset, achieving MSE and R2 values of 1.9035 and 0.99902, respectively. Finally, we applied this method to construct the removal function on an actual small grinding head production line. Compared to the traditional Preston equation-based removal function, the predicted residual surface's PV and RMS errors were reduced from 28.24 % to 35.58 %–4.563 % and 4.86 %, respectively. These validation results demonstrate that the proposed method not only facilitates easier acquisition of the removal function model but also significantly enhances the accuracy of computer-aided processing software predictions, thereby better guiding ultra-precision machining processes. • Proposed a CNN-BiLSTM hybrid neural network to predict material removal rates. • First to construct a small grinding head removal function using a BiLSTM Predictor. • Optimized the neural network parameter sets using an improved Grey Wolf algorithm. • Achieved MSE of 6.19 and R2 of 0.9949 on the PHM2016 Data Challenge dataset. • Reduced polishing residual surface PV and RMS prediction errors to 4.563 % and 4.86 %. [ABSTRACT FROM AUTHOR]

Recently, there has been increasing concern about the vulnerability of deep neural network (DNN)-based synthetic aperture radar (SAR) automatic target recognition (ATR) to adversarial attacks, where a DNN could be easily deceived by clean input with imperceptible but aggressive perturbations. This paper studies the synthetic-to-measured (S2M) transfer setting, where an attacker generates adversarial perturbation based solely on synthetic data and transfers it against victim models trained with measured data. Compared with the current measured-to-measured (M2M) transfer setting, our approach does not need direct access to the victim model or the measured SAR data. We also propose the transferability estimation attack (TEA) to uncover the adversarial risks in this more challenging and practical scenario. The TEA makes full use of the limited similarity between the synthetic and measured data pairs for blind estimation and optimization of S2M transferability, leading to feasible surrogate model enhancement without mastering the victim model and data. Comprehensive evaluations based on the publicly available synthetic and measured paired labeled experiment (SAMPLE) dataset demonstrate that the TEA outperforms state-of-the-art methods and can significantly enhance various attack algorithms in computer vision and remote sensing applications. Codes and data are available at https://github.com/scenarri/S2M-TEA. [ABSTRACT FROM AUTHOR]

Three-dimensional variation in structural components or fiber alignments results in complex mechanical property distribution in tissues and biomaterials. In this paper, we use a physics-informed UNet-based neural network model (El-UNet) to discover the three-dimensional (3D) internal composition and space-dependent material properties of heterogeneous isotropic and transversely isotropic materials without a priori knowledge of the composition. We then show the capabilities of El-UNet by validating against data obtained from finite-element simulations of two soft tissues, namely, brain tissue and articular cartilage, under various loading conditions. We first simulated compressive loading of 3D brain tissue comprising of distinct white matter and gray matter mechanical properties undergoing small strains with isotropic linear elastic behavior, where El-UNet reached mean absolute relative errors under 1.5 % for elastic modulus and Poisson's ratio estimations across the 3D volume. We showed that the 3D solution achieved by El-UNet was superior to relative stiffness mapping by inverse of axial strain and two-dimensional plane stress/plane strain approximations. Additionally, we simulated a transversely isotropic articular cartilage with known fiber orientations undergoing compressive loading, and accurately estimated the spatial distribution of all five material parameters, with mean absolute relative errors under 5 %. Our work demonstrates the application of the computationally efficient physics-informed El-UNet in 3D elasticity imaging and provides methods for translation to experimental 3D characterization of soft tissues and other materials. The proposed El-UNet offers a powerful tool for both in vitro and ex vivo tissue analysis, with potential extensions to in vivo diagnostics. Elasticity imaging is a technique that reconstructs mechanical properties of tissue using deformation and force measurements. Given the complexity of this reconstruction, most existing methods have mostly focused on 2D problems. Our work is the first implementation of physics-informed UNets to reconstruct three-dimensional material parameter distributions for isotropic and transversely isotropic linear elastic materials by having deformation and force measurements. We comprehensively validate our model using synthetic data generated using finite element models of biological tissues with high bio-fidelity–the brain and articular cartilage. Our method can be implemented in elasticity imaging scenarios for in vitro and ex vivo mechanical characterization of biomaterials and biological tissues, with potential extensions to in vivo diagnostics. [Display omitted] [ABSTRACT FROM AUTHOR]

Over the past years, several efforts have been made to reduce greenhouse gas emissions coming from the transport sector. Due to the highly efficient CO2-free combustion and low manufacturing costs, Hydrogen Internal Combustion engines (H2ICEs) are considered one of the most promising solutions for the future of medium and heavy duty vehicles. However, the combustion of an air-hydrogen mixture presents challenges related to the production of nitrogen oxides (NOx) and high knock tendency, mainly due to the chemical characteristics of the fuel. Although these problems can be mitigated by the use of a lean mixture, which is also useful to increase the combustion efficiency, the presence of excess air reduces exhaust temperatures and, consequently, the enthalpy content in the exhaust would be limited, leading to a reduced boosting capability. Therefore, a proper control of mixture preparation and combustion phasing is mandatory to limit NOx emissions, avoid abnormal combustions, and maximize efficiency without performance limitations. This paper focuses on the design of a dedicated control strategy for H2ICEs. Starting from a previously validated 1-D engine model operated with hydrogen, a 0-D Artificial Neural Network (ANN) - based engine model has been designed and calibrated. By using the obtained fast running ANN-based model, an innovative torque-based engine controller has been developed and both engine and controller models have been tested covering different torque profiles. The results show good accuracy within a range of ±5% on producing the requested torque by controlling the centre of combustion. [Display omitted] • Hydrogen represents an optimal solution for the abatement of CO2 emissions related to the transport sector. • Hydrogen combustion is prone to abnormal combustions and NOx emissions. • Dedicated control strategies are needed to achieve an efficient, clean and reliable H2 combustion. • Model in the Loop approach aimed at testing the proposed control strategy. • Artificial neural network – based fast running engine model enabled testing the control system in relevant running conditions. [ABSTRACT FROM AUTHOR]

• Thermomechanical problem of FGMs sphere with material uncertainties is analyzed. • The interval random uncertainty model is recommended for material parameters. • A data-driven ANN fast calculation for FGMs sphere uncertainties analysis is established. • The volume fraction distribution is optimized for the safety design of the FGMs sphere. Mechanical analysis and optimal design for functionally graded materials (FGMs) structures are significant. The present paper analyzes the parameter uncertainties problem for the thermomechanical response of the FGMs spherical shells with volume fraction power distribution. Here, the interval random uncertainty model is recommended to describe the uncertainties of each component of material parameters in FGMs, and a data-driven artificial neural network (ANN) fast calculation for FGMs spherical shells thermomechanical problems with uncertainties analysis is established and trained. The thermomechanical coupling response analysis and volume fraction optimization analysis of the FGMs spherical shell with material uncertainties are realized for zirconia-titanium FGMs, with the maximum normalized Von Mises stress as the structural safety index and the ANN as the fast calculation method. In addition, the Von Mises stress of the FGMs spherical shell and a ZrO 2 -Ti alloy double-layer spherical shell under different loads is compared. The results show that material parameter uncertainties, especially those in Young's modulus, thermal expansion coefficient, and uniaxial yield limit significantly affect structural safety. The structural safety index λ calculated based on the volume fraction optimization design of FGMs spherical shell is significantly lower than that of the ZrO 2 -Ti alloy double-layer. The ANN method greatly improves the computational efficiency for uncertain problems and maintains high accuracy, compared with the statistical analysis after many calculations by randomly selecting material parameters. This study provides a path for the safety design of FGMs structures with uncertain parameters. [ABSTRACT FROM AUTHOR]

The main concept of a smart city is to join manual items with electronics, software, sensors, and network connectivity for data contact via Internet of Things (IoT) gadgets. IoT improves production and efficiency by cleverly utilizing remote management, but security as well as privacy risk, rises. Cyber threats are progressing every day, affecting inadequate actions of safety and privacy. In a smart city, the exposed action of an individual or business can keep the whole city in danger. Owing to the trust of numerous modules of smart cities on data and communication techniques, cybersecurity tasks like information leakage and mischievous cyber-attacks. Malicious Activity Detection in the area of cybersecurity for smart cities is dominant in protecting the consistent organization of urban atmospheres. Leveraging innovative machine learning (ML) and deep learning (DL) approaches, mainly anomaly detection methods permits the identification of abnormal patterns and probable threats within the massive streams of data produced by smart city methods. So, this paper designs a Fusion of Optimization Algorithms and DL for Enhanced Malicious Activity Recognition (FOADL-EMAR) technique for cybersecurity in smart cities. The purpose of the FOADL-EMAR technique is to recognize the presence of malicious activities using optimal DL techniques in the environment of a smart city. To accomplish this, the FOADL-EMAR technique uses a Z-score data normalization model to measure the input dataset into a useful format. In addition, the FOADL-EMAR technique uses an improved sand cat swarm optimization (ISCSO) algorithm that can be applied to select an optimal subset of features. An ensemble of three DL techniques is used namely long short-term memory (LSTM), deep neural networks (DNNs), and extreme learning machine (ELM) for malicious activity detection. The Harris Hawks Optimization (HHO) approach has been applied to improve the detection results of the ensemble models. The simulation analysis of the FOADL-EMAR methodology occurs utilizing a benchmark database. The experimentation values demonstrate the improved detection outcomes of the FOADL-EMAR algorithm over other existing methods in terms of different measures. [ABSTRACT FROM AUTHOR]

In the past few years, the lane detection technique has become a key factor for autonomous driving systems and self-driving cars on the road. Among the various vehicle subsystems, the lane detection module is one of the essential parts of the Advanced Driver Assistance System (ADAS). Conventional lane detection approaches use machine vision algorithms to find straight lines in road scene images. However, it is challenging to identify straight or curved lane markings in complex environments. To deal with this problem, this paper presents a lane detection technique based on deep learning. It is combined with a 3D convolutional network, so the temporal information is added to the network architecture. Using the front camera images, the system can immediately detect the lane marking information ahead. Moreover, we propose an approach for improvement by adding the time axis to the network architecture. In addition to using 3D-ResNet50, the temporal convolution and spatial convolution are separated for processing. The accuracy is 91.34% improved after adding time and space split convolution with LeakyReLU. The experiments carried out using real scene images have demonstrated the feasibility of the proposed technique for applications to various complex scenes. [ABSTRACT FROM AUTHOR]

This paper studies a multi-hydraulic system (MHS) synchronization control algorithm. Firstly, a general nonlinear asymmetric MHS state space entirety model is established and subsequently the model form is simplified by nonlinear feedback linearization. Secondly, an entirety model-type solution is proposed, integrating a nonlinear model predictive control (NMPC) algorithm with a cross-coupling control (CCC) algorithm. Furthermore, a novel disturbance compensator based on the system's inverse model is introduced to effectively handle disturbances, encompassing unmodeled errors and noise. The proposed innovative controller, known as nonlinear model predictive control—cross-coupling control with deep neural network feedforward (NMPC-CCC-DNNF), is designed to minimize synchronization errors and counteract the impact of disturbances. The stability of the control system is rigorously demonstrated. Finally, simulation results underscore the efficacy of the NMPC-CCC-DNNF controller, showcasing a remarkable 60.8% reduction in synchronization root mean square error (RMSE) compared to other controllers, reaching up to 91.1% in various simulations. These results affirm the superior control performance achieved by the NMPC-CCC-DNNF controller. • The nonlinear model of an asymmetric multi-hydraulic system is established. • The entirety model-type solution is proposed with nonlinear model predictive control and cross-coupling control algorithm. • A novel disturbance compensator based on the inverse deep neural network model is proposed. • Results showed the proposed controller can decrease 60.8% and up to 91.1% sysnchronization root mean square error. [ABSTRACT FROM AUTHOR]

• AI improves infectious waste management. • Ensemble model exceeds 97.81% accuracy. • Reinforcement learning optimizes classification. • Geometric augmentation boosts model robustness. • Study addresses urgent urban waste challenges. This research paper focuses on effective infectious municipal waste management in urban settings, highlighting a dearth of dedicated research in this domain. Unlike general or specific waste types, infectious waste poses distinct health and environmental risks. Leveraging advanced artificial intelligence techniques, we prioritize infectious waste categorization and optimization, integrating metaheuristics into optimization methods to create a robust dual-ensemble framework. Our model, the "Enhanced Artificial Intelligence for Infectious Municipal Waste Classification System," combines ensemble image segmentation methods and diverse convolutional neural network models. Innovative geometric image augmentation enhances model robustness, diversifies training data, and improves accuracy across waste types. A pivotal aspect is the integration of a reinforcement learning-differential evolution algorithm as a decision fusion strategy, optimizing classification by harmonizing outputs from ensemble methods and convolutional neural network models. Computational results, using a newly collected dataset, demonstrate our model's accuracy exceeding 96.54% while using the existing solid waste dataset we achieve the accuracy of 97.81%, outperforming advanced approaches by margins ranging from 2.02% to 8.80%. This research significantly advances sustainable waste management, showcasing artificial intelligence's transformative potential in addressing intricate waste challenges. It establishes a foundational framework prioritizing efficiency, effectiveness, and sustainability for future waste management solutions. Acknowledging the importance of diverse datasets, customization for urban contexts, and practical integration into existing infrastructures, our work contributes to the broader discourse on the role of artificial intelligence in evolving waste management practices. [ABSTRACT FROM AUTHOR]

The accidental leakage of gaseous hydrogen from hydrogen refueling station facilities has the potential to result in a large fire and explosion catastrophe. The ability to forecast the spatiotemporal evolution of hydrogen plumes in real-time is crucial for monitoring the distribution of plume concentrations and mitigating the risk of fire and explosion. The utilization of deep learning has been extensively employed in a diverse range of spatiotemporal forecasting tasks. However, these approaches encounter limitations in accurately quantifying uncertainty when predicting spatiotemporal concentrations and plume boundaries. This research paper introduces a novel model called DPSTNN_H 2 Evolution, which is a deep probabilistic spatial-temporal neural network designed for forecasting the spatiotemporal evolution of hydrogen plumes. The benchmark dataset is constructed by the implementation of numerical simulations pertaining to the inadvertent leak of hydrogen within a hydrogen refueling station. The findings of the study indicate that incorporating quantified uncertainty information might enhance the precision of plume boundaries and the resilience of plume concentrations when predicting the spatiotemporal development of hydrogen. By employing Monte Carlo sampling with a sample size of m = 100 and a dropout rate of p = 0.1 , the model demonstrates the ability to provide real-time inference for 10 instances of plumes, while maintaining a high level of accuracy with R2 = 0.9829. In comparison to the current state-of-the-art model, the proposed model demonstrates superior accuracy and robustness in forecasting the spatiotemporal evolution of hydrogen plumes. In general, our proposed model has the potential to serve as a dependable option for the development of a digital twin for emergency management of hydrogen refueling stations. • Probabilistic spatial-temporal neural network model for hydrogen plume evolutions is proposed. • Normalized uncertainty contours and uncertainty intervals to improve accuracy and robustness. • Numerical experiment of hydrogen leakage and dispersion in refueling station are conducted. • Optimal hyper-parameters of the proposed model are determined • Comparison between the proposed model with point-estimation based model is conducted [ABSTRACT FROM AUTHOR]

The efficient approximation of parametric PDEs is of tremendous importance in science and engineering. In this paper, we show how one can train Galerkin discretizations to efficiently learn quantities of interest of solutions to a parametric PDE. The central component in our approach is an efficient neural-network-weighted Minimal-Residual formulation, which, after training, provides Galerkin-based approximations in standard discrete spaces that have accurate quantities of interest, regardless of the coarseness of the discrete space. [ABSTRACT FROM AUTHOR]

Accurate three-dimensional (3D) measurement for large field of view (FOV) is currently a significant research field. Accordingly, system calibration is crucial to ensure accuracy. However typical calibration methods often involve the use of large calibration objects, which is not only expensive but also difficult to achieve sufficient accuracy. A novel method based on a dual-brand deep neural network (DNN) is proposed for the system calibration. Taking advantage of the concept of "divide and conquer", the FOV is divided into sub-regions with a part of overlapping regions by a small calibration object, which forms a large calibration object covering the whole FOV. Then the sub-regions are fused into a global framework and further optimized by the proposed dual-brand DNN. The proposed method reduces the need for calibration objects while improving the calibration accuracy and generalization ability in large FOV. A series of experiments have been designed to prove the effectiveness and robustness of the proposed method. • A high-accuracy calibration method of a 3D measurement system with large field-of-view is proposed. The highlights of the paper are: • A high-accuracy calibration method for large field-of-view is proposed. • The large field-of-view is divided into multiple sub-regions. • Sub-regions are unified to a uniform coordinate system by self-constraint. • A dual-branch DNN is optimized using the multi-objective loss function. [ABSTRACT FROM AUTHOR]

Precision Agriculture (PA) has revolutionized crop management by leveraging information technology, satellite positioning data, and remote sensing. One crucial component in PA applications is the Normalized Difference Vegetation Index (NDVI), which offers valuable insights into crop vigor and health. However, discontinuity of optical satellite acquisitions related to cloud cover and the huge load of the required processing time pose challenges to real-time applications. NDVI prediction emerges as an innovative solution to address these limitations. It allows for proactive decision-making by providing accurate estimates, enabling farmers and land managers to plan essential agronomic activities such as irrigation, fertilization, and pest control, based on anticipated future conditions. This study introduces an Artificial Neural Network (ANN) model incorporating NDVI, Normalized Difference Water Index (NDWI), temperatures, and precipitation as predictive variables. The model employs a novel time series slicing algorithm, Boosting Adaptive Time Series Slicer (BATS), to enhance the input training dataset's variability, presenting the model with a broader range of examples. A 2-Bidirectional Long Short-Term Memory (LSTM) forecasting model was developed to predict future NDVI values over short and medium-term horizons. The study area used to train, test and validate the ANN corresponds to a diverse landscape of cultivated corn fields located in Piemonte (NW-Italy). Results showed that NDVI future estimates were accurate; considering three time horizons for predictions (5, 10, and 15 days) RMSE values resulted to be 0.028, 0.038 and 0.050, respectively. Additionally, ablation tests proved that the most important variable for enhancing the model's accuracy is the NDWI, and the most useful timesteps are the four most recent ones. To preliminary investigate the capability of the ANN to operate over a wider and different area it was applied over the entire Europe, using the LUCAS dataset as reference map to locate corn fields. Results show RMSE of 0.062, 0.083 and 0.105 for the 5, 10 and 15 days forecasting horizons, respectively. The methodology proposed in this paper can be a possible alternative to more ordinary approaches for NDVI forecasting that nowadays appears to be a fundamental step for a proactive precision agriculture where crop management can be significantly improved. Future developments should explore the use of sequence-to-sequence ANNs to predict the development of multiple spectral indices over multiple crop types simultaneously. [ABSTRACT FROM AUTHOR]

This paper introduces an innovative approach for generating re-entry trajectories for a reusable winged spacecraft. This approach utilizes Fourier series parametrized control profiles. The Fourier coefficients are derived through a combination of the Improved Search Space Reduction (ISSR) technique and Sequential Quadratic Programming (SQP) optimization methods, which effectively limit the maximum heat rate experienced by the spacecraft. These re-entry trajectories and control profiles are then used to train artificial neural networks, enabling the controller to provide optimal control inputs based on the spacecraft's current altitude and velocity. To validate this methodology, Hardware-in-loop (HIL) simulations are conducted, integrating the designed neural network-based controller with a Texas Instruments TI Delfino TMSF28335 controller and a real-time simulator, the OPAL-RT OP4510. The results of the HIL simulation demonstrate that the generated re-entry trajectory accurately adheres to heat rate and terminal constraints. Additionally, the Fourier series parametrization of control profiles is applied to a high lift-to-drag ratio CAV-H vehicle, showcasing the method's versatility. Furthermore, resilience of proposed method to uncertainties in aerodynamic coefficients and atmospheric density is also demonstrated. The results show that the proposed method is generic and exhibits robustness to uncertainties. [ABSTRACT FROM AUTHOR]

Controlled de-orbiting is crucial for a low earth orbiting (LEO) satellite or capsule intending to land in a desired location and to prevent damage to people and property on the ground caused by debris. Drag modulation is one possible mechanism to control de-orbiting, exploiting atmospheric drag variation to reduce the necessary orbital energy from the initial conditions to the re-entry interface. In this context, this paper proposes a novel targeted de-orbiting Artificial Neural Network (ANN) and drag-based guidance algorithm for a LEO artificial satellite. It relies on the combination of empirical and analytical relations with Deep Neural Networks (DNNs) to estimate the main parameters of the optimal control law in real time. The training set is composed of several optimal control solutions generated with a previously developed optimal control algorithm, exploiting the formulation in equinoctial modified orbital parameters to manage the large time scale of the problem and the computational cost. An innovative procedure for the training set generation led to the achievement of general results with a limited number of samples. The successful outcome of the guidance algorithm on over 1000 cases demonstrates its robustness and generalization of results. To conclude, a Linear Quadratic Regulator (LQR) feedback control is applied to one case to deal with a more realistic and uncertain density model. • Analytical optimal guidance for a satellite de-orbiting from Low Earth Orbit. • A novel approach based on Deep Neural Networks. • Prediction of the key parameters of the optimal control law in real time. • A Monte Carlo analysis showed the algorithm's robustness and generalization. • Successful feedback control thanks to a Linear Quadratic Regulator (LQR). [ABSTRACT FROM AUTHOR]

While deep neural networks have shown impressive results in automatic speaker recognition and related tasks, it is dissatisfactory how little is understood about what exactly is responsible for these results. Part of the success has been attributed in prior work to their capability to model supra-segmental temporal information (SST), i.e., learn rhythmic-prosodic characteristics of speech in addition to spectral features. In this paper, we (i) present and apply a novel test to quantify to what extent the performance of state-of-the-art neural networks for speaker recognition can be explained by modeling SST; and (ii) present several means to force respective nets to focus more on SST and evaluate their merits. We find that a variety of CNN- and RNN-based neural network architectures for speaker recognition do not model SST to any sufficient degree, even when forced. The results provide a highly relevant basis for impactful future research into better exploitation of the full speech signal and give insights into the inner workings of such networks, enhancing explainability of deep learning for speech technologies. • Literature explains speaker recognition in neural nets by modeling of voice dynmaics. • Diagnostic: We quantify how well deep learning models actually capture dynamics. • Observation: State-of-the-art deep nets do not model speaker prosody but ignore it. • Interpretation as "cheating": Achieving high without putting in due effort. • Outlook: Increasing task difficulty biases models towards prosody, but not enough. [ABSTRACT FROM AUTHOR]

The extensive spread of fake news on social networks is carried out by a diverse range of users, encompassing private individuals, newspapers, and organizations. With widely accessible image and video editing tools, malicious users can easily create manipulated media. They can then distribute this content through multiple fake profiles, aiming to maximize its social impact. To tackle this problem effectively, it is crucial to possess the ability to analyze shared media to identify the originators of fake news. To this end, multimedia forensics research has advanced tools that examine traces in media, revealing valuable insights into its origins. While combining these tools has proven to be highly efficient in creating profiles of image and video creators, it is important to note that most of these tools are not specifically designed to function effectively in the complex environment of content exchange on social networks. In this paper, we introduce the problem of establishing associations between images and their source profiles as a means to tackle the spread of disinformation on social platforms. To this end, we assembled SocialNews , an extensive image dataset comprising more than 12,000 images sourced from 21 user profiles across Facebook, Instagram, and Twitter, and we propose three increasingly realistic and challenging experimental scenarios. We present two simple yet effective techniques as benchmarks, one based on statistical analysis of Discrete Cosine Transform (DCT) coefficients and one employing a neural network model based on ResNet, and we compare their performance against the state of the art. Experimental results show that the proposed approaches exhibit superior performance in accurately classifying the originating user profiles. • We introduce SocialNews, a novel dataset for disinformation detection online. • Images were sourced primarily from social profiles of news agencies around the world. • The goal is to automatically identify the profile of the user that shared an image. • We introduce two benchmarks methods: a DCT-based one and a ResNet-based one. • Experiments show that the proposed benchmark methods outperform the state of the art. [ABSTRACT FROM AUTHOR]

In this paper, we consider the evolution of a new probability distribution called the exponential flexible Weibull distribution. The proposed exponential flexible Weibull distribution is obtained by combining the flexible Weibull extension with the exponential T- X strategy. For the exponential flexible Weibull, the estimators of the model parameters are derived mathematically. The appraisal of these parameters is accomplished through a simulation study. The applicability and virtuoso of the exponential flexible Weibull distribution are exemplified via two data sets. Furthermore, we implement the state-of-the-art deep learning algorithms, specifically Artificial Neural Networks and Extreme Gradient Boosting, which are widely employed in real-world applications. A comprehensive comparative analysis is conducted to assess the relative performance of these methodologies. [ABSTRACT FROM AUTHOR]

The utilization of solar radiation by converting them into thermal energy is discussed in this paper. Nanoparticles improve the ability of heat transfer therefore, it is beneficial in the use of solar thermal systems and energy storage devices. The novel mixture of nanoparticles Graphene and Polythiophene in base fluid, which has high thermodynamic properties for the improvement of thermal effect with electromagnetic effect by using Maxwell fluid model is discussed. Polyvinyl alcohol water is taken as base fluid flowing through a moveable flat plat. The governing partial differential equations are transformed into ordinary differential equations. The semi-analytical technique, homotopy analysis method is used to obtain the solution of the ordinary differential equations. The velocity is enhanced with magnetic and electric field strength. The increase of the Prandtl number, Eckert number and chemical reaction parameter, exceeds the thermal effect which produces more entropy generation and heat enhancement. The results show that the hybrid nanofluid with this Novel mixture is highly thermodynamic with higher entropy and rapid thermal augmentation which can be used in energy production and energy storage devices. A novel intelligent numerical computing technique multi-layer perceptron with feed-forward back-propagation, an artificial neural networking method with the Levenberg-Marquard algorithm is used in this model. The data is gathered for the neural networking method training, validation, and testing. The efficiency of the model is obtained and mean square error is obtained by artificial neural networking. [ABSTRACT FROM AUTHOR]

Rolling bearings constitute one of the most vital components in mechanical equipment, monitoring and diagnosing the condition of rolling bearings is essential to ensure safe operation. In actual production, the collected fault signals typically contain noise and cannot be accurately identified. In the paper, stochastic resonance (SR) is introduced into a spiking neural network (SNN) as a feature enhancement method for fault signals with varying noise intensities, combining deep learning with SR to enhance classification accuracy. The output signal-to-noise ratio(SNR) can be enhanced with the SR effect when the noise-affected fault signal input into neurons. Validation of the method is carried out through experiments on the CWRU dataset, achieving classification accuracy of 99.9%. In high-noise environments, with SNR equal to −8 dB, SRDNs achieve over 92% accuracy, exhibiting better robustness and adaptability. • Stochastic resonance is combined with spiking neural networks to improve accuracy. • Diverse neurons are employed in Stochastic Resonance Deep Residual Networks (SRDN). • SRDN exhibits superb robustness and adaptability under different noise conditions. [ABSTRACT FROM AUTHOR]

Accurate identification of the failure modes of Reinforced Concrete (RC) columns based on the design parameters of the structural members is critical for earthquake-resistant design and safety evaluation of existing structures. Existing identification methods have some problems, such as high cost, incomplete consideration of influencing factors, and low precision or recall in identifying shear or flexural-shear failure. In this paper, the main factors for the failure modes of RC columns are first analyzed and studied. Then, the problem of class imbalance in data samples is investigated. To identify the failure modes of RC columns, oversampling of data (BSB-FMC), model ensembling (RFB-FMC), cost-sensitive learning (CSB-FMC) and a fusion model of three strategies (BSFCB-FMC) are proposed. And finally, the SHapley Additive exPlanations (SHAP) method is used to provide a better interpretation of the designed model. The results show that the developed strategies can improve the accuracy of identifying the failure modes of RC columns compared to the models using a single Artificial Neural Network (ANN), a Support Vector Machine (SVM), a Random Forest (RF), and Adaptive Boosting (AdaBoost). The overall accuracy of the developed BSFCB-FMC model reaches 97%, and the precision and recall for the three failure modes are both above 90%. The designed model provides a solution for fast, accurate and cost-effective identification of the failure modes of RC columns. • We develop the models for identifying the failure modes of RC columns considering class imbalance problem. • The BSFCB-FMC model is developed by considering data oversampling, model ensembling, and cost-sensitive learning. • The designed model provides engineers with an interpretable, fast and stable model for identifying failure modes. [ABSTRACT FROM AUTHOR]

This paper introduces a novel direct torque control approach based on the decision tree (T-DTC), employing artificial neural networks that are effectively trained to enhance accuracy and robustness. The main objective of T-DTC is the substantial reduction of flux and torque ripples inherent in the conventional DTC, ensuring effective control of the induction motor. The conventional hysteresis controllers for stator flux and electromagnetic torque are replaced by two advanced controllers named M5 Prime model trees. Additionally, the traditional switching table is substituted with a novel decision tree table utilizing the classifier algorithm 4.5. The effectiveness of the proposed T-DTC strategy is demonstrated through simulation in MATLAB/Simulink and validated in real-time using an HIL platform based on OPAL-RT OP 5600 and Virtex 6 FPGA ML605. The results obtained demonstrate a notable improvement compared to existing techniques in the literature. [Display omitted] • An enhanced DTC strategy for induction motor based on decision tree is proposed. • A neural learning process is applied for the designed controllers. • Easy real-time implementation of the Tree-DTC strategy via the HIL tests is realized. • Considerable minimization of stator flux and electromagnetic torque ripples is achieved. • Robust Tree-DTC strategy in terms of speed monitoring and disturbance rejection is achieved. [ABSTRACT FROM AUTHOR]

Schedule maintenance activities for hydrogen fuel cell vehicles are aimed to keep them in better condition in long-term operation. In this paper, we develop a reinforcement learning based schedule maintenance strategy, which is used to comprehensively consider the balance between safety and maintenance cost, so as to find the optimal maintenance strategy. A multi-level framework is established with remaining useful life of key components, fault tree analysis, and logistics cost model to generate an exploration environment that can express the operational stability, the failure rate of components, and the cost of repair and storage. The trained agent combines a deep neural network to explore the optimal strategy under the dynamic reliability of key components. Finite steps are the constraints. Safety rates, maintenance cost, and episode of operation are incorporated into a multi-objective reward function. The hydrogen supply circuit of fuel cell vehicle is simulated via Python. The trained agent is compared with traditional time-based schedule maintenance strategy and corrective maintenance strategy. The results show that the reinforcement learning based schedule maintenance agent has optimized the total reward, cost control and accident rate by 77%, 59% and 5%, respectively, compared with the traditional time-based schedule maintenance strategy. In the safe operation management of fuel cell vehicles, efficient and stable decision-making ability has been achieved. • An adaptive maintenance strategy of deep reinforcement learning is proposed. • An exploration environment of FCV is established. • The deep Q network is proposed to solve the maintenance problem. • The efficient and stable decision-making ability is much better than time-based scheduled maintenance strategy. [ABSTRACT FROM AUTHOR]

In recent studies, artificial intelligence models have been developed for the prediction of nitrogen oxide emissions from thermal power plants. This research utilizes an artificial intelligence prediction model with more coal input features than boiler features, including volatility, ash content, sulfur content, fixed carbon, total moisture, calorific value, grinding rate, fuel ratio, coal feeding rate, boiler efficiency, total air volume, and excess air volume. The paper delves into the importance analysis of input features for artificial intelligence models. Moreover, feature importance analysis is not only a prerequisite for predicting nitrogen oxide emissions but also a study providing insights into model performance. An artificial neural networks (ANN) regression model is employed to predict nitrogen oxide emissions, and the results demonstrate that the number of feature importance significantly impacts model performance. The best model performance is achieved with eight specific input features. Finally, after the training and validation processes, the ANN model yields the optimal coefficient of determination (R2) value. • Development of an artificial intelligence prediction model for nitrogen oxide emissions from thermal power plants. • A comprehensive set of input features is utilized for emissions prediction. • Importance analysis of input features significantly impacts model performance. • Optimal model performance was achieved with eight specific input features. • The robust coefficient of determination (R2) value demonstrates the accuracy of the ANN model. [ABSTRACT FROM AUTHOR]

Despite significant progress has been made towards crop yield prediction with remote sensing, there exist knowledge gaps on (1) the impacts of temporal resolution of imaging frequencies on yield prediction, (2) transferability of the models among different genotypes and test sites, and (3) translation of these research developments to crop breeding that benefit farmers. Existing research predominantly provides an on-site perspective, frequently missing the complexities of real-world applications. The objectives of this paper are to investigate the transferability and generalization capabilities of yield prediction models for crop breeding across test sites located in North and South Americas. Toward that goal, we tested different machine learning techniques including Random Forest Regressor (RF), Gradient Boosting Regression (GB), and Deep Neural Networks (DNN) for soybean yield prediction with experiments conducted in different climate and growth conditions. A novel transfer learning approach was proposed for genotype selection and categorizing soybean yield for screening high-yield varieties. Furthermore, we studied the effect of temporal resolution on yield prediction, focusing on the critical development stages and optimal aerial survey frequencies for precise yield prediction using large 31,404 sample data. Results demonstrated that the combined dataset of Argentina and United States representing different climate regimes provided the highest performance with an R2 of 0.76 using RF and GB algorithms. The classification approach was proven to be most useful for crop breeding as demonstrated by accurately identifying the high-yielding genotypes. Increasing temporal sampling of key phenological stages significantly improved yield prediction. Although transfer learning yielded promising outcomes across trials within Argentina the efficacy of transferring models from Argentina to the United States was limited, attributed to significant seasonal and climate variations. This study pioneered the use of transfer learning for model adaptability in real-world breeding scenarios, training and transferring models within the South and North Americas, providing actionable insights and strategies for the breeding community, aiming to facilitate improved decision-making for agricultural productivity. [ABSTRACT FROM AUTHOR]

To improve convergence speed of deep neural network trained by gradient descent methods (GDMs), this paper proposed a novel fractional order gradient descent optimizer (FOAdam) based on Caputo operator and Adam algorithm, and analyzed the impact of fractional order on convergence performance using optimization theory and simulation. Furthermore, to address the trade-off between convergence speed and precision under fixed-order conditions, a fractional order scheduler (FOS) was designed based on the Connections Cloud Model (CCM). Numerical experiments conducted on MNIST and CIFAR-10 datasets showed that FOS-FOAdam outperformed other mainstream GDMs in terms of convergence speed and precision. Finally, FOS-FOAdam was applied in recognizing and classifying image datasets of cuttings and cores at the logging site, demonstrating good prospects for practical engineering applications. [ABSTRACT FROM AUTHOR]