Search

The pulp and paper industry is critical to global industrial and economic development. Recently, India's pulp and paper industries have been facing severe competitive challenges. The challenges have impaired the environmental performance and resulted in the closure of several operations. Assessment and prediction of the performance of the Indian pulp and paper industry using various parameters is a critical task for researchers. This study proposes a framework for performance assessment and prediction based on Data Envelopment Analysis (DEA), Artificial Neural Networks, and Deep Learning (DL) to assist industry administration and decision-making. We presented a case study based on eight industries to demonstrate the methodology's applicability. This study analyses and predicts industry performance based on sample data observations over 30 years. The result suggests the DEA-DL-based efficiency prediction has an overall MSE of 0.08 compared with the actual efficiency. Furthermore, the efficiency rankings are compared between the three techniques. The results suggest that the integrated DEA-DL method is primarily accurate in most scenarios with the actual values. The findings of this study provide a comprehensive analysis of environmental performance for policymakers. [ABSTRACT FROM AUTHOR]

Recent increases in global food demand have made this research and, therefore, the prediction of agricultural commodity prices, almost imperative. The aim of this paper is to build efficient artificial intelligence methods to effectively forecast commodity prices in light of these global events. Using three separate, well-structured models, the commodity prices of eleven major agricultural commodities that have recently caused crises around the world have been predicted. In achieving its objective, this paper proposes a novel forecasting model for agricultural commodity prices using the extreme learning machine technique optimized with the genetic algorithm. In predicting the eleven commodities, the proposed model, the extreme learning machine with the genetic algorithm, outperforms the model formed by the combination of long short-term memory with the genetic algorithm and the autoregressive integrated moving average model. Despite the fluctuations and changes in agricultural commodity prices in 2022, the extreme learning machine with the genetic algorithm model described in this study successfully predicts both qualitative and quantitative behavior in such a large number of commodities and over such a long period of time for the first time. It is expected that these predictions will provide benefits for the effective management, direction and, if necessary, restructuring of agricultural policies by providing food requirements that adapt to the dynamic structure of the countries. [ABSTRACT FROM AUTHOR]

De-mining operations are of critical importance for humanitarian efforts and safety in conflict-affected regions. In this paper, we address the challenge of enhancing the accuracy and efficiency of mine detection systems. We present an innovative Deep Learning architecture tailored for pulse induction-based Metallic Mine Detectors (MMD), so called DL-MMD. Our methodology leverages deep neural networks to distinguish amongst nine distinct materials with an exceptional validation accuracy of 93.5%. This high level of precision enables us not only to differentiate between anti-personnel mines, without metal plates but also to detect minuscule 0.2-g vertical paper pins in both mineralized soil and non-mineralized environments. Moreover, through comparative analysis, we demonstrate a substantial 3% and 7% improvement (approx.) in accuracy performance compared to the traditional K-Nearest Neighbors and Support Vector Machine classifiers, respectively. The fusion of deep neural networks with the pulse induction-based MMD not only presents a cost-effective solution but also significantly expedites decision-making processes in de-mining operations, ultimately contributing to improved safety and effectiveness in these critical endeavors. [ABSTRACT FROM AUTHOR]

In order to solve the problem of untimely monitoring of tool wear status during laser-ultrasonic compound cutting (LUCC), which leads to the reduction of process accuracy and product quality damage, a method of tool wear status monitoring based on acoustic emission (AE) and deep learning is proposed in this paper. The AE signal is collected and analyzed in the frequency and time-frequency domains by using Fourier transform (FT) and wavelet packet decomposition (WPD), it is found that the AE signal energy is mainly concentrated in the 1st, 2nd, 3rd, and 4th frequency bands, and the energy of each frequency band in the signal increases gradually when the tool wear degree increases, however, the percentage of energy of each frequency band in the total energy shows different change trend. According to the amount of flank wear of the tool, the tool wear degree is divided into four tool wear states. The SVM model and BP neural network model were established based on MATLAB software to realize the tool wear state monitoring. The results show that the tool wear monitoring based on BP neural network is better than that of SVM for tool wear status monitoring. The model identification correct rate reaches 99 %, which is more suitable for the tool wear state monitoring designed in this paper. [ABSTRACT FROM AUTHOR]

Memristors have several chaotic dynamic models and have been used successfully in various fields, including secure communication systems, information storage, and artificial neural networks. The memristor-based four-dimensional chaotic (FDMC) systems generate unpredictable and intricate time domain signals. Parameter fluctuations in the FDMC system may give birth to chaos, making it difficult to suppress. Stabilizing chaos in the FDMC system improves the circuit's performance. This paper synthesizes a novel time-efficient chatter-free nonlinear robust adaptive control (NLRAC) technique that stabilizes chaos in the FDMC system affected by time-varying unknown bounded exogenous disturbances and model uncertainties. The proposed NLRAC strategy decimates the time-varying unknown bounded exogenous disturbances and model uncertainties effects; it establishes a faster, smoother state-variable trajectories convergence to the zero vicinity. The theoretical analysis and mathematical proofs are based on the Lyapunov stability technique. Computer simulation results show that the proposed NLRAC technique effectively brings the FDMC system's state-variable trajectories to zero with reduced fluctuations for control input signals and state-variable trajectories. This feedback controller's attribute enhances closed-loop stability performance, improves precision, and reduces risk overshoot. The paper includes comparative computer simulation results to endorse the proposed controller performance. [ABSTRACT FROM AUTHOR]

To investigate how the petroleum industry evaluates and selects powerful cloud service providers, first, an evaluation index system including 25 indices such as scalability and private data protection is built. This index system can systematically examine the comprehensive strengths of cloud service providers. Aiming to solve the problems that the traditional expert evaluation method has high requirements on expert experience and is easily affected by subjective factors, a novel artificial intelligence evaluation model named TentISSA-BPNN is proposed. The objective evaluation ability of this model can be effectively used in evaluation research on cloud service providers for petroleum enterprises. In this model, the SSA algorithm is optimized by Tent chaotic mapping and adaptive inertia weight; an algorithm, TentISSA, that has good stability and fast convergence speed is designed and proposed; and the BPNN is improved with TentISSA to obtain more accurate evaluation results. To evaluate the performance of the TentISSA algorithm, nine unimodal and multimodal functions are selected in this paper to test the convergence accuracy. Then, seven models are selected as the control groups to validate the effectiveness and performance of the TentISSA-BPNN evaluation model proposed in this paper. Finally, the preprocessed data of the candidate cloud service providers are input into the trained neural network model proposed in this paper for evaluation. Based on the ranking of the evaluation scores, the comprehensive strengths of the cloud service providers are obtained to provide a decision-making reference for managers of petroleum enterprises in the process of choosing cloud service providers. [ABSTRACT FROM AUTHOR]

Due to the large intra-class differences between the same categories and the scale imbalance between different categories in the remote sensing image dataset, the semantic segmentation task presents the problem of small-scale object information loss, the imbalance between foreground and background, and simultaneously the background dominates, which seriously affects the performance of the network model. To solve the above problems, this paper proposes an efficient bilateral branch depth neural network model based on the U-Net depth neural network, named BBU-Net. Firstly, one branch of the network learns the distribution characteristics of the original data, and the other focuses on difficult samples. Then the two branches improve the representation and classification ability of the neural network by accumulating learning strategies. Finally, considering the geometric diversity of remote sensing images, this paper adopts test time augmentation and reflection padding strategies and proposes a balanced weighted loss function named CombineLoss to alleviate the imbalance in the training process. The depth neural network proposed in this paper was first tested on the Inria Aerial Image Labeling Dataset, and 87.53% of mean intersection over union and 97.4% of mean pixel accuracy were obtained, respectively. At the same time, to verify the model's complexity, the model proposed in this paper is compared with the neural network based on integrated learning. The comparison results show that the spatial complexity of the network proposed in this paper is much lower than the neural network obtained by integrated learning, and the parameters are also much smaller than the neural network based on integrated learning. Then use the satellite building dataset I in the WHU Building Dataset and mainstream semantic segmentation methods for multiple groups of comparative experiments. The experimental results show that the method proposed in this paper can effectively extract the semantic information of remote sensing images, significantly improve the imbalance of remote sensing image data, improve the performance of the network model, and achieve a good semantic segmentation effect, which fully proves the effectiveness of this method. [ABSTRACT FROM AUTHOR]

The issue of traffic mismanagement is getting bad to worse as the trend of urbanization is increasing and posing significant threats to the urban areas. This paper addresses this issue of traffic mismanagement by proposing a Fog-Cloud centric Internet of Things (IoT)-based collaborative framework that enables machine learning-based situation-aware traffic management. This framework monitors the traffic dynamics at the fog layer for providing real-time analytics to the cloud and enabling the traffic situation-aware routing of the vehicles. Whereas the framework at the cloud layer determines the situation-aware analytics by predicting Waiting Time (WaT), Waiting Queue Length (WQueL) and next green phase duration (G) for each Traffic Movement Signal Point (TMSP) based on the real-time data and analytics provided by the fog layer. The road-infrastructure hosted fog layer classifies the In-schedule Reachability Status (IRS) that determines the ability of the vehicle to reach the respective TMSP down the lane before the start of the next green phase. After classifying all such vehicles on a lane by the fog layer, the cloud layer predicts the optimal duration of the next green phase at that respective TMSP to reduce the traffic congestion on the respective junction point and subsequently provides these area-wide analytics to the vehicle hosted fog nodes and traffic controllers on the respective junction points. The vehicles use these analytics for enabling situation-aware vehicle routing functionality by selecting a time optimized path and enabling balanced traffic load on all possible paths. The framework employs Logistic Regression (LR) for IRS classification at the fog layer and Artificial Neural Network (ANN) for traffic prediction at the respective TMSP at the cloud layer. The result depiction acknowledges LR's efficiency compared to other employed classifiers in terms of various statistical parameters. The optimal performance of ANN at the learning rate (LeR) of 0.1, momentum rate (MoR) of 0.95, and 500 epochs depict the prediction efficiency of ANN as compared to other used prediction approach. The contribution of this paper is two functionalities-based working of fog computing for providing real-time and situation-aware traffic analytics, adaptive traffic movement phase planning, time optimized navigation, and optimal traffic load balancing. [ABSTRACT FROM AUTHOR]

This paper focuses on building a ground motion model (GMM) using artificial neural network technique driven by a synthetically generated database in a data poor region. A hybrid simulated method considering nonlinear site response is used to generate potential ground motions in Tianjin area. The synthetic database containing a total of 9267 ground motion records from 93 simulated earthquake events are utilized to develop the model. A back propagation neural network developed by genetic algorithm (GA-BPNN) is used to obtain the optimal weights and biases that most fit the target dataset without overfitting. The structure of GA-BPNN model consists of 322 unknowns including weights and biases that connect input and output parameters. The model is developed to predict PGA and 5% damped spectral acceleration (periods from 0.01 to 10 s). The input parameters consist of moment magnitude (Mw), strike (φ), dip (δ), rake angle (λ), focal depth (h), epicenter distance (R) and azimuth (θ). The model performance is observed to be within the appropriate error limits. It is found that the model has the ability to capture the parametric variation relationship. Additionally, the synthetically based model is compared with empirically based GMM relations derived from NGA-West2, finding it has similar performance and behavior to leading GMMs. The model application in Tianjin area demonstrates that this paper provides a scheme to utilize synthetic database and build GMMs in data poor regions. [ABSTRACT FROM AUTHOR]

This paper is about the opposite of judgement and calculation. This opposition has been a traditional anchor of critiques concerned with the rise of AI decision making over human judgement. Contrary to these approaches, it is argued that human judgement is not and cannot be replaced by calculation, but that it is human judgement that contextualises computational structures and gives them meaning and purpose. The article focuses on the epistemic structure of algorithms and artificial neural networks to find that they always depend on human judgement to be related to real life objects or purposes. By introducing the philosophical concept of judgement, it becomes clear that the property of judgement to provide meaning and purposiveness is based on the temporality of human life and the ambiguity of language, which quantitative processes lack. A juxtaposition shows that calculations and clustering can be used and referred to in more or less prejudiced and reflecting as well as opaque and transparent ways, but thereby always depend on human judgement. The paper clearly asserts that the transparency of AI is necessary for their autonomous use. This transparency requires the explicitness of the judgements that constitute these computational structures, thereby creating an awareness of the conditionality of such epistemic entities. [ABSTRACT FROM AUTHOR]

Deep neural networks are extensively used in text mining and Natural Language Processing is to enable computers to understand, analyze, and generate natural language data, such as text or speech, but semantic resources, such as taxonomies and ontologies, are not fully included in deep learning. In this paper, we use Deep Convolutional Neural Network (Deep CNN) to classify research papers using the Computer Science Ontology, an ontology of research areas in the field of computer science. It takes as input the abstract and keywords of a particular research paper and returns the relevant research topic. To evaluate our ontology, we used a gold standard dataset that includes research articles. To further improve text classification results, we propose to design a Deep CNN model. We then used ontology matching to reduce the classes and get better results. Experimental results show that the proposed approach outperforms the one with the highest precision, recall, and F1-score. [ABSTRACT FROM AUTHOR]

One key frontier of artificial intelligence (AI) is the ability to comprehend research articles and validate their findings, posing a magnanimous problem for AI systems to compete with human intelligence and intuition. As a benchmark of research validation, the existing peer-review system still stands strong despite being criticized at times by many. However, the paper vetting system has been severely strained due to an influx of research paper submissions and increased conferences/journals. As a result, problems, including having insufficient reviewers, finding the right experts, and maintaining review quality, are steadily and strongly surfacing. To ease the workload of the stakeholders associated with the peer-review process, we probed into what an AI-powered review system would look like. In this work, we leverage the interaction between the paper's full text and the corresponding peer-review text to predict the overall recommendation score and final decision. We do not envisage AI reviewing papers in the near future. Still, we intend to explore the possibility of a human–AI collaboration in the decision-making process to make the current system FAIR. The idea is to have an assistive decision-making tool for the chairs/editors to help them with an additional layer of confidence, especially with borderline and contrastive reviews. We use a deep attention network between the review text and paper to learn the interactions and predict the overall recommendation score and final decision. We also use sentiment information encoded within peer-review texts to guide the outcome further. Our proposed model outperforms the recent state-of-the-art competitive baselines. We release the code of our implementation here: https://github.com/PrabhatkrBharti/PEERRec.git. [ABSTRACT FROM AUTHOR]

Accurate prediction of sea level height is critically important for the government in assessing sea level risk in coastal areas. However, due to the nonlinear, time-varying and highly uncertain characteristics of sea level change data, sea level prediction is challenging. To improve the accuracy of sea level prediction, this paper uses a new swarm intelligence algorithm named the sparrow search algorithm (SSA), which can imitate the foraging behavior and antipredation behavior of sparrows, to determine optimal solutions. To avoid the algorithm falling into a local optimal situation, this paper integrates the sine–cosine algorithm and the Cauchy variation strategy into the SSA to obtain an algorithm named the SCSSA. The SCSSA is used to optimize the parameter values of the CNN-BiLSTM (convolutional neural network combined with bidirectional long short-term memory neural network) model; finally, a combined neural network model (named SCSSA-CNN-BiLSTM) is proposed. In this paper, the time series data of seven tidal stations located in coastal China are used for experimental analysis. First, the SCSSA-CNN-BiLSTM model is compared with the CNN-BiLSTM model to predict the time series data of SHANWEI Station. With respect to the training and test sets of data, the SCSSA-CNN-BiLSTM model outperforms the other models on all the evaluation metrics. In addition, the remaining six tide station datasets and five neural network models, including the SCSSA-CNN-BiLSTM model, are used to further study the performance of the proposed prediction model. Four evaluation indices including the root mean squared error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE) and coefficient of determination (R2) are adopted. For six stations, the RMSE, MAE, MAPE and R2 of SCSSA-CNN-BiLSTM model are ranged from 20.9217 ~ 27.8427 mm, 9.4770 ~ 17.8603 mm, 0.1322% ~ 0.2482% and 0.9119 ~ 0.9759, respectively. The experimental analysis results show that the SCSSA-CNN-BiLSTM model makes effective predictions at all stations, and the prediction performance is better than that of the other models. Even though the combination of SCSSA algorithm may increase the complexity of the model, indeed the proposed model is a new prediction method with good accuracy and robustness for predicting sea level change. [ABSTRACT FROM AUTHOR]

With the ongoing integration of information technology and industrialization, strategic emerging industries are becoming an increasingly important force in guiding future economic and social development. As one of the strategic emerging industries' development priorities and a replacement for scarce labor resources, industrial robots will be widely used in labor-intensive industries. It is a contentious topic how to evaluate and improve robot knowledge education. There are modular features introduced in this paper, which builds a modular network for the evaluation of robot knowledge education quality and enhances the cognitive computing ability of artificial neural networks and their ability to process complex information. A modular neural network-based model of feature combination robot knowledge education quality evaluation is developed based on the three aspects of module division method, subnet structure selection, and feature combination output. The following are some of the paper's most important contributions: K-OD algorithm of density clustering optimized by K-means is proposed. Because of its high level of modularized partition simulating, this method has an excellent clustering effect, and it identifies the core points, boundary points, as well as outliers. Using K-OD algorithm, the calculation of density radius and threshold is optimized by using density clustering, which reduces the overall computational complexity. Find out how SOM neural networks learn from competition. SOM network's competition layer neuron weights are prone to falling into local optimal solutions, so an SASOM neural network with weight adjustment simulated by an annealing algorithm is proposed to address this issue. It is more accurate in terms of prediction and error, and it is better at identifying sample attribute features. This work builds a modular neural network for evaluating robot knowledge education quality using K-OD clustering algorithm and SASOM neural network, which introduces the simulated annealing mechanism. [ABSTRACT FROM AUTHOR]

The paramount concern of highly accurate energy-efficient computing in machines with significant cognitive capabilities aims to enhance the accuracy and efficiency of bio-inspired Spiking Neural Networks (SNNs). This paper addresses this main objective by introducing a novel spatial power spike-timing-dependent plasticity (Spatial-Pow-STDP) learning rule as a digital block with high accuracy in a bio-inspired SNN model. Motivated by the demand for precise and accelerated computation that reduces high-cost resources in neural network applications, this paper presents a methodology based on COordinate Rotation DIgital Computer (CORDIC) definitions. The proposed designs of CORDIC algorithms for exponential (Exp CORDIC), natural logarithm (Ln CORDIC), and arbitrary power function (Pow CORDIC) are meticulously detailed and evaluated to ensure optimal acceleration and accuracy, which respectively show average errors near 10–9, 10–6, and 10–5 with 4, 4, and 6 iterations. The engineered architectures for the Exp, Ln, and Pow CORDIC implementations are illustrated and assessed, showcasing the efficiency achieved through high frequency, leading to the introduction of a Spatial-Pow-STDP learning block design based on Pow CORDIC that facilitates efficient and accurate hardware computation with 6.93 × 10–3 average error with 9 iterations. The proposed learning mechanism integrates this structure into a large-scale spatiotemporal SNN consisting of three layers with reduced hyper-parameters, enabling unsupervised training in an event-based paradigm using excitatory and inhibitory synapses. As a result, the application of the developed methodology and equations in the computational SNN model for image classification reveals superior accuracy and convergence speed compared to existing spiking networks by achieving up to 97.5%, 97.6%, 93.4%, and 93% accuracy, respectively, when trained on the MNIST, EMNIST digits, EMNIST letters, and CIFAR10 datasets with 6, 2, 2, and 6 training epochs. [ABSTRACT FROM AUTHOR]

The number of papers on machine learning and deep neural networks applied to intrusion detection systems (IDS) is ever-increasing. Differently from existing work on the topic, this paper explores the effect of training-time randomness of deep neural networks, which is overlooked by the related literature. Training-time randomness is regulated by the seed of the pseudorandom number generator, and affects the performance of IDS models. The seed selection is studied in conjunction with other critical learning parameters: to the best of our knowledge, there are no similar studies in IDS. The experiments are done with a recent and widely consolidated intrusion detection benchmark, which is used to train and test a neural network under different combinations of seeds and parameters both in supervised and semi-supervised learning modes. The results are inferred by a mixture of explorative analysis, design of experiments, and analysis of variance. According to the results, the choice of the seed yields either excellent or scarce detection metrics; more importantly, the seed selection might be as relevant as the other major learning parameters assessed. [ABSTRACT FROM AUTHOR]

Super-computing or HPC clusters are built to provide services to execute computationally complex applications. Generally, these HPC applications involve large scale IO (input/output) processing over the networked parallel file system disks. They are commonly developed on top of the C/C++ based MPI standard library. The HPC clusters MPI–IO performance significantly depends on the particular parameter value configurations, not generally considered when writing the algorithms or programs. Therefore, this leads to poor IO and overall program performance degradation. The IO is mostly left to individual practitioners to be optimised at code level. This usually leads to unexpected consequences due to IO bandwidth degradation which becomes inevitable as the file data scales in size to petabytes. To overcome the poor IO performance, this research paper presents an approach for auto-tuning of the configuration parameters by forecasting the MPI–IO bandwidth via artificial neural networks (ANNs), a machine learning (ML) technique. These parameters are related to MPI–IO library and lustre (parallel) file system. In addition to this, we have identified a number of common configurations out of numerous possibilities, selected in the auto-tuning process of READ/WRITE operations. These configurations caused an overall READ bandwidth improvement of 65.7% with almost 83% test cases improved. In addition, the overall WRITE bandwidth improved by 83% with number of test cases improved by almost 93%. This paper demonstrates that by using auto-tuning parameters via ANNs predictions, this can significantly impact overall IO bandwidth performance. [ABSTRACT FROM AUTHOR]

In this paper, we address the problem of spatially-varying illumination-aware indoor harmonization. Existing image harmonization works either focus on extracting no more than 2D information (e.g., low-level statistics or image filters) from the background image or rely on the non-linear representations of deep neural networks to adjust the foreground appearance. However, from a physical point of view, realistic image harmonization requires the perception of illumination at the foreground position in the scene (i.e., Spatially-Varying (SV) illumination), especially for indoor scenes. To solve indoor harmonization, we present a novel learning-based framework, which attempts to mimic the physical model of image formation. The proposed framework consists of a new neural harmonization architecture with four compact neural modules, which jointly learn SV illumination, shading, albedo, and rendering. In particular, a multilayer perceptron-based neural illumination field is designed to recover the illumination with finer details. Besides, we construct the first large-scale synthetic indoor harmonization benchmark dataset in which the foreground focuses on humans and is rendered and perturbed by SV illuminations. An object placement formula is also derived to ensure that the foreground object is placed in the background at a reasonable size. Extensive experiments on synthetic and real data demonstrate that our proposed approach achieves better results than prior works. [ABSTRACT FROM AUTHOR]

The increasing reliance on internet-based services has heightened the vulnerability of network infrastructure to cyberattacks, particularly distributed denial of service (DDoS) attacks. These attacks can cause severe disruptions and significant financial losses. Early detection of malicious traffic is crucial in effectively combating such threats. This paper presents an innovative approach called the Encoder-Stacked deep neural networks (E-SDNN) model, which leverages Stacked/bagged multi-layer perceptrons (MLP) for accurate DDoS attack detection. The proposed method employs an encoder to select pertinent features from a preprocessed dataset, enabling precise attack detection. Extensive experiments were conducted on benchmark cybersecurity datasets, namely CICDS2017 and CICDDoS2019, encompassing various DDoS attack scenarios. The experimental results demonstrate the superiority of the E-SDNN model compared to state-of-the-art methods. The proposed E-SDNN model achieved an impressive overall accuracy rate of 99.94% and 98.86% for CICDDS2017 and CICDDoS2019, respectively. [ABSTRACT FROM AUTHOR]

One of the focal points in the field of intelligent transportation is the intelligent control of traffic signals (TS), aimed at enhancing the efficiency of urban road networks through specific algorithms. Deep Reinforcement Learning (DRL) algorithms have become mainstream, yet they suffer from inefficient training sample selection, leading to slow convergence. Additionally, enhancing model robustness is crucial for adapting to diverse traffic conditions. Hence, this paper proposes an enhanced method for traffic signal control (TSC) based on DRL. This approach utilizes dueling network and double q-learning to alleviate the overestimation issue of DRL. Additionally, it introduces a priority sampling mechanism to enhance the utilization efficiency of samples in memory. Moreover, noise parameters are integrated into the neural network model during training to bolster its robustness. By representing high-dimensional real-time traffic information as matrices, and employing a phase-cycled action space to guide the decision-making of intelligent agents. Additionally, utilizing a reward function that closely mirrors real-world scenarios to guide model training. Experimental results demonstrate faster convergence and optimal performance in metrics such as queue length and waiting time. Testing experiments further validate the method's robustness across different traffic flow scenarios. [ABSTRACT FROM AUTHOR]

This paper presents a method to perform the real-time creation of models that are used to represent aspects of tracked objects in video frames. Object modeling is done during the task of tracking previously unseen selected objects, and both tracking and model creation are implemented using the WiSARD weightless neural network and occur in real time, starting from no prior knowledge. The main purpose of this work is to track an object through camera images and, simultaneously, create a model that describes the presented appearances along with the transitions between each learned aspect. To achieve this goal, an object tracker based on the ClusWiSARD weightless neural network model was used to determine the states that describe the observed objects. In this way, it is possible to obtain a system that capture knowledge about the visual structures of the learned objects, creating relationships between the possible appearances, and being able to transit over the model aspects in an appropriate way. Furthermore, the created models have visual representations that can be used to show the learned aspects and validate the state transitions, in addition to being able to visualize occluded parts of objects. [ABSTRACT FROM AUTHOR]

Once realized, autonomous aerial refueling will revolutionize unmanned aviation by removing current range and endurance limitations. Previous attempts at establishing vision-based solutions have come close but rely heavily on near perfect extrinsic camera calibrations that often change midflight. In this paper, we propose dual object detection, a technique that overcomes such requirement by transforming aerial refueling imagery directly into receiver aircraft reference frame probe-to-drogue vectors regardless of camera position and orientation. These vectors are precisely what autonomous agents need to successfully maneuver the tanker and receiver aircraft in synchronous flight during refueling operations. Our method follows a common 4-stage process of capturing an image, finding 2D points in the image, matching those points to 3D object features, and analytically solving for the object pose. However, we extend this pipeline by simultaneously performing these operations across two objects instead of one using machine learning and add a fifth stage that transforms the two pose estimates into a relative vector. Furthermore, we propose a novel supervised learning method using bounding box corrections such that our trained artificial neural networks can accurately predict 2D image points corresponding to known 3D object points. Simulation results show that this method is reliable, accurate (within 3 cm at contact), and fast (45.5 fps). [ABSTRACT FROM AUTHOR]

Parkinson's disease (PD) is a condition that degenerates over time and impairs speech and pronunciation because brain cells have died. This research work aims to predict parkinson disease using the voice features extracted from speech signals recorded from PD individuals with dysphonic speech disorders by employing deep learning algorithms. PD is challenging to diagnose early on in the clinical presentation. To address the issue in machine learning methods, this paper proposes a neural network model by processing speech signals to classify PD using the University of California Irvine (UCI) machine learning repository dataset. Initially, a pre-loss reduction module is created by using pre-sampling to make the dataset balanced by reducing the dimensionality and maintaining the size of the space without influencing the learning process for data preparation. The relevant features are derived using a novel multi-agent salp swarm (MASS) algorithm, and a novel Parkinson classification neural network (PCNN) is proposed to classify Parkinson's patients with high accuracy employing these derived features. The result shows that the models that use MASS-PCNN produce higher classification accuracy of 99.1%, precision of 97.8%, recall of 94.7% and F1-score of 0.995 when paralleled to the existing models. As an outcome, the suggested model will perform superior to common convolutional neural networks. [ABSTRACT FROM AUTHOR]

Spectroscopic techniques generate one-dimensional spectra with distinct peaks and specific widths in the frequency domain. These features act as unique identities for material characteristics. Deep neural networks (DNNs) has recently been considered a powerful tool for automatically categorizing experimental spectra data by supervised classification to evaluate material characteristics. However, most existing work assumes balanced spectral data among various classes in the training data, contrary to actual experiments, where the spectral data is usually imbalanced. The imbalanced training data deteriorates the supervised classification performance, hindering understanding of the phase behavior, specifically, sol-gel transition (gelation) of soft materials and glycomaterials. To address this issue, this paper applies a novel data augmentation method based on a generative adversarial network (GAN) proposed by the authors in their prior work. To demonstrate the effectiveness of the proposed method, the actual imbalanced spectral data from Pluronic F-127 hydrogel and Alpha-Cyclodextrin hydrogel are used to classify the phases of data. Specifically, our approach improves 8.8%, 6.4%, and 6.2% of the performance of the existing data augmentation methods regarding the classifier's F-score, Precision, and Recall on average, respectively. Specifically, our method consists of three DNNs: the generator, discriminator, and classifier. The method generates samples that are not only authentic but emphasize the differentiation between material characteristics to provide balanced training data, improving the classification results. Based on these validated results, we expect the method's broader applications in addressing imbalanced measurement data across diverse domains in materials science and chemical engineering. [ABSTRACT FROM AUTHOR]

The prevalence of cardiovascular disease (CVD) has surged in recent years, making it the foremost cause of mortality among humans. The Electrocardiogram (ECG), being one of the pivotal diagnostic tools for cardiovascular diseases, is increasingly gaining prominence in the field of machine learning. However, prevailing neural network models frequently disregard the spatial dimension features inherent in ECG signals. In this paper, we propose an ECG autoencoder network architecture incorporating low-rank attention (LRA-autoencoder). It is designed to capture potential spatial features of ECG signals by interpreting the signals from a spatial perspective and extracting correlations between different signal points. Additionally, the low-rank attention block (LRA-block) obtains spatial features of electrocardiogram signals through singular value decomposition, and then assigns these spatial features as weights to the electrocardiogram signals, thereby enhancing the differentiation of features among different categories. Finally, we utilize the ResNet-18 network classifier to assess the performance of the LRA-autoencoder on both the MIT-BIH Arrhythmia and PhysioNet Challenge 2017 datasets. The experimental results reveal that the proposed method demonstrates superior classification performance. The mean accuracy on the MIT-BIH Arrhythmia dataset is as high as 0.997, and the mean accuracy and F 1 -score on the PhysioNet Challenge 2017 dataset are 0.850 and 0.843. [ABSTRACT FROM AUTHOR]

The paper explores the possibilities of using data classification methods when forecasting time series of the geomagnetic Kp-index by machine learning methods. To classify categories of the Kp-index based on the degree of disturbance, linear and logistic regression, random forest, gradient boosting on top of decision trees, and artificial neural networks of various architectures are used. The results of these methods are compared with a trivial inertial forecast (the statistical indicators of which for problems of this type are always high) at horizons from 3 h to 1 day in 3-h increments. The problem of choosing a cross-validation scheme for selecting the model hyperparameters, ways to overcome the imbalance of categories, the relative importance of input features, as well as the dependence of the results on the test sample (beginning of the 25th solar activity cycle) on inclusion in the training sample of data from the 23rd and 24th cycles or only the 24th cycles are studied. Based on the results, conclusions are drawn about the preferred methods for classifying values of the Kp-index based on the level of geomagnetic disturbance. Ways for further research and possible improvement of the classification quality are outlined, including for determining the characteristic hidden states of Earth's magnetosphere as a dynamic system in order to improve the quality of forecasting geomagnetic indices. [ABSTRACT FROM AUTHOR]

In this paper, a novel machine-learning based models are presented to predict the effect of notch depth on elastic new strain-concentration factor of rectangular bars with single edge U-notch under combined loading of static tension and pure bending. Regarding the importance of this study, the database with 162 samples is utilized to develop the new methodology of machine learning based models. The database includes the notch radius, the Poisson's ratio, and the thick ratio that represent the influential inputs. The predicted key feature is the elastic new strain-concentration factor under combined loading of static tension and pure bending. These samples were tested with high precision and the predicted values of SNCF were obtained. For comparison, adaptive neural fuzzy inference system, artificial neural network, fine tree, ensemble boosted tree, and ensemble optimized bagged tree were designed and developed in this study. To evaluate and compare the performance of the models, four statistical indices of MAE, MSE, root mean square error (RMSE)and determination coefficient (R) were utilized. Based on the results, all models can predict the SNCF appropriately. However, the Ensemble optimized Bagged tree model had a better performance than other models and it had a significant priority in term of prediction accuracy. Finally, the results indicated that the elastic SNCF increased with increasing notch depth from 0.2 ≤ ho/Ho ≤ 0.7 and sharply decreases with increasing notch depth for shallow notches (0.8 ≤ ho/Ho ≤ 0.95). [ABSTRACT FROM AUTHOR]

Rock strength parameters such as uniaxial compressive strength and modulus of elasticity are crucial parameters in designing rock engineering structures. Owing to the importance of the aforementioned parameters, in this paper, image processing technique is coupled with artificial neural network (ANN) method for assessing the uniaxial compressive strength and modulus of elasticity of sandstones. For this reason, 102 core sandstone samples were prepared. Subsequently petrographic analyses and imaging operation for 102 images were performed. Principal component analysis was then conducted for feature reduction purposes. At last, an ANN model, which received its input data from image processing technique, was constructed for assessing the UCS and E of sandstone samples. Overall, the best performance of the network was obtained when 10 hidden nodes were used. The correlation coefficient (R) values of 0.9722 and 0.97062 for UCS and E, respectively, suggest the feasibility of the proposed model. [ABSTRACT FROM AUTHOR]

Recurrent neural networks (RNNs) are widely utilized in neural network research to capture spatiotemporal features in video data. However, their effectiveness heavily relies on the spatial features upon which they trained. This paper introduces innovative ensembles of features for constructing frame-wise structures by employing impactful neural network models with innovative training pipelines. These features are designed to enhance the recognition of hand gesture videos using RNN by leveraging temporal information. Recognizing hand gestures from videos is a complex task that presents considerable challenges. One notable challenge is the overlap in gesture motion, where different gesture categories exhibit similar hand poses within a single video clip. To overcome this issue, we were motivated to develop extensive and diverse features that offer a more comprehensive description of the gesture video clips, thereby mitigating recognition problems caused by images overlapping. Overall, our efforts to generate diverse features have yielded promising results in enhancing the recognition of hand gestures from videos, particularly in scenarios where overlap poses a significant challenge. We have combined the extracted features from a deep neural network trained from scratch with features obtained from various standard neural networks (Self-Organizing Map, Radial Base Function) that are trained to enhance the deep-trained features. The mutual arrangement for combining the shared features has configured new frame-wise image features. Furthermore, we have provided a performance comparison of the newly constructed frame-wise features through time-sharing to train RNN for recognition. The proposed models have been evaluated on two-hand gesture video datasets, where a preserving gesture sequence is crucial due to overlapping motions. Our work demonstrates a significant improvement in performance for both datasets. [ABSTRACT FROM AUTHOR]

There has been extensive evidence demonstrating that deep neural networks are vulnerable to adversarial examples, which motivates the development of defenses against adversarial attacks. Existing adversarial defenses typically improve model robustness against individual specific perturbation types (e.g., ℓ ∞ -norm bounded adversarial examples). However, adversaries are likely to generate multiple types of perturbations in practice (e.g., ℓ 1 , ℓ 2 , and ℓ ∞ perturbations). Some recent methods improve model robustness against adversarial attacks in multiple ℓ p balls, but their performance against each perturbation type is still far from satisfactory. In this paper, we observe that different ℓ p bounded adversarial perturbations induce different statistical properties that can be separated and characterized by the statistics of Batch Normalization (BN). We thus propose Gated Batch Normalization (GBN) to adversarially train a perturbation-invariant predictor for defending multiple ℓ p bounded adversarial perturbations. GBN consists of a multi-branch BN layer and a gated sub-network. Each BN branch in GBN is in charge of one perturbation type to ensure that the normalized output is aligned towards learning perturbation-invariant representation. Meanwhile, the gated sub-network is designed to separate inputs added with different perturbation types. We perform an extensive evaluation of our approach on commonly-used dataset including MNIST, CIFAR-10, and Tiny-ImageNet, and demonstrate that GBN outperforms previous defense proposals against multiple perturbation types (i.e., ℓ 1 , ℓ 2 , and ℓ ∞ perturbations) by large margins. [ABSTRACT FROM AUTHOR]

Safe and efficient navigation is critical for a mobile robot in a highly constrained workspace. Autonomous navigation is to be performed safely and robustly in the environment map with obstacles of various geometric shapes, sizes and colors positioned at random locations. In this paper, we present an approach to perform autonomous navigation by detecting the obstacles in the map and by generating auxiliary collision-free waypoints in obstacle-free space map. In achieving this, the object detection is done using SSDMobileNetV2 model and auxiliary collision-free navigation waypoints are generated using the Deepway neural network model. Further, the RRT path planner is applied to analyze the waypoints generated and to find the a global path between start and goal locations. An optimal local path is achieved using the A* path planner. Extensive simulations of various scenarios are performed and the proposed model is evaluated. The results reveal that the proposed model achieves significant improvements in terms of time, distance and F1-score. [ABSTRACT FROM AUTHOR]

The automotive S-rail plays a crucial role in frontal car crashes, aiming to absorb impact energy and reduce passenger injury. This paper innovatively presents an optimization approach to determine the optimal configuration of an S-rail featuring a tapered, multicell front section. The structural design of the S-rail is conceptualized within the design space of a heavy quadricycle vehicle and subsequently subjected to numerical investigation through LS-DYNA using nonlinear explicit dynamics analyses. The objective is to maximize energy absorption while minimizing the S-rail's initial peak force (IPF) and mass. An artificial neural network (ANN) is employed to construct surrogate models for the optimization process. The non dominated sorting genetic algorithm, integrated with the ANN, yields an optimal S-rail design. The Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) method, using the mean weighting method on the Pareto frontier optimal solution set, is appropriately applied to select the optimal solution. The optimized S-rail shows improved specific energy absorption compared to the baseline model while maintaining a low IPF. In conclusion, this study highlights the superior predictability of an ANN over conventional quadratic response surface methodology. The results confirm the effectiveness of the ANN-based optimization approach and the selection of a compromise solution using the TOPSIS technique. The proposed procedure has substantial potential to enhance the safety and performance of automotive S-rails. [ABSTRACT FROM AUTHOR]

In recent years, Model Predictive Torque Control (MPTC) has gained popularity as a powerful method of controlling Induction Motors (IMs). There are, however, some factors such as the weighted coefficient that must be taken into account to attain satisfactory performance at different operation points for stator flux. As of now, an empirical procedure has been used for tuning the weighting factor in MPTC, which is not as effective. Model Predictive Flux Control (MPFC) is proposed in this paper, which eliminates complicated process of predicting the stator current by using the flux vectors as control variables. In order to get over these obstacles, a novel Model Predictive Control (MPC) method utilizing a Cascaded Artificial Neural Network (ANN) is proposed in this research. As a result, the control complexity is diminished and weighting factor in standard MPTC is eliminated. In-depth evaluations and comparisons of MPTC and MPFC are conducted, covering low-speed function, dynamic response, and steady-state performance. In contract to traditional approaches, the preferred method has much lower computational cost, virtuous dynamic response, and superior steady-state performance. The overall proposed work is simulated using MATLAB/SIMULINK platform and experimental tests performed on 3Φ VSI fed IM drives are used to verify the efficacy of proposed approach. [ABSTRACT FROM AUTHOR]

This paper presents improved single- and multi-objective algorithms based on the original moth flame optimizer (MFO) to tackle the dynamic economic emission dispatch (DEED) problem that affects power systems operations. The DEED problem is a multi-objective optimization problem that is strongly constrained, multi-dimensional, nonlinear, and non-convex. It comprises several optimization criteria, many of which are in direct opposition to one another; therefore, no one solution is optimal with regard to all of those criteria. Firstly, an enhanced flame generation strategy is incorporated into the MFO algorithm to improve performance. Then, the improved MFO is combined with the crowding distance mechanism and non-dominated sorting framework to enhance the convergence rate and the quality of the results. This helps improve the convergence pace. Firstly, the proposed multi-objective moth flame optimizer (MOMFO) algorithm is validated using 15 ZDT and UF benchmark multi-objective test functions. Then, the nonlinear DEED problem is also solved by determining the feasible optimal solution using the MOMFO algorithm. The implementation of the MOMFO on 10-unit systems and the IEEE 30-bus test system is being done to display the ability to solve a nonlinear, non-convex, and constrained DEED optimization problem. The DEED problem is solved using the MOMFO algorithm and other state-of-the-art algorithms, such as the non-dominated sorting genetic algorithm-II (NSGA-II), the multi-objective teaching–learning-based optimization (MOTLBO) algorithm, and multi-objective reptile search algorithm (MORSA). The selection of the control parameters of the MOMFO can be decided from the algorithm's findings on different IEEE bus systems. This study also introduces a new technique for incorporating loss predictions using artificial neural networks into the DEED model. During each phase of the dispatch time, the trained neural network can make only a single forecast of the transmission loss. The performance of MOMFO is compared with NSGA-II, MOTLBO, and MORSA, and the results obtained for both benchmarks and DEED proved the superiority of the proposed algorithm in solving the DEED of the power systems. [ABSTRACT FROM AUTHOR]

This research paper aims to ensure the reliable and efficient operation of grid-connected solid-state transformers (SSTs) by detecting and evaluating various undesirable operating conditions. The study considers different types of faults, including internal faults like open switches and open capacitors, external faults such as symmetrical and asymmetrical faults occurring at various locations of the SST, and abnormalities on the grid side known as sympathetic inrush conditions. To analyze these operating conditions, the secondary current of the high-frequency transformer is normalized and decomposed using the discrete wavelet transform (DWT) and wavelet packet transform (WPT). From the DWT and WPT decomposition at multiple levels, several statistical parameters are calculated. These statistical parameters are carefully selected from different decomposition levels to enhance the effectiveness of the detection algorithm utilizing DWT and WPT. In order to quickly identify and classify all operating conditions that impact the performance of the grid-connected SST, a three-layer feedforward artificial neural network (ANN) is employed, using the selected statistical features. The accuracy and efficiency of the ANN-based classification approach are evaluated by assessing the effectiveness of the statistical features obtained from DWT and WPT. Simulation results have been altered by introducing various noise levels to systematically assess the performance of the proposed algorithms. The average accuracy of the DWT-ANN algorithm stands at 97.89%, while the WPT-ANN algorithm achieves a slightly elevated accuracy level of 98.01%. This notable similarity in accuracy curtails from the careful selection of the wavelet function, decomposition level, and feature sets. [ABSTRACT FROM AUTHOR]

Aiming to solve the problems of multiple internal power components, high fault probability, high similarity of the fault features of different power components, difficulty of traditional fault diagnosis feature extraction and low accuracy of fault identification in high-voltage multilevel cascaded H-bridge inverters, this paper presents a fault diagnosis method based on an attention-parallel multisource data fusion residual network. First, a parallel residual neural network model is established, and the extracted multilevel three-phase voltage before filtering and the three-phase current waveform after filtering are converted into two-dimensional image data using a wavelet transform. Subsequently, a feature fusion module is integrated into the network structure to adaptively extract features at different network levels. This module locates key features using the attention mechanism. Then, it fuses useful fault information into feature images using the feature fusion mechanism, enhancing the feature representation capability of the network. Finally, the fault features extracted by the feature fusion module undergo the complete convolution operation. The final enhanced features are used as classification features and classified using a softmax layer. Experimental results demonstrate that the proposed method exhibits high fault diagnosis accuracy and adaptability. [ABSTRACT FROM AUTHOR]

Establishing a reliable credit card fraud detection model has become a primary focus for academia and the financial industry. The existing anti-fraud methods face challenges related to low recall rates, inaccurate results, and insufficient causal modeling ability. This paper proposes a credit card fraud detection model based on counterfactual data enhancement of the triplet network. Firstly, we convert the problem of generating optimal counterfactual explanations (CFs) into a policy optimization of agents in the discrete–continuous mixed action space, thereby ensuring the stable generation of optimal CFs. The triplet network then utilizes the feature similarity and label difference of positive example samples and CFs to enhance the learning of the causal relationship between features and labels. Experimental results demonstrate that the proposed method improves the accuracy and robustness of the credit card fraud detection model, outperforming existing methods. The research outcomes are of significant value for both credit card anti-fraud research and practice while providing a novel approach to causal modeling issues across other fields. [ABSTRACT FROM AUTHOR]

This paper presents an analysis and prediction of the shear strength of wide-shallow reinforced concrete beams, utilizing Finite Element Analysis (FEA) and machine learning techniques. The methodology involves validating a detailed Finite Element Model (FEM) against experimental results, conducting a parametric study, and developing three Machine Learning prediction equations. The FEM captures concrete and steel behaviors, including cracking and crushing for concrete and linear isotropic properties for steel reinforcement. Loading and boundary conditions are defined for accuracy and validated against 13 experimental specimens, exhibiting a maximum 8% and 12% difference in loads and deflections, respectively. A parametric study generates a dataset of 77 wide beam configurations, exploring variations in beam widths, concrete strengths, compression rebars, and shear reinforcement. This dataset is used to develop machine learning models, including "Genetic Programming (GP)", "Evolutionary Polynomial Regression (EPR)", and "Artificial Neural Network (ANN)". Comparative analysis reveals GP and EPR models with over 95% correlation, while the ANN model outperforms with 99% accuracy. Sensitivity analysis underscores the significant influence of concrete strength and beam aspect ratio on shear strength. In conclusion, the study demonstrates the potential of FEA and machine learning models to predict shear strength in wide-shallow reinforced concrete beams, providing valuable insights for architectural design and engineering practices and emphasizing the role of concrete strength and beam geometry in shear behavior. [ABSTRACT FROM AUTHOR]

Designing implants for large and complex cranial defects is a challenging task, even for professional designers. Current efforts on automating the design process focused mainly on convolutional neural networks (CNN), which have produced state-of-the-art results on reconstructing synthetic defects. However, existing CNN-based methods have been difficult to translate to clinical practice in cranioplasty, as their performance on large and complex cranial defects remains unsatisfactory. In this paper, we present a statistical shape model (SSM) built directly on the segmentation masks of the skulls represented as binary voxel occupancy grids and evaluate it on several cranial implant design datasets. Results show that, while CNN-based approaches outperform the SSM on synthetic defects, they are inferior to SSM when it comes to large, complex and real-world defects. Experienced neurosurgeons evaluate the implants generated by the SSM to be feasible for clinical use after minor manual corrections. Datasets and the SSM model are publicly available at https://github.com/Jianningli/ssm. [ABSTRACT FROM AUTHOR]

The application of deep neural network has achieved remarkable success in object detection. However, the network structures should be still evolved consistently and tuned finely to acquire better performance. This gears to the continuous demands on high performance in those complex scenes, where multi-scale objects to be detected are located here and there. To this end, this paper proposes a network structure called Multi-Scale Coupled Attention (MSCA) under the framework of self-attention learning with methodologies of importance assessment. Architecturally, it consists of a Multi-Scale Coupled Channel Attention (MSCCA) module, and a Multi-Scale Coupled Spatial Attention (MSCSA) module. Specifically, the MSCCA module is developed to achieve the goal of self-attention learning linearly on the multi-scale channels. In parallel, the MSCSA module is constructed to achieve this goal nonlinearly on the multi-scale spatial grids. The MSCCA and MSSCA modules can be connected together into a sequence, which can be used as a plugin to develop end-to-end learning models for object detection. Finally, our proposed network is compared on two public datasets with 13 classical or state-of-the-art models, including the Faster R-CNN, Cascade R-CNN, RetinaNet, SSD, PP-YOLO, YOLO v3, YOLO v5, YOLO v7, YOLOX, DETR, conditional DETR, UP-DETR and FP-DETR. Comparative experimental results with numerical scores, the ablation study, and the performance behaviour all demonstrate the effectiveness of our proposed model. [ABSTRACT FROM AUTHOR]

A neural network model needs to be manually designed for ancient mural dynasty recognition, and this paper proposes an ancient mural dynasty recognition algorithm that is based on a neural architecture search (NAS). First, the structural edge information of mural images is extracted for use by the neural network model in recognizing mural missions. Second, an NAS algorithm that is based on contrast selection (CS) simplifies the architecture search to an incremental CS and then searches for the optimal network architecture on the mural dataset. Finally, the identified optimal network architecture is used for training and testing to complete the mural dynasty recognition task. The results show that the top accuracy of the proposed method on the mural dataset is 88.10%, the recall rate is 87.52%, and the precision rate is 87.69%. Each evaluation index used by the neural network model is superior to that of classical network models such as AlexNet and ResNet-50. Compared with NAS methods such as ASNG and MIGO, the accuracy of mural dynasty recognition is higher by an average of 4.27% when using the proposed method. The proposed method is verified on CIFAR-10, CIFAR-100, ImageNet16-120 and other datasets and achieves a good recognition accuracy in the NAS-bench-201 search space, which averages 93.26%, 70.73% and 45.34%, respectively, on the abovementioned datasets. [ABSTRACT FROM AUTHOR]

The health management of railway signal equipment in the high-speed railway is a key link between intelligent operation and maintenance. Accurately predicting the health state of compensation capacitors is of great significance to ensure the reliable work of track circuits. This paper proposes an improved deep neural network algorithm focusing on the problem of long-term accurate health forecasts for compensation capacitors. First, establishing a transmission state model for degradation mechanism mining, the difference function that can quantitatively evaluate features is defined by piecewise processing cab signaling receiving voltage. Introducing the degradation model, predictive driving under both model and data is implemented. Then, the convolutional neural networks and bidirectional long–short-term memory are combined and improved to construct a novel artificial intelligence combination strategy, while parameters are optimized based on the sparrow search algorithm. Finally, facing the conditional repair of compensation capacitors, we set a reasonable threshold for the occurrence of hidden dangers to complete fault warning. This novel and practical approach effectively explores the procedure of prognosis and health management, while the refined maintenance will better utilize current monitoring information, helping the intelligence and accuracy of safety control decision-making. [ABSTRACT FROM AUTHOR]

Artificial Neural Networks (ANNs) have been used in a multitude of real-world applications given their predictive capabilities, and algorithms based on gradient descent, such as Backpropagation (BP) and variants, are usually considered for their optimisation. However, these algorithms have been shown to get stuck at local optima, and they require a cautious design of the architecture of the model. This paper proposes a novel memetic training method for simultaneously learning the ANNs structure and weights based on the Coral Reef Optimisation algorithms (CROs), a global-search metaheuristic based on corals' biology and coral reef formation. Three versions based on the original CRO combined with a Local Search procedure are developed: (1) the basic one, called Memetic CRO; (2) a statistically guided version called Memetic SCRO (M-SCRO) that adjusts the algorithm parameters based on the population fitness; (3) and, finally, an improved Dynamic Statistically-driven version called Memetic Dynamic SCRO (M-DSCRO). M-DSCRO is designed with the idea of improving the M-SCRO version in the evolutionary process, evaluating whether the fitness distribution of the population of ANNs is normal to automatically decide the statistic to be used for assigning the algorithm parameters. Furthermore, all algorithms are adapted to the design of ANNs by means of the most suitable operators. The performance of the different algorithms is evaluated with 40 classification datasets, showing that the proposed M-DSCRO algorithm outperforms the other two versions on most of the datasets. In the final analysis, M-DSCRO is compared against four state-of-the-art methods, demonstrating its superior efficacy in terms of overall accuracy and minority class performance. [ABSTRACT FROM AUTHOR]

In this paper, we study the post-hoc calibration of modern neural networks, a problem that has drawn a lot of attention in recent years. Despite the plethora of calibration methods proposed, there is no consensus yet on the inherent complexity of the task and, while some authors claim that simple functions solve the problem, others suggest that more expressive models are needed to capture misscalibration. As a first approach, we focus on the task of confidence scaling, specifically on post-hoc methods that generalize Temperature Scaling, which we refer to as the Adaptive Temperature Scaling family. We begin by demonstrating that while complex models like neural networks provide an advantage when there is ample data, they fail in scenarios where it is limited, notably common in fields like medical diagnosis. We then show how under this ideal data conditions the more expressive methods learn a relationship between the entropy of a prediction and its level of overconfidence, and based on this observation, we propose Entropy-based Temperature Scaling, a simple method that scales the confidence of a prediction according to this relationship. Results show that our method obtains state-of-the-art performance and is robust against data scarcity. Moreover, our proposed model enables a deeper understanding of the calibration process by the interpretation of the entropy as a measure of uncertainty in the network outputs. [ABSTRACT FROM AUTHOR]

This paper presents a new accurate method to compute the mechanical response of pavement structures using an Artificial Neural Network (ANN) model coupled with Multi-Layer Elastic Analysis (MLEA). The ANN model is used to improve the numerical integration of the response function used in the MLEA method. It requires four inputs: total pavement thickness, the diameter of the contact area, radial distance, and depth of the response point; and it was trained on one million hypothetical pavement structures. The developed method has been validated by a comparative analysis against boundary conditions, finite element analysis, and available MLEA solutions using various hypothetical pavement structures. The results demonstrate that the developed solution gives excellent response in the vicinity of the pavement surface together with a significant improvement in computational efficiency. [ABSTRACT FROM AUTHOR]

The paper studies the effectiveness of machine learning techniques in predicting the microhardness of composite materials manufactured from a mixture of iron-copper (Fe-Cu) nanopowders and hydroxyapatite (HA) particles. It is shown that the different proportion of Fe-Cu and HA powders and the polymer fraction in the composite significantly affect its hardness. A surrogate model based on the artificial neural network (ANN) and the analytical model, is proposed to quantitatively evaluate the microhardness, depending on the powder/polymer ratio. The ANN models show the probability distribution of indentation values after microhardness testing, which is the input data for the analytical model to compute the hardness. This approach can reduce the time and cost of the material research and minimizes the reliance on expensive materials and experimental equipment. [ABSTRACT FROM AUTHOR]

This paper introduces an innovative electrocardiogram (ECG ) denoising technique based on stationary wavelet transform ( S W T) and wavelet/total variation (WATV). In this technique, we also use two different artificial neural networks ( ANNs ) to determine two ideal thresholds, t h r 1 and t h r 2 . The latter is used for the soft thresholding of a noisy details coefficient, c d b 2 , to obtain a denoised coefficient, c d d 2 . The threshold t h r 1 is used for the soft thresholding of a noisy details coefficient, c d b 1 , yielding a denoised coefficient, c d d 1. The coefficient c d b 1 and a noisy approximation coefficient, c a b 1 , are obtained by applying SWT to the noisy ECG signal. The coefficient c d b 2 and another noisy approximation coefficient, c a b 2 , are obtained by applying SWT to c a b 1 . In this proposed ECG denoising system, we also apply a WATV-based denoising technique to c a b 2 to obtain a denoised approximation coefficient, c a d 2 . This WATV-based denoising technique requires the estimation of the level of the noise corrupting the clean ECG signal. This noise is additive Gaussian white noise (AGWN) and its level is denoted as σ , which is estimated from c d b 1 . After that, the inverse of SWT ( S W T - 1 ) is applied to c d d 2 and c a d 2 to obtain a denoised approximation coefficient, c a d 1 . Subsequently, we apply S W T - 1 to c d d 1 and c a d 1 to finally obtain the denoised ECG signal. The performance of this proposed ECG denoising technique is proven by the results obtained after computing the signal-to-noise ratio ( SNR ), the peak SNR ( PSNR ), the mean square error ( MSE ), the mean absolute error ( MAE ) and the cross-correlation ( CC ). [ABSTRACT FROM AUTHOR]

Quantum neural networks are neural network models based on the principles of quantum mechanics, a combination of the advantages of classical neural networks and quantum information, using quantum bits instead of neurons in classical neural networks and quantum gates instead of activation functions in classical neural networks. Immune algorithms are a class of algorithms based on the theory of artificial immune systems, which implement functions similar to the biological immune system in terms of antigen recognition, cell differentiation, memory and self-regulation, using a population search strategy and iterative computation to eventually obtain the optimal solution to the problem with a higher probability. Quantum neural networks, one of the most important approaches in the field of quantum machine learning, can be implemented by means of variational quantum circuits. However, the classification training accuracy of variational quantum algorithms is not very high. In this paper, we propose a variational shadow quantum neural network based on the immune optimisation algorithm to classify data in order to improve the training accuracy and also the training speed. Experiments show that the immune optimisation algorithm-based variational shadow quantum neural network can not only improve the training accuracy, but also the training speed. [ABSTRACT FROM AUTHOR]

This paper proposes a hybrid forecasting model combining auto-regressive integrated moving average (ARIMA) and artificial neural network (ANN) techniques to improve the software fault forecasting and hence improvising the reliability of software. Software reliability forecasting plays a critical role in software development and maintenance, as it helps to identify potential errors and improve the overall performance of software systems. The proposed model leverages the strengths of both ARIMA and ANN, allowing for more accurate predictions and better handling of complex and dynamic software systems. The effectiveness of the hybrid model is evaluated using real-world software data, demonstrating its superiority over traditional forecasting methods. This research contributes to the development of more robust and reliable software systems, which are essential in today's rapidly evolving technological landscape. [ABSTRACT FROM AUTHOR]

Recent research has shown the vulnerability of deep networks to adversarial perturbations. Adversarial training and its variants have been shown to be effective defense algorithms against adversarial attacks, enhancing the defense abilities of deep neural networks by training them to fit adversarial examples. However, the significant computational burden of generating strong adversarial examples has rendered the process time-consuming, presenting a challenge for efficient training. In this paper, we propose adversarial training with robust area (ATRA), a highly efficient variant of adversarial training. We experimentally find that certain pixels in the image play a crucial role in improving robust accuracy, which we refer to the collection of discrete pixels as the high-robust area. Based on the robust area of the input instance, ATRA generates adversarial examples by applying an adaptive perturbation. Furthermore, we investigate the transferability of the high-robust area during the attack iteration process and experimentally demonstrate its effectiveness. Therefore, ATRA has the advantage of reducing the additional cost of generating strong adversarial examples while maintaining model robustness. Our experimental results on MNIST, CIFAR10, and TinyImageNet show that our method outperforms current state-of-the-art baselines with significantly less additional training time required, especially on MNIST where our method requires 18 × less training time. Furthermore, our method also achieves good performance under different adversarial attacks such as FGSM, CW, and AutoAttack. [ABSTRACT FROM AUTHOR]