Search

Digital technologies sustain today's world. Every part of the world is working towards digital technologies, which none of us can eliminate. Enormous growth is achieved only by unexpected acceleration by digital technologies, including the Internet of Everything (IoE), Artificial Neural Networks (ANN), Machine Learning (ML), Internet of Things (IoT), Artificial Intelligence (AI), Deep Learning (DL), and many more. These technologies started occupying all the engineering sectors, including manufacturing. This paper focuses on tribology analysis related to manufacturing concerning various digital manufacturing technologies. The paper narration includes Tribology using digital technologies wherein the journals and patent landscape analysis abet them. In trend, Tribology utilizes all these technologies today and envisages its growth with the predominant technological invention in the border view. The survey of various literature reveals that only three digital technologies, including AI, ML, and ANN, are used by tribologists around the globe. Other Technologies like Evolutionary Algorithm (EA), Support Vector Machine (SVM), and Adaptive Neuro-Fuzzy Interference Systems (ANFIS) are not used predominantly. [ABSTRACT FROM AUTHOR]

Monitoring and managing litter on the roadways is important not only for preserving the cleanliness and esthetic appeal of our cities but also for safeguarding the overall health and sanitary environment of citizens. With the development of artificial intelligence, it is now possible to design algorithms capable of autonomously assessing the sanitation status of roadways. In this paper, we propose a method for detecting garbage on roads as our solution to tackle the issue. The proposed model is a deep learning model with an attention mechanism introduced to detect garbage in real-time scenarios. Furthermore, the object recognition capability of the model is enhanced through transfer learning to mitigate the influence of irrelevant content during training. The refined network can detect rubbish on roads with higher efficiency than the existing models. Also, compared with other methods, it consumes less amount of data for training. The experimental results demonstrate the efficiency of our proposed model, with a performance boost of 7.62% over the state-of-the-art methods. [ABSTRACT FROM AUTHOR]

The recognition of steel microstructure images plays a crucial role in the metallographic analysis process. Although some progress has been made through the application of artificial intelligence algorithms, several challenges remain. First, existing algorithms exhibit weak nonlinear feature extraction capabilities and noticeable limitations. Second, they overlook the intrinsic noise and redundant interference present in microscopic images. To address these issues, this paper investigates the automatic recognition of metallographic tissues by leveraging residual structures in deep neural networks. An enhanced residual network model based on transfer learning is proposed, which utilizes the pre-trained weights from the ImageNet dataset to facilitate learning with small sample data. This network offers higher classification accuracy and higher F1 scores. In addition, a deep residual shrinkage network model based on an attention mechanism is proposed. This model incorporates an attention sub-network into the original residual module and employs a soft threshold function to eliminate redundant features, including noise. The proposed algorithms are evaluated against various convolutional neural networks using 20 types of metallographic test sets. The experimental results showed that both methods have high accuracy rates of 95% and 94.44%, respectively, and F1 scores of 0.9464 and 0.9419. While maintaining the complexity of the model, there has been a significant improvement in accuracy, and the models exhibit strong generalization capabilities. Our research contributes to enhancing production efficiency, strengthening quality control, and improving material performance through computer vision technology. [ABSTRACT FROM AUTHOR]

The article discusses the use of model predictive control (MPC) for drone flight control in unknown dynamic environments. MPC is a practical method for drone flight control due to its robustness against modeling errors and uncertainties. However, it can degrade in performance when faced with unknown environmental dynamics. The paper introduces a parameterized MPC approach called hyMPC that adapts to uncertain environmental conditions. It uses a novel policy search framework to train a high-level Gaussian policy and neural network policies to provide real-time decision variables. The effectiveness of hyMPC is validated through numerical simulations, achieving a 100% success rate in drone flight tests. The text discusses a framework for maneuvering drones through swinging gates using reinforcement learning (RL) and model predictive control (MPC). The framework utilizes episode-based policy search methods to acquire parameterized motor primitives and skills for controlling the drone. The RL-driven MPC framework incorporates a multi-layer perceptron to predict the gate's future state and a hybrid MPC cost function for trajectory optimization. The policy parameters are updated using a reward function that evaluates the quality of sampled trajectories. The proposed framework is validated through numerical simulations. This document presents a novel framework for navigating drones through swinging gates with unknown dynamics. The framework combines real-time Model Predictive Control (MPC) and offline Reinforcement Learning (RL) techniques. The approach involves training a neural network to predict gate motions and using an MLP to guide trajectory planning. The framework divides the traversal task into gate-following and gate-traversing [Extracted from the article]

The recognition of steel microstructure images plays a crucial role in the metallographic analysis process. Although some progress has been made through the application of artificial intelligence algorithms, several challenges remain. First, existing algorithms exhibit weak nonlinear feature extraction capabilities and noticeable limitations. Second, they overlook the intrinsic noise and redundant interference present in microscopic images. To address these issues, this paper investigates the automatic recognition of metallographic tissues by leveraging residual structures in deep neural networks. An enhanced residual network model based on transfer learning is proposed, which utilizes the pre-trained weights from the ImageNet dataset to facilitate learning with small sample data. This network offers higher classification accuracy and higher F1 scores. In addition, a deep residual shrinkage network model based on an attention mechanism is proposed. This model incorporates an attention sub-network into the original residual module and employs a soft threshold function to eliminate redundant features, including noise. The proposed algorithms are evaluated against various convolutional neural networks using 20 types of metallographic test sets. The experimental results showed that both methods have high accuracy rates of 95% and 94.44%, respectively, and F1 scores of 0.9464 and 0.9419. While maintaining the complexity of the model, there has been a significant improvement in accuracy, and the models exhibit strong generalization capabilities. Our research contributes to enhancing production efficiency, strengthening quality control, and improving material performance through computer vision technology. [ABSTRACT FROM AUTHOR]

Model pruning is one of the main methods of deep neural network model compression. However, the existing model pruning methods are inefficient, there is still a lot of redundancy in the network, and the pruning has a great impact on the accuracy. In addition, the traditional pruning process usually needs to fine-tune the network to restore accuracy, and fine-tuning has a limited effect on accuracy recovery, so it is difficult to achieve a high level of accuracy. In this paper, we propose a new neural network pruning framework: the channel sparsity is realized by introducing a scale factor, and the sparse network is pruned by setting a global threshold, which greatly improves the efficiency of pruning. After pruning, this paper proposes a rewind method to restore the accuracy, that is, save the weight after training, and then reload it on the network for training to restore the accuracy. In addition, we also study the best rewind point of the three networks. The experimental results show that our method significantly reduces the number of parameters and FLOPs without affecting or even improving the accuracy, and the rewind method proposed by us achieves a better accuracy recovery effect than fine-tuning. At the same time, we find that the epoch with the highest accuracy is the best rewind point, and the accuracy is the highest after saving its corresponding weight and retraining the model. [ABSTRACT FROM AUTHOR]

In this research paper, we observed the Prandtl–Eyring magneto hydrodynamic fluid model (PE-MHDFM) by applying the Bayesian regularization scheme as backpropagated artificial neural networks (BRS-BANNs). Effect of suction/injection at the wall is the source of convective steady flow. The nonlinear partial differential equations (PDEs) of PE-MHDFM are converted into ordinary differential equations (ODE) by applying some suitable similarity transformation. These ODEs are solved by utilizing Lobatto IIIA numerical procedure to acquire the reference dataset for different scenarios of BRS-BANN. The reference dataset is used to design the solver BRS-BANN. Further, the performance of BRS-BANN is clarified by MSE results, error analysis plots, regression and error histogram. Moreover, the solution of PE-MHDFM is observed through the validation, training and testing procedures. It is observed that the best correlation between the targeted values outcomes of the study is matched effectively, which definitely authenticates the validity and reliability of the designed solver. Furthermore, the impacts on the velocity profile and temperature profile are examined by the variation of different physical quantities along with their comparison with state-of-the-art Lobatto IIIA numerical approach. [ABSTRACT FROM AUTHOR]

EEG has been proved to be an effective tool for researchers' cognition and mental workload by detecting the changes of brain activity potential. The mental workload of pilots in aviation flight is closely related to the characteristics of flight tasks. The previous methods have problems such as lack of objectivity, low EEG analysis ability and lack of real-time analysis ability. In order to solve these problems, this paper proposes a multi-dimensional data fusion brain workload calculation method based on flight effect evaluation, which integrates vision, operational behavior and visual gaze, and classifies and analyzes them in combination with EEG data. This method evaluates the mental workload of pilots from three aspects: visual gaze behavior, control behavior and flight effect in the simulated flight experimental environment, and realizes a more objective mental workload analysis. Then, the synchronously collected EEG data are segmented and sampled to form a dataset, and an LSTM neural network model integrating attention mechanism is established, in which the attention mechanism is used to improve the feature processing ability of the network model for the classification of complex EEG data. After machine learning training, the final model can achieve 94% detection accuracy for 2-s EEG data, and has the ability of real-time analysis in the application environment. Compared with the previous similar LSTM model, the accuracy is improved by 6%, which also shows the effectiveness of the model. [ABSTRACT FROM AUTHOR]

In the resource-constrained embedded systems, the designing of efficient deep neural networks is a challenging process, due to diversity in the artificial intelligence applications. The quantization in deep neural networks superiorly diminishes the storage and computational time by reducing the bit-width of networks encoding. In order to highlight the problem of accuracy loss, the quantization levels are automatically discovered using Policy Feedback-based Reinforcement Learning Method (PF-RELEQ). In this paper, the Proximal Policy Optimization with Policy Feedback (PPO-PF) technique is proposed to determine the best design decisions by choosing the optimum hyper-parameters. In order to enhance the sensitivity of the value function to the change of policy and to improve the accuracy of value estimation at the early learning stage, a policy update method is devised based on the clipped discount factor. In addition, specifically the loss functions of policy satisfy the unbiased estimation of the trust region. The proposed PF-RELEQ effectively balances quality and speed compared to other deep learning methods like ResNet-1202, ResNet-32, ResNet-110, GoogLeNet and AlexNet. The experimental analysis showed that PF-RELEQ achieved 20% computational work-load reduction compared to the existing deep learning methods on ImageNet, CIFAR-10, CIFAR-100 and tomato leaf disease datasets and achieved approximately 2% of improvisation in the validation accuracy. Additionally, the PF-RELEQ needs only 0.55 Graphics Processing Unit on an NVIDIA GTX-1080Ti to develop DNNs that delivers better accuracy improvement with fewer cycle counts for image classification. [ABSTRACT FROM AUTHOR]

As a third generation artificial neural network, spiking neuron network is expected to expand the artificial intelligence world. However, as a more detailed simulation of brain, a single run of spiking neural networks (SNNs) simulation can take hours to days. To get a better prediction of SNN simulation performance, existing work requires gathering result of actual runs to conduct accurate modeling. In this paper, we propose a nonempirical SNN simulation performance prediction method, prototyped in a hybrid CPU-FPGA cluster. Experiments show that our method, without actual simulation run, can get comparable accuracy with orders of magnitude less runtime cost. [ABSTRACT FROM AUTHOR]

When using deep learning methods to model natural language, a recurrent neural network that can map input sequences to output sequences is usually used. Considering that natural language contains more complicated syntactic structures, and the performance of cyclic neural networks in long sentence processing will decrease, scholars have introduced an attention mechanism into the model, which has improved the above problems to a certain extent. The existing attention mechanism still has some shortcomings, such as the inability to explicitly obtain the known syntactic structure information in the sentence, and the poor interpretability of the output probability. In response to the above problems, this article will improve the attention mechanism in the recurrent neural network model. Firstly, the prior information in the natural language sequence is constructed as a graph model through syntactic analysis and other means, and then the graph structure regularization term is introduced into the sparse mapping. A new function netmax is constructed to replace the softmax function in the traditional attention mechanism, thereby improving the performance of the model and making the degree of association. The input values corresponding to larger input samples are closer, making the output of the attention mechanism easier to understand. The innovation of this paper mainly lies in that the weight calculation method which can be widely used in the attention mechanism is proposed by combining the deep learning model with statistical knowledge, which opens a channel to introduce the prior information for the deep learning model in natural language processing tasks. [ABSTRACT FROM AUTHOR]

The materials' consolidation, especially ceramics, is very important in advanced research development and industrial technologies. Science of sintering with all incoming novelties is the base of all these processes. A very important question in all of this is how to get the more precise structure parameters within the morphology of different ceramic materials. In that sense, the advanced procedure in collecting precise data in submicro-processes is also in direction of advanced miniaturization. Our research, based on different electrophysical parameters, like relative capacitance, breakdown voltage, and tg δ , has been used in neural networks and graph theory successful applications. We extended furthermore our neural network back propagation (BP) on sintering parameters' data. Prognosed mapping we can succeed if we use the coefficients, implemented by the training procedure. In this paper, we continue to apply the novelty from the previous research, where the error is calculated as a difference between the designed and actual network output. So, the weight coefficients contribute in error generation. We used the experimental data of sintered materials' density, measured and calculated in the bulk, and developed possibility to calculate the materials' density inside of consolidated structures. The BP procedure here is like a tool to come down between the layers, with much more precise materials' density, in the points on morphology, which are interesting for different microstructure developments and applications. We practically replaced the errors' network by density values, from ceramic consolidation. Our neural networks' application novelty is successfully applied within the experimental ceramic material density ρ = 5. 4 × 1 0 3 [kg/m3], confirming the direction way to implement this procedure in other density cases. There are many different mathematical tools or tools from the field of artificial intelligence that can be used in such or similar applications. We choose to use artificial neural networks because of their simplicity and their self-improvement process, through BP error control. All of this contributes to the great improvement in the whole research and science of sintering technology, which is important for collecting more efficient and faster results. [ABSTRACT FROM AUTHOR]

The ultimate direction of intelligent vehicle management is to achieve artificial intelligence (AI), and data mining is an important supporting technology for AI. The adoption of new AI technology can effectively improve operational efficiency and safety, especially in terms of performance. This paper takes the researches on traffic jam as an example and proposes one algorithm for combination forecasting model based on a segmentation algorithm for traffic flow sequence and BP neural network prediction. In this paper, it also introduces the traffic flow clustering analysis and mining algorithms for congestion events at the intersections. The blocking point algorithm is improved, and experimental analysis is performed through samples. Experimental results show that the algorithm use for combination forecasting model can greatly improve the real-time performance of short-term traffic flow prediction and significantly reduce the prediction error rate. Therefore, this algorithm has practical and innovative significance in the field of intelligent vehicle management. [ABSTRACT FROM AUTHOR]

In the era of globalization, manufacturing industries are facing intense pressure to prevent unexpected breakdowns, reduce maintenance cost and increase plant availability. Induction motors are the most sought-after prime movers in modern-day industries due to their robustness. Recently, research has picked up a fervent pace in the area of fault diagnosis of electrical machines. This paper presents the application of Support Vector Machine (SVM) and Artificial Neural Network (ANN)-based system to diagnose the vibration and Instantaneous Power (IP)-based responses of rolling element bearings and broken rotor bars in an induction motor. The dimensionality of the extracted features was reduced using Principal Component Analysis (PCA) and thereafter the selected features were ranked in order of relevance using the Sequential Floating Forward Selection (SFFS) method for reducing the size of input features and finding the most optimal feature set. A comparative analysis of the effectiveness of SVM and ANN is carried out using statistical parameters extracted from vibration and IP signals. The highest accuracy of 92.5% and 98.2% was achieved for vibration and IP signatures, respectively, using the proposed SFFS-based feature selection technique and ANN classification method. The results reveal that ANN has better performance than SVM and the proposed strategy can be used for automatic recognition of machine faults. The use of this type of intelligent system helps in avoiding unwanted and unplanned system shutdowns due to the failure of the motor. [ABSTRACT FROM AUTHOR]

The process of retinal vessel segmentation is important for detection of various eye conditions including the effect of diabetes on eyes, or diabetic retinopathy. As we know, the retinal microvasculature is unique since it is the only part of the human circulation system that can be directly and non-evasively visualized in vivo; readily photographed as well as subjected to digital image analysis. This paper explores a new technique for detecting the idiosyncrasies of retina images, for which we have reviewed some well-known image segmentation algorithms that help in detecting retinal abnormalities. In this work, we have also focused on the extraction of the vessel from retina images and developed an automated diagnostic system for diabetic retinopathy. This paper represents techniques, such as the snake model that was used for auto-extraction of retinal blood vessels and use of wavelet decomposition and back propagation neural network to extract the retinal vessels features and analyze the dataset. Finally, an analysis of performance of the vessel segmentation algorithm and wavelet analysis on standard image databases has been done. In this context, we have used F-score for validation of the result. [ABSTRACT FROM AUTHOR]

With the continuous expansion of the application scope of computer network technology, various malicious attacks that exist in the Internet range have caused serious harm to computer users and network resources. This paper attempts to apply artificial intelligence (AI) to computer network technology and research on the application of AI in computing network technology. Designing an intrusion detection model based on improved back propagation (BP) neural network. By studying the attack principle, analyzing the characteristics of the attack method, extracting feature data, establishing feature sets, and using the agent technology as the supporting technology, the simulation experiment is used to prove the improvement effect of the system in terms of false alarm rate, convergence speed, and false negative rate, the rate reached 86.7%. The results show that this fast algorithm reduces the training time of the network, reduces the network size, improves the classification performance, and improves the intrusion detection rate. [ABSTRACT FROM AUTHOR]

Gomoku is an ancient board game. The traditional approach to solving the Gomoku game is to apply tree search on a Gomoku game tree. Although the rules of Gomoku are straightforward, the game tree complexity is enormous. Unlike many other board games such as chess and Shogun, the Gomoku board state is more intuitive. That is to say, analyzing the visual patterns on a Gomoku game board is fundamental to play this game. In this paper, we designed a deep convolutional neural network model to help the machine learn from the training data (collected from human players). Based on this original neural network model, we made some changes and get two variant neural networks. We compared the performance of the original neural network with its variants in our experiments. Our original neural network model got 69% accuracy on the training data and 38% accuracy on the testing data. Because the decision made by the neural network is intuitive, we also designed a hard-coded convolution-based Gomoku evaluation function to assist the neural network in making decisions. This hybrid Gomoku artificial intelligence (AI) further improved the performance of a pure neural network-based Gomoku AI. [ABSTRACT FROM AUTHOR]

Recent research has demonstrated the effectiveness of deep subspace learning networks, including the principal component analysis network (PCANet) and linear discriminant analysis network (LDANet), since they can extract high-level features and better represent abstract semantics of given data. However, their representation does not consider the nonlinear relationship of data and limits the use of features with nonlinear metrics. In this paper, we propose a novel architecture combining the kernel collaboration representation with deep subspace learning based on the PCANet and LDANet for facial expression recognition. First, the PCANet and LDANet are employed to learn abstract features. These features are then mapped to the kernel space to effectively capture their nonlinear similarities. Finally, we develop a simple yet effective classification method with squared -regularization, which improves the recognition accuracy and reduces time complexity. Comprehensive experimental results based on the JAFFE, CK, KDEF and CMU Multi-PIE datasets confirm that our proposed approach has superior performance not just in terms of accuracy, but it is also robust against block occlusion and varying parameter configurations. [ABSTRACT FROM AUTHOR]

Rainfall-runoff modeling is very important for Water Resources Management because accurate and timely prediction can avoid accidents, such as the life risk, economic losses, etc. This paper proposed the novel hybrid optimization algorithm to combine Neural Network (NN) for rainfall-runoff modeling, namely HGASA-NN. Firstly, a novel and specialized hybrid optimization strategy by incorporating Simulated Annealing algorithm (SA) into Genetic Algorithm (GA) was used to train the initial connection weights and thresholds of NN. Secondly, the Back Propagation (BP) algorithm was adjusted the final weights and biases. Finally, a numerical example of daily rainfall-runoff data was used to elucidate the forecasting performance of the proposed HGASA-NN model. The HGASA-NN can make use of not only strong global searching ability of the GASA, but also strong local searching ability of the BP algorithm. The forecasting results indicate that the proposed model yields more accurate forecasting results than the BP-NN and pure GA training NN model. Therefore, the HGASA-NN model is a promising alternative for rainfall-runoff forecasting. [ABSTRACT FROM AUTHOR]

Differing from the conventional back-propagation (BP) neural networks, a novel multi-input Euler polynomial neural network, in short, MIEPNN (specifically, 4-input Euler polynomial neural network, 4IEPNN) is established and investigated in this paper. In order to achieve satisfactory performance of the established MIEPNN, a weights and structure determination (WASD) algorithm with pruning-while-growing (PWG) and twice-pruning (TP) techniques is built up for the established MIEPNN. By employing the weights direct determination (WDD) method, the WASD algorithm not only determines the optimal connecting weights between hidden layer and output layer directly, but also obtains the optimal number of hidden-layer neurons. Specifically, a sub-optimal structure is obtained via the PWG technique, then the redundant hidden-layer neurons are further pruned via the TP technique. Consequently, the optimal structure of the MIEPNN is obtained. To provide a reasonable choice in practice, several different MATLAB computing routines related to the WDD method are studied. Comparative numerical-experiment results of the 4IEPNN using these different MATLAB computing routines and the standard multi-layer perceptron (MLP) neural network further verify the superior performance and efficacy of the proposed MIEPNN equipped with the WASD algorithm including PWG and TP techniques in terms of training, testing and predicting. [ABSTRACT FROM AUTHOR]

Most current speech recognition systems use Hidden Markov Models (HMMs) to deal with the temporal variability of speech and Gaussian mixture models (GMMs) to determine how well each state of each HMM fits a frame or a short window of frames of coefficients that represents the acoustic input. In these systems acoustic inputs are represented by Mel Frequency Cepstral Coefficients temporal spectrogram known as frames. But MFCC is not robust to noise. Consequently, with different train and test conditions the accuracy of speech recognition systems decreases. On the other hand, using MFCCs of larger window of frames in GMMs needs more computational power. In this paper, Deep Belief Networks (DBNs) are used to extract discriminative information from larger window of frames. Nonlinear transformations lead to high-order and low-dimensional features which are robust to variation of input speech. Multiple speaker isolated word recognition tasks with 100 and 200 words in clean and noisy environments has been used to test this method. The experimental results indicate that this new method of feature encoding result in much better word recognition accuracy. [ABSTRACT FROM AUTHOR]

In this paper, we attempt to understand the propagation and stability feature of large-scale complex software from the perspective of complex networks. Specifically, we introduced the concept of "propagation scope" to investigate the problem of change propagation in complex software. Although many complex software networks exhibit clear "small-world" and "scale-free" features, we found that the propagation scope of complex software networks is much lower than that of small-world networks and scale-free networks. Furthermore, because the design of complex software always obeys the principles of software engineering, we introduced the concept of "edge instability" to quantify the structural difference among complex software networks, small-world networks and scale-free networks. We discovered that the edge instability distribution of complex software networks is different from that of small-world networks and scale-free networks. We also found a typical structure that contributes to the edge instability distribution of complex software networks. Finally, we uncovered the correlation between propagation scope and edge instability in complex networks by eliminating the edges with different instability ranges. [ABSTRACT FROM AUTHOR]

One of the most difficult problems in cluster analysis is the identification of the number of groups in a dataset especially in the presence of missing value. Since traditional clustering methods assumed the real number of clusters to be known. However, in real world applications the number of clusters is generally not known a priori. Also, most of clustering methods were developed to analyse complete datasets, they cannot be applied to many practical problems, e.g., on incomplete data. This paper focuses, first, on an algorithm of a fuzzy clustering approach, called OCS-FSOM. The proposed algorithm is based on neural network and uses Optimal Completion Strategy for missing value estimation in incomplete dataset. Then, we propose an extension of our algorithm, to tackle the problem of estimating the number of clusters, by using a multi level OCS-FSOM method. The new algorithm called Multi-OCSFSOM is able to find the optimal number of clusters by using a statistical criterion, that aims at measuring the quality of obtained partitions. Carried out experiments on real-life datasets highlights a very encouraging results in terms of exact determination of optimal number of clusters. [ABSTRACT FROM AUTHOR]