Search

In this paper, an analysis of a mathematical model of the coronavirus is carried out by using two fractal-fractional parameters. This dangerous virus infects a person through the mouth, eyes, nose or hands. This makes it so dangerous that no one can get rid of it. One of the main factors contributing to increasing infections of this deadly virus is crowding. We believe that it is necessary to model this effect mathematically to predict the possible outcomes. Hence, the study of neural network-based models related to the spread of this virus can yield new results. This paper also introduces the use of artificial neural networks (ANNs) to approximate the solutions, which is a significant contribution in this regard. We suggest employing this new method to solve a system of integral equations that explain the dynamics of infectious diseases instead of the classical numerical methods. Our study shows that, compared to the Adams-Bashforth algorithm, the ANN is a reliable candidate for solving the problems. [ABSTRACT FROM AUTHOR]

Combining computational technologies and humanities is an ongoing effort aimed at making resources such as texts, images, audio, video, and other artifacts digitally available, searchable, and analyzable. In recent years, deep neural networks (DNN) dominate the field of automatic text analysis and natural language processing (NLP), in some cases presenting a super‐human performance. DNNs are the state‐of‐the‐art machine learning algorithms solving many NLP tasks that are relevant for Digital Humanities (DH) research, such as spell checking, language detection, entity extraction, author detection, question answering, and other tasks. These supervised algorithms learn patterns from a large number of "right" and "wrong" examples and apply them to new examples. However, using DNNs for analyzing the text resources in DH research presents two main challenges: (un)availability of training data and a need for domain adaptation. This paper explores these challenges by analyzing multiple use‐cases of DH studies in recent literature and their possible solutions and lays out a practical decision model for DH experts for when and how to choose the appropriate deep learning approaches for their research. Moreover, in this paper, we aim to raise awareness of the benefits of utilizing deep learning models in the DH community. [ABSTRACT FROM AUTHOR]

The quality of scientific publications can be measured by quantitative indices such as the h‐index, Source Normalized Impact per Paper, or g‐index. However, these measures lack to explain the function or reasons for citations and the context of citations from citing publication to cited publication. We argue that citation context may be considered while calculating the impact of research work. However, mining citation context from unstructured full‐text publications is a challenging task. In this paper, we compiled a data set comprising 9,518 citations context. We developed a deep learning‐based architecture for citation context classification. Unlike feature‐based state‐of‐the‐art models, our proposed focal‐loss and class‐weight‐aware BiLSTM model with pretrained GloVe embedding vectors use citation context as input to outperform them in multiclass citation context classification tasks. Our model improves on the baseline state‐of‐the‐art by achieving an F1 score of 0.80 with an accuracy of 0.81 for citation context classification. Moreover, we delve into the effects of using different word embeddings on the performance of the classification model and draw a comparison between fastText, GloVe, and spaCy pretrained word embeddings. [ABSTRACT FROM AUTHOR]

Accurate prostate segmentation in ultrasound images is crucial for the clinical diagnosis of prostate cancer and for performing image-guided prostate surgery. However, it is challenging to accurately segment the prostate in ultrasound images due to their low signal-to-noise ratio, the low contrast between the prostate and neighboring tissues, and the diffuse or invisible boundaries of the prostate. In this paper, we develop a novel hybrid method for segmentation of the prostate in ultrasound images that generates accurate contours of the prostate from a range of datasets. Our method involves three key steps: (1) application of a principal curve-based method to obtain a data sequence comprising data coordinates and their corresponding projection index; (2) use of the projection index as training input for a fractional-order-based neural network that increases the accuracy of results; and (3) generation of a smooth mathematical map (expressed via the parameters of the neural network) that affords a smooth prostate boundary, which represents the output of the neural network (i.e., optimized vertices) and matches the ground truth contour. Experimental evaluation of our method and several other state-of-the-art segmentation methods on datasets of prostate ultrasound images generated at multiple institutions demonstrated that our method exhibited the best capability. Furthermore, our method is robust as it can be applied to segment prostate ultrasound images obtained at multiple institutions based on various evaluation metrics. [ABSTRACT FROM AUTHOR]

Brain tumors (BTs) are an uncommon but fatal kind of cancer. Therefore, the development of computer-aided diagnosis (CAD) systems for classifying brain tumors in magnetic resonance imaging (MRI) has been the subject of many research papers so far. However, research in this sector is still in its early stage. The ultimate goal of this research is to develop a lightweight effective implementation of the U-Net deep network for use in performing exact real-time segmentation. Moreover, a simplified deep convolutional neural network (DCNN) architecture for the BT classification is presented for automatic feature extraction and classification of the segmented regions of interest (ROIs). Five convolutional layers, rectified linear unit, normalization, and max-pooling layers make up the DCNN's proposed simplified architecture. The introduced method was verified on multimodal brain tumor segmentation (BRATS 2015) datasets. Our experimental results on BRATS 2015 acquired Dice similarity coefficient (DSC) scores, sensitivity, and classification accuracy of 88.8%, 89.4%, and 88.6% for high-grade gliomas. When it comes to segmenting BRATS 2015 BT images, the performance of our proposed CAD framework is on par with existing state-of-the-art methods. However, the accuracy achieved in this study for the classification of BT images has improved upon the accuracy reported in prior studies. Image classification accuracy for BRATS 2015 BT has been improved from 88% to 88.6%. [ABSTRACT FROM AUTHOR]

Mathematical modeling of many natural and physical phenomena in industry, engineering sciences and basic sciences lead to linear and non-linear devices. In many cases, the coefficients of these devices, taking into account qualitative or linguistic concepts, show their complexity in the form of Z-numbers. Since Z-number involves both fuzziness and reliability or probabilistic uncertainty, it is difficult to obtain the exact solution to the problems with Z-number. In this work, a method and an algorithm are proposed for the approximate solution of a Z-number linear system of equations as an important case of such problems. The paper is devoted to solving linear systems where the coefficients of the variables and right hand side values are Z-numbers. An algorithm is presented based on a ranking scheme and the neural network technique to solve the obtained system. Moreover, two examples are included to describe the procedure of the method and results. [ABSTRACT FROM AUTHOR]

The nanoindentation technique is employed to characterize the behaviors of biomaterials. Nevertheless, there is a lack of development of a miniaturized precise positioner for in situ nanoindentation. Besides, modeling behaviors of the positioner are restricted due to its complex kinematic characteristics. Therefore, this paper proposes a novel compliant two degrees of freedom (dof) stage for positioning a biomaterial sample in in situ nanoindentation. In addition, a new modeling and dimensional optimization synthesis method of the stage is developed. The proposed effective methodology is developed based on a kinetostatic analysis-based calculation method, the Lagrange approach, and a neural network algorithm. With an increased advance in artificial intelligence, a neural network algorithm is proposed to extend the applicability of artificial neural networks in optimizing the parameters of the stage. First, the 2-dof stage is built via a combination of an eight-lever displacement amplifier and a symmetric parallelogram mechanism. Second, a chain of mathematical equations of the 2-dof stage is constructed using a kinetostatic analysis-based method to calculate the ratio of displacement amplification and the input stiffness of the 2-dof stage. Then, the Lagrange method is utilized to formulate the dynamic equation of the 2-dof stage. Finally, a neural network algorithm is adopted to maximize the natural first frequency of the proposed stage. The optimal results determined that the frequency of the stage can achieve a high value of 112.0995 Hz. Besides, the formed mathematical models were relatively precise by comprising the simulation verifications. [ABSTRACT FROM AUTHOR]

As the competition between enterprises intensifies, employees have witnessed a decline of psychological health year by year and severe anxiety and depression. To ensure the normal work of employees, it is important to implement psychological occupational therapy intervention (POTI). The previous studies on corporate occupational values focus on the behavioral variables and attitude variables related to occupations. The research paradigm does not suit a specific group of employees. Therefore, this paper explores the individual differences in POTI guided by the realization of occupational values. For a specific group of employees, the correlations of the psychological problems with job attitude, job involvement, and psychological health level were reasoned logically, a theoretical model was established, and the full-model map was plotted to illustrate the influence of the realization of occupational values over POTI. Then, the evaluation data on the psychological intervention effect of 2,800 employees were explored based on multikernel learning, and an individual difference prediction model was constructed through multikernel learning. Finally, the predicted results of different groups of employees were compared, revealing the effectiveness of our algorithm. [ABSTRACT FROM AUTHOR]

In view of the poor performance of the original mathematical model of assembly construction project precost budget, a mathematical model of assembly construction project precost budget based on improved neural network algorithm is proposed. This paper investigates the cost content of assembly construction project and analyzes its early cost. It finds that the early cost of assembly construction project includes component production cost, transportation component cost, and installation component cost. Based on the improved neural network algorithm to build an improved neural network model, the improved neural network model to mine the cost data in the early stage of assembly construction project is used. In this paper, the earned value variable is introduced to transform the project duration and project cost in the early stage of the prefabricated construction project into quantifiable cost data, and the earned value analysis method is used to estimate the implementation cost of the prefabricated construction project. According to the result of cost estimation, the mathematical model of precost budget of prefabricated construction project is built based on the project parameters. In order to prove that the cost budget performance of the mathematical model based on the improved neural network algorithm in the early stage of assembly construction project is better, the original mathematical model is compared with the mathematical model, the experimental results show that the cost budget performance of the model is better than the original model, and the cost budget performance is improved. [ABSTRACT FROM AUTHOR]

Automatic image annotation aims to predict labels for images according to their semantic contents and has become a research focus in computer vision, as it helps people to edit, retrieve and understand large image collections. In the last decades, researchers have proposed many approaches to solve this task and achieved remarkable performance on several standard image datasets. In this paper, we propose a novel learning to rank approach to address image auto-annotation problem. Unlike typical learning to rank algorithms for image auto-annotation which directly rank annotations for image, our approach consists of two phases. In the first phase, neural ranking models are trained to rank image’s semantic neighbors. Then nearest-neighbor based models propagate annotations from these semantic neighbors to the image. Thus our approach integrates learning to rank algorithms and nearest-neighbor based models, including TagProp and 2PKNN, and inherits their advantages. Experimental results show that our method achieves better or comparable performance compared with the state-of-the-art methods on four challenging benchmarks including Corel5K, ESP Games, IAPR TC-12 and NUS-WIDE. [ABSTRACT FROM AUTHOR]

In this paper, the problem of temperature distribution for convective straight fins with constant and temperature-dependent thermal conductivity is solved by using artificial neural networks trained by the biogeography-based heterogeneous cuckoo search (BHCS) algorithm. We have solved the integer and noninteger order energy balance equation in order to analyse the temperature distribution in convective straight fins. We have compared our results with homotopy perturbation method (HPM), variational iteration method (VIM), and homotopy perturbation Sumudu transform method (HPSTM). The results show that the ANN–BHCS algorithm gives better results than other analytical techniques. We have further checked the efficiency of the ANN–BHCS algorithm by using the performance metrics MAD, TIC, and ENSE. We have calculated the values of MAD, TIC, and ENSE for case 1 of the problem, and histograms of these metrics show the efficiency of our algorithm. [ABSTRACT FROM AUTHOR]

Predicting business operations on the basis of previous events plays an important role in managing a company. In the paper, we predict monthly sales volume of a textile warehouse by mathematical tools. To this end we use a feedforward artificial neural network trained on past data. The network predicted the volume with high accuracy. For the examined company, such prediction is very important as nearly the entire range of products is imported from different countries and the goods have to be ordered in advance. [ABSTRACT FROM AUTHOR]

In this paper, we present a fault detection filter for the induction motor speed as class of nonlinear system in networked control systems (NCSs) subject to induced times delays. The induced times delays is from the controller to the plant and from the sensor to the controller. First the nonlinear system used in this paper is an Induction motor that is modeled as multimodel system. Then an adaptive state filter is derived from augmented state version of the proposed detection filter which can provide the information of faults and states of the induction motor. An example is included to show the efficiency of the proposed method. [ABSTRACT FROM AUTHOR]

This paper examines a linked simulation-optimization procedure based on the combined application of an artificial neural network (ANN) and genetic algorithm (GA) with the aim of developing an efficient model for the multiobjective management of groundwater lenses in small islands. The simulation-optimization methodology is applied to a real aquifer in Kish Island of the Persian Gulf to determine the optimal groundwater-extraction while protecting the freshwater lens from seawater intrusion. The initial simulations are based on the application of SUTRA, a variable-density groundwater numerical model. The numerical model parameters are calibrated through automated parameter estimation. To make the optimization process computationally feasible, the numerical model is subsequently replaced by a trained ANN model as an approximate simulator. Even with a moderate number of input data sets based on the numerical simulations, the ANN metamodel can be efficiently trained. The ANN model is subsequently linked with GA to identify the nondominated or Pareto-optimal solutions. To provide flexibility in the implementation of the management plan, the model is built upon optimizing extraction from a number of zones instead of point-well locations. Two issues are of particular interest to the research reported in this paper are: (1) how the general idea of minimizing seawater intrusion can be effectively represented by objective functions within the framework of the simulation-optimization paradigm, and (2) the implications of applying the methodology to a real-world small-island groundwater lens. Four different models have been compared within the framework of multiobjective optimization, including (1) minimization of maximum salinity at observation wells, (2) minimization of the root mean square (RMS) change in concentrations over the planning period, (3) minimization of the arithmetic mean, and (4) minimization of the trimmed arithmetic mean of concentration in the observation wells. The latter model can provide a more effective framework to incorporate the general objective of minimizing seawater intrusion. This paper shows that integration of the latest innovative tools can provide the ability to solve complex real-world optimization problems in an effective way. [ABSTRACT FROM AUTHOR]

The spiculation sign is one of the main signs to distinguish benign and malignant pulmonary nodules. In order to effectively extract the image feature of a pulmonary nodule for the spiculation sign distinguishment, a new spiculation sign recognition model is proposed based on the doctors' diagnosis process of pulmonary nodules. A maximum density projection model is established to fuse the local three-dimensional information into the two-dimensional image. The complete boundary of a pulmonary nodule is extracted by the improved Snake model, which can take full advantage of the parallel calculation of the Spike Neural P Systems to build a new neural network structure. In this paper, our experiments show that the proposed algorithm can accurately extract the boundary of a pulmonary nodule and effectively improve the recognition rate of the spiculation sign. [ABSTRACT FROM AUTHOR]

This paper investigates the data-based optimal control for a class of networked industrial processes with a double-layer architecture. Without knowing the dynamics of subsystems at the device layer, the index prediction function is constructed via the input/output signals, and radial basis function neural networks. The tuning laws for the index prediction function are obtained through the optimal control strategy. Then, by treating the network-induced phenomenon as random round-trip time delay and introducing the predictive algorithm, the compensation scheme is designed at the operation layer to dynamically decompose the setpoints. Finally, two simulation examples are given to further illustrate the effectiveness of the proposed compensation strategy. [ABSTRACT FROM AUTHOR]

In this paper, we present a novel feature-based neural network (NN) approach for estimation of blood pressure (BP) from wrist oscillometric measurements. Unlike previous methods that use the raw oscillometric waveform envelope (OMWE) as input to the NN, in this paper, we propose to use features extracted from the envelope. The OMWE is mathematically modeled as a sum of two Gaussian functions. The optimum parameters of this model are found by minimizing the least squares error between the model and the OMWE using the Levenberg–Marquardt algorithm and are used as features. Two separate feed-forward NNs (FFNNs) are then designed to estimate the systolic and diastolic BPs using these features. The FFNNs are trained using the resilient backpropagation learning algorithm and tested on a data set of BP measurements recorded from 85 subjects. The performance is then compared with that of the conventional maximum amplitude algorithm, adaptive neuro-fuzzy inference system, and already published NN-based methods. It is found that the proposed approach achieves lower values of mean absolute error and standard deviation of error in the estimation of BP. In addition, the proposed approach has the following advantages: lower complexity with respect to the design parameters, smaller training data set, and lower computational load. [ABSTRACT FROM PUBLISHER]

Neural network was introduced to sneak circuit analysis (SCA) in previous works. However, it may generate suspect results which were hard to explain. To overcome the shortcomings, this paper proposed a novel neural network model based on circuit architecture, named CArNN, which is used as an individual of an ensemble. In CArNN, neurons represented system components, and weights represented the joints between components. Models of neurons are sigmoid functions. Clone selection algorithm was used to train CArNNs population. The trained antibodies were used as individuals of an ensemble. The inputs of CArNN are states of switches, and the outputs are states of functional components. Ensemble predicted all possible functions of circuit. The sneak circuits can be discovered by comparing the predicted and designed functions. The results revealed that CArNNs can exactly discover sneak circuits. [ABSTRACT FROM AUTHOR]

A Centroid Neural Network with Weighted Features (CNN-WF) is proposed and presented in this paper. The proposed CNN-WF is based on a Centroid Neural Network (CNN), an effective clustering tool that has been successfully applied to various problems. In order to evaluate the importance of each feature in a set of data, a feature weighting concept is introduced to the Centroid Neural Network in the proposed algorithm. The weight update equations for CNN-WF are derived by applying the Lagrange multiplier procedure to the objective function constructed for CNN-WF in this paper. The use of weighted features makes it possible to assess the importance of each feature and to reject features that can be considered as noise in data. Experiments on a synthetic data set and a typical image compression problem show that the proposed CNN-WF can assess the importance of each feature and the proposed CNN-WF outperforms conventional algorithms including the Self-Organizing Map (SOM) and CNN in terms of clustering accuracy. [ABSTRACT FROM AUTHOR]

Steady State models of Evolutionary Algorithms are widely used, yet surprisingly little attention has been paid to the effects arising from different replacement strategies. This paper explores the use of mathematical models to characterise the selection pressures arising in a selection-only environment. The first part brings together models for the behaviour of seven different replacement mechanisms and provides expressions for various proposed indicators of Evolutionary Algorithm behaviour. Some of these have been derived elsewhere, and are included for completeness, but the majority are new to this paper. These theoretical indicators are used to compare the behaviour of the different strategies. The second part of this paper examines the practical relevance of these indicators as predictors for algorithms' relative performance in terms of optimisation time and reliability. It is not the intention of this paper to come up with a "one size fits all" recommendation for choice of replacement strategy. Although some strategies may have little to recommend them, the relative ranking of others is shown to depend on the intended use of the algorithm to be implemented, as reflected in the choice of performance metrics. [ABSTRACT FROM AUTHOR]

Background: Although Pneumatic Artificial Muscle (PAM) has a promising future in rehabilitation robots, it's difficult to realize accurate position control due to its highly nonlinear properties.Objective: This paper deals with position control of PAM.Methods: To describe the hysteresis inside PAM, a polynomial based phenomenological function is developed. Based on the phenomenological model for PAM and analysis of pressure dynamics within PAM, an adaptive cascade controller is proposed. Both outer loop and inner loop employ BP Neural Network tuned PID algorithm. The outer loop is to handle high nonlinearities and unmodeled dynamics of PAM, while the inner loop is responsible for nonlinearities caused by pressure dynamics.Results: Experimental results show high tracking accuracy as compared with a convention PID controller.Conclusion: The proposed controller is effective in improving performance of PAM and will be implemented in a rehabilitation robot. [ABSTRACT FROM AUTHOR]

Cardiac digital twins provide a physics and physiology informed framework to deliver personalized medicine. However, high-fidelity multi-scale cardiac models remain a barrier to adoption due to their extensive computational costs. Artificial Intelligence-based methods can make the creation of fast and accurate whole-heart digital twins feasible. We use Latent Neural Ordinary Differential Equations (LNODEs) to learn the pressure-volume dynamics of a heart failure patient. Our surrogate model is trained from 400 simulations while accounting for 43 parameters describing cell-to-organ cardiac electromechanics and cardiovascular hemodynamics. LNODEs provide a compact representation of the 3D-0D model in a latent space by means of an Artificial Neural Network that retains only 3 hidden layers with 13 neurons per layer and allows for numerical simulations of cardiac function on a single processor. We employ LNODEs to perform global sensitivity analysis and parameter estimation with uncertainty quantification in 3 hours of computations, still on a single processor. [ABSTRACT FROM AUTHOR]

Accuracy is a critical factor in predictive modeling. A predictive model such as a decision tree must be accurate to draw conclusions about the system being modeled. This research aims at analyzing and improving the performance of classification and regression trees (CART), a decision tree algorithm, by evaluating and deriving a new methodology based on the performance of real-world data sets that were studied. This paper introduces a new approach to tree induction to improve the efficiency of the CART algorithm by combining the existing functionality of CART with the addition of artificial neural networks (ANNs). Trained ANNs are utilized by the tree induction algorithm by generating new, synthetic data, which have been shown to improve the overall accuracy of the decision tree model when actual training samples are limited. In this paper, traditional decision trees developed by the standard CART methodology are compared with the enhanced decision trees that utilize the ANN's synthetic data generation, or CART+. This research demonstrates the improved accuracies that can be obtained with CART+, which can ultimately improve the knowledge that can be extracted by researchers about a system being modeled. [ABSTRACT FROM AUTHOR]

Based on information theory, the single neuron adaptive control problem for stochastic systems with non-Gaussian noises is investigated in this paper. Here, the statistic information of the output within a receding window rather than the output value is used for the tracking problem. Firstly, the single neuron controller structure, which has the ability of self-learning and self-adaptation, is established. Then, an improved performance criterion is given to train the weights of the single neuron. Furthermore, the mean-square convergent condition of the proposed control algorithm is formulated. Finally, comparative simulation results are presented to show that the proposed algorithm is superior to the PID controller. The contributions of this work are twofold: (1) the optimal control algorithm is formulated in the data-driven framework, which needn't the precise system model that is usually difficult to obtain; (2) the control problem of non-Gaussian systems can be effectively dealt with by the simple single neuron controller under improved minimum entropy criterion. [ABSTRACT FROM AUTHOR]

Recently, artificial neural networks, especially feedforward neural networks, have been widely used for the identification and control of nonlinear dynamical systems. However, the determination of a suitable set of structural and learning parameter value of the feed-forward neural networks still remains a difficult task. This paper is concerned with the use of extended Kalman filter and unscented Kalman filter based feedforward neural networks training algorithms. The comparisons of the performances of both algorithms are discussed and illustrated using a simulated example. The simulation results show that in terms of mean squared errors, unscented Kalman filter algorithm is superior to the extended Kalman filter and back-propagation algorithms since there are improvements between 2.45-21.48% (for training) and 8.35-29.15% (for testing). This indicates that unscented Kalman filter based feedforward neural networks learning could be a good alternative in artificial neural network models based applications for nonlinear dynamical systems. [ABSTRACT FROM AUTHOR]

Neural tree model has been successfully applied to solving a variety of interesting problems. In most previous studies, optimization of the neural tree model was divided into two steps: first structure optimization, then parameter optimization. One major problem in the evolution of structure without parameter information was noisy fitness evaluation. In this paper, an improved breeder genetic programming algorithm is proposed to the synthesis of neural tree model. The effectiveness and performance of the method are evaluated on time series prediction problems and compared with those of related methods. Simulation results show that the proposed algorithm is a potential method with better performance and effectiveness. [ABSTRACT FROM AUTHOR]

Resistance spot welding is a major metal connecting method in vehicle and other domestic electronic domains. Among all the welding techniques, the spot welding inverter is an important direction at the present time. The high nonlinearity and strongly coupled multiple parameters in the resistance spot welding process challenge the classical control theory based on some specific conditions and ideal assumptions, which in real practice obstacle the high-quality welding. This paper put the fuzzy neural network into a constant-current-controlled spot welding inverter, where the welding current peak and its variation are adopted as the input parameters and the duty ratio of the switches is regarded as the output. Eventually a five-layer feed-forward network was constructed, back propagation (BP) algorithm was applied to revise the adjustable parameters in the network, and a mathematical model was established to obtain the training samples serving for the network. The ultimate precision could reach 1.75%, the relative control error is 2.28% with strong external disturbances, the overmodulation is 3.35%, and the total modulating period is seven switching period, which indicated that the proposed algorithm has good performance. [ABSTRACT FROM AUTHOR]

Adaptive dynamic programming (ADP) is a promising research field for design of intelligent controllers, which can both learn on-the-fly and exhibit optimal behavior. Over the past decades, several generations of ADP design have been proposed in the literature, which have demonstrated many successful applications in various benchmarks and industrial applications. While many of the existing researches focus on multiple-inputs-single-output system with steepest descent search, in this paper we investigate a generalized multiple-input-multiple-output (GMIMO) ADP design for online learning and control, which is more applicable to a wide range of practical real-world applications. Furthermore, an improved weight-updating algorithm based on recursive Levenberg–Marquardt methods is presented and embodied in the GMIMO approach to improve its performance. Finally, we test the performance of this approach based on a practical complex system, namely, the learning and control of the tension and height of the looper system in a hot strip mill. Experimental results demonstrate that the proposed approach can achieve effective and robust performance. [ABSTRACT FROM AUTHOR]

This paper proposes a novel steam valving controller using radial basis function (RBF) networks-based approximate model method. Approximate model method is a kind of direct linearization approach that is derived based on the approximation of the plant's input-output model via Taylor expansion. RBF networks are used to identify the plant to implement the approximate model control law. In order to improve the performance of the approximate model controller, RBF networks weights are adjusted online using BP algorithms with an adaptive learning rate. Several simulations results demonstrate the effectiveness of the proposed controller for team valving control. [ABSTRACT FROM AUTHOR]

This paper describes the comparison of the burr size predictive models based on artificial neural networks (ANN) and response surface methodology (RSM). The models were developed based on three-level full factorial design of experiments conducted on AISI 316L stainless steel work material with cutting speed, feed, and point angle as the process parameters. The ANN predictive models of burr height and burr thickness were developed using a multilayer feed forward neural network, trained using an error back propagation learning algorithm (EBPA), which is based on the generalized delta rule. The performance of the developed ANN models were compared with the second-order RSM mathematical models of burr height and thickness. The comparison clearly indicates that the ANN models provide more accurate prediction compared to the RSM models. The details of experimentation, model development, testing, and performance comparison are presented in the paper. [ABSTRACT FROM AUTHOR]

This paper presents a new algorithm for electrocardiogram (ECG) signal compression based on local extreme extraction, adaptive hysteretic filtering and Lempel-Ziv-Welch (LZW) coding. The algorithm has been verified using eight of the most frequent normal and pathological types of cardiac beats and an multi-layer perceptron (MLP) neural network trained with original cardiac patterns and tested with reconstructed ones. Aspects regarding the possibility of using the principal component analysis (PCA) to cardiac pattern classification have been investigated as well. A new compression measure called "quality score," which takes into account both the reconstruction errors and the compression ratio, is proposed. [ABSTRACT FROM AUTHOR]

In this paper, we have proposed an algorithm to design Convolutional Neural Networks (CNN) structures using Genetic Alghorithms (GAs) that are able to learn the best CNN architecture in a completely automatic manner based on limited computing resources. A coding strategy based on sophisticated, hand- designed, modern network blocks has been proposed. So that, the proposed algorithm does not require users with prior knowledge of CNNs, the problem being addressed or even GAs. The performance of the proposed algorithm was evaluated by conducting a series of experiments with widely used reference datasets for image classification tasks and comparing results with modern algorithms that have shown promising performance in this field. The experimental results showed that the proposed algorithm can be used to automatically find a competitive CNN structure compared to modern models, as this algorithm achieved the best classification accuracy among manually and automatically designed CNNs as well as competitive classification accuracy for semi-automatic algorithms. [ABSTRACT FROM AUTHOR]

This paper describes a statistical method that helps to find good parameter settings for evolutionary algorithms. The method builds a functional relationship between the algorithm's performance and its parameter values. This relationship--a statistical model--can be identified thanks to simulation data. Estimation and test procedures are used to evaluate the effect of parameter variation. In addition, good parameter settings can be investigated with a reduced number of experiments. Problem labeling can also be considered as a model variable and the method enables identifying classes of problems for which the algorithm behaves similarly. Defining such classes increases the quality of estimations without increasing the computational cost. [ABSTRACT FROM AUTHOR]

In this paper, neural algorithms, including the multi-layered perceptron (MLP) differential approximator, generalized hybrid power series, discrete Hopfield neural network, and the hybrid numerical, are used for constructing models that incorporate a priori knowledge in the form of differential equations for dynamic engineering processes. The properties of these approaches are discussed and compared to each other in terms of efficiency and accuracy. The presented algorithms have a number of advantages over other traditional mesh-based methods such as reduction of the computational cost, speed up of the execution time, and data integration with the a priori knowledge. Furthermore, the presented techniques are applicable when the differential equations governing a system or dynamic engineering process are not fully understood. The proposed algorithms learn to compute the unknown or free parameters of the equation from observations of the process behavior, hence a more precise theoretical description of the process is obtained. Additionally, there will be no need to solve the differential equation each time the free parameters change. The parallel nature of the approaches outlined in this paper make them attractive for parallel implementation in dynamic engineering processes. [ABSTRACT FROM AUTHOR]

This paper introduces a new algorithm for solving ordinary differential equations (ODEs) with initial or boundary conditions. In our proposed method, the trial solution of differential equation has been used in the regression-based neural network (RBNN) model for single input and single output system. The artificial neural network (ANN) trial solution of ODE is written as sum of two terms, first one satisfies initial/boundary conditions and contains no adjustable parameters. The second part involves a RBNN model containing adjustable parameters. Network has been trained using the initial weights generated by the coefficients of regression fitting. We have used feed-forward neural network and error back propagation algorithm for minimizing error function. Proposed model has been tested for first, second and fourth-order ODEs. We also compare the results of proposed algorithm with the traditional ANN algorithm. The idea may very well be extended to other complicated differential equations. [ABSTRACT FROM AUTHOR]

The focus in this paper embraces the hybrid models whose components are nonparametric regression and artificial neural networks. Smoothing spline, regression spline and additive regression models are considered as the nonparametric regression components. Furthermore, various multilayer perceptron algorithms and radial basis function network model are regarded as the artificial neural networks components. The performances of these models are compared by forecasting three real Turkish data sets: Domestic product per capita (GDP), the number of cars produced and the number of tourist arrivals. The results obtained by experimental evaluations show that hybrid models proposed in this paper have performed much better in comparison to hybrid models discussed in literature. [ABSTRACT FROM AUTHOR]

Copyright of Journal of Mechanical Engineering / Strojniški Vestnik is the property of University of Ljubljana, Faculty of Mechanical Engineering, Journal of Mechanical Engineering and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

This paper presents a novel neural network model with hybrid quantized architecture to improve the performance of the conventional Elman networks. The quantum gate technique is introduced for solving the pattern mismatch between the inputs stream and one-time-delay state feedback. A quantized back-propagation training algorithm with an adaptive dead zone scheme is developed for providing an optimal or suboptimal tradeoff between the convergence speed and the generalization performance. Furthermore, the effectiveness of the new real time learning algorithm is demonstrated by proving the quantum gate parameter convergence based on Lyapunov method. The numerical experiments are carried out to demonstrate the accuracy of the theoretical results. [ABSTRACT FROM AUTHOR]

Abstract: Incremental learning of neural networks has attracted much interest in recent years due to its wide applicability to large scale data sets and to distributed learning scenarios. Moreover, nonstationary learning paradigms have also emerged as a subarea of study in Machine Learning literature due to the problems of classical methods when dealing with data set shifts. In this paper we present an algorithm to train single layer neural networks with nonlinear output functions that take into account incremental, nonstationary and distributed learning scenarios. Moreover, it is demonstrated that introducing a regularization term into the proposed model is equivalent to choosing a particular initialization for the devised training algorithm, which may be suitable for real time systems that have to work under noisy conditions. In addition, the algorithm includes some previous models as special cases and can be used as a block component to build more complex models such as multilayer perceptrons, extending the capacity of these models to incremental, nonstationary and distributed learning paradigms. In this paper, the proposed algorithm is tested with standard data sets and compared with previous approaches, demonstrating its higher accuracy. [Copyright &y& Elsevier]

Developing a model based digital human meridian system is one of the interesting ways of understanding and improving acupuncture treatment, safety analysis for acupuncture operation, doctor training, or treatment scheme evaluation. In accomplishing this task, how to construct a proper model to describe the behavior of human meridian systems is one of the very important issues. From experiments, it has been found that the hysteresis phenomenon occurs in the relations between stimulation input and the corresponding response of meridian systems. Therefore, the modeling of hysteresis in a human meridian system is an unavoidable task for the construction of model based digital human meridian systems. As hysteresis is a nonsmooth, nonlinear and dynamic system with a multi-valued mapping, the conventional identification method is difficult to be employed to model its behavior directly. In this paper, a neural network based identification method of hysteresis occurring in human meridian systems is presented. In this modeling scheme, an expanded input space is constructed to transform the multi-valued mapping of hysteresis into a one-to-one mapping. For this purpose, a modified hysteretic operator is proposed to handle the extremum-missing problem. Then, based on the constructed expanded input space with the modified hysteretic operator, the so-called Extreme Learning Machine (ELM) neural network is utilized to model hysteresis inherent in human meridian systems. As hysteresis in meridian system is a dynamic system, a dynamic ELM neural network is developed. In the proposed dynamic ELM neural network, the output state of each hidden neuron is fed back to its own input to describe the dynamic behavior of hysteresis. The training of the recurrent ELM neural network is based on the least-squares algorithm with QR decomposition. [ABSTRACT FROM AUTHOR]

Multitudinous parameters involved have made the direct methanol fuel cell (DMFC) a complex “black-box,” posing challenges and difficulties in its modeling. This paper presents a neural network (NN) model with immune-based particle swarm optimization (IPSO) approach of the DMFC system, which is different from the conventional complex mathematical models. With the actual operation of DMFC taken into consideration, the polarization curves are run under a stable condition as the reference data for training the model. To reduce time cost for the training procedure and maintaining minimum modeling error, the IPSO algorithm is applied to the learning procedure of NN model. By combining the NN and the IPSO, the weight of the transfer function on the node in the hidden layer can be adjusted to minimize modeling error. The simulation results were in agreement with the experimental results, showing that the hybridization of NN model with IPSO approach can effectively demonstrate the polarization behaviors on a DMFC system. Therefore, this hybrid NN model with IPSO approach can be used as a simulation tool, which can save much money and time for reforming the conventional mathematical models with expensive experiment. Furthermore, the proposed method reveals an adaptive ability to improve the model even if the DMFC system structure is different. [ABSTRACT FROM PUBLISHER]

Analog very large scale integration implementations of neural networks can compute using a fraction of the size and power required by their digital counterparts. However, intrinsic limitations of analog hardware, such as device mismatch, charge leakage, and noise, reduce the accuracy of analog arithmetic circuits, degrading the performance of large-scale adaptive systems. In this paper, we present a detailed mathematical analysis that relates different parameters of the hardware limitations to specific effects on the convergence properties of linear perceptrons trained with the least-mean-square (LMS) algorithm. Using this analysis, we derive design guidelines and introduce simple on-chip calibration techniques to improve the accuracy of analog neural networks with a small cost in die area and power dissipation. We validate our analysis by evaluating the performance of a mixed-signal complementary metal-oxide-semiconductor implementation of a 32-input perceptron trained with LMS. [ABSTRACT FROM AUTHOR]

A novel black-box modeling method for field effect transistor (FET) based on an improved K-Nearest Neighbors algorithm is proposed in this paper. K-Nearest Neighbors algorithm, which has simple algorithm structure and high accuracy, has shown great potential in regression application. A Taylor series expansion method is employed in nonlinear elements modeling of FET to improve the physical meaning of black-box model. A GaN HEMT power device is used to demonstrate the proposed method. And the experimentation shows that the calculated results using improved K-Nearest Neighbors algorithm based model fit the measurement results well. [ABSTRACT FROM AUTHOR]

Retrieval schemes often use two important components: 1) a radiative transfer model (RTM) inside the retrieval procedure or to construct the learning dataset for the training of the statistical retrieval algorithms and 2) a numerical weather prediction (NWP) model to provide a first guess or, again, to construct a learning dataset. This is particularly true in operational centers. As a consequence, any physical retrieval or similar method is limited by inaccuracies in the RTM and NWP models on which it is based. In this paper, a method for partially compensating for these errors as part of the sensor calibration is presented and evaluated. In general, RTM/NWP errors are minimized as best as possible prior to the training of the retrieval method, and then tolerated. The proposed method reduces these unknown and generally nonlinear residual errors by training a separate preprocessing neural network (NN) to produce calibrated radiances from real satellite data that approximate those radiances produced by the ''flawed'' NWP and RTM models. The final ''compensated/flawed'' retrieval assures better internal consistency of the retrieval procedure and then produces more accurate results. To the authors'' knowledge, this type of NN model has not been used yet for this purpose. The calibration approach is illustrated here on one particular application: the retrieval of atmospheric water vapor from the Advanced Microwave Scanning Radiometer for Earth Observing System (AMSR-E) and the Humidity Sounder for Brazil (HSB) measurements for nonprecipitating scenes, over land and ocean. Before being inverted, the real observations are ''projected'' into the space of the RTM simulation space from which the retrieval is designed. Validation of results is performed with radiosonde measurements and NWP analysis departures. This study shows that the NN calibration of the AMSR-E/HSB observations improves water vapor inversion, over ocean and land, for both clear and cloudy situations. The NN calibration is efficient and very general, being applicable to a large variety of problems. The nonlinearity of the NN allows for the calibration procedure to be state dependent and adaptable to specific cases (e.g., the same correction will not be applied to medium-range measurement and to extreme conditions). Its multivariate nature allows for a full exploitation of the complex correlation structure among the instrument channels, making the calibration of each single channel more robust. The procedure would make it possible to project the satellite observations in a reference observational space defined by radiosonde measurements, RTM simulations, or other instrument observational space. [ABSTRACT FROM AUTHOR]

Mathematical models, in which many input variables are involved, require a range of input and output data, since the number of parameters increases with the input variables. GMDH (Group Method of Data Handling) has been used for the identification of a mathematical model that has many input variables but limited data needs by using a hierarchical structure. This paper proposes a neuro-fuzzy (GMDH model, adopting Gaussian radial basis functions (GRBF) as partial descriptions of GMDH. GRBF is reinterpreted as both a simplified fuzzy reasoning model and as a three-layered neural network. As an example of applying the algorithm, the wheel wear equation is identified, using data from experiments of abrasive cut-off. In the model, characteristics of work materials, grinding fluids, factors of wheels, wheel velocity and table feed are used as input variables, and the grinding ratio is the resulting output. The validity of the model is confirmed within the predicted accuracy by using additional data. [ABSTRACT FROM AUTHOR]

Abstract: The focus of this paper is to propose a hybrid neural network model for associative recall of analog and digital patterns. This hybrid model consists of self-feedback neural network structures (SFNN) in parallel with generalized regression neural networks (GRNN). Using a new one-shot learning algorithm developed in the paper, pattern representations are first stored as the asymptotically stable fixed points of the SFNN. Then in the retrieving process, each pattern is applied to the GRNN to make the corresponding initial condition and to initiate the dynamical equations of the SFNN that should in turn output the corresponding representation. In this way, the corresponding stored patterns are retrieved even under high noise degradation. Moreover, contrary to many associative memories, the proposed hybrid model is without any spurious attractors and can store both binary and real-value patterns without any preprocessing. Several simulations confirm the theoretical analyses of the model. Results indicate that the performance of the hybrid model is better than that of recurrent associative memory and competitive with other classes of networks. [Copyright &y& Elsevier]

Abstract: This paper presents a nonlinear modeling approach of a proton exchange membrane fuel cell (PEMFC) based on the hybrid particle swarm optimization with Levenberg–Marquardt algorithm neural network (PSO-LM NN). The PSO algorithm converges rapidly during the initial stages of a global search, while it becomes extremely slow around the global optimum. On the contrary, the LM algorithm can achieve faster convergent speed around the global optimum, while it is prone to being trapped in the local minimum. Therefore the hybrid algorithm with a transition from PSO search to LM training is proposed to train the weights and thresholds of neural network, which aims to exploit the advantage of the both algorithms. An accurate mathematical model is an extremely useful tool for the fuel cell design, and neural network is an excellent optional tool for complex nonlinear dynamic system modeling such as PEMFC. In the paper, firstly a highly reduced PEMFC dynamic physical model is established to generate the data for the PSO-LM NN model training and validation, and then the neural network nonlinear autoregressive model based on the PSO-LM algorithm is applied in modeling PEMFC voltage and temperature model, and finally the validation test result demonstrates that the trained PSO-LM NN model can efficiently approach the dynamic behavior of a PEMFC. [Copyright &y& Elsevier]