Search

In recent years, the convergence of the Internet of Things (IoT) and machine learning technologies has instigated advancements in IoT, and machine learning has revolutionized SMEs, reshaping their role in regional economic growth. These technologies provide SMEs with innovative tools, fostering connectivity within regional ecosystems. This transformation is crucial for China's economic realignment in its 'new normal' phase, with enterprises driving social and economic progress. This study proposed the XGBoost algorithm and IoT data enhance collaboration among SMEs in regional economies, fostering innovation and driving economic development. The role of IoT and machine learning in promoting sustainable regional economic prosperity. Technological innovation is essential for enterprise survival and growth in a competitive landscape. This paper examines the influence of environmental factors and geography on economic development across China's regions. It focuses on SME coupling and coordination, contributing to regional economic progress through performance evaluation. IoT integration provides SMEs with abundant real-time data, enabling deep insights into customer behavior, supply chains, and production. Simultaneously, the XGBoost algorithm efficiently processes and extracts actionable insights from this data. Data from 11 provinces in the Yangtze River economic belt highlights Jiangsu Province's leadership in regional innovation performance for 2015 and 2020. The empirical results, grounded in datasets amalgamating information from these provinces, attest to the potential of this IoT and XGBoost-driven approach. Boasting an impressive accuracy rate of 91.7%, surpassing alternative machine learning techniques like SVM, KNN, DT, RF, and LR, this research underscores the effectiveness of this integrated strategy in optimizing SME operations. Additionally, it computes the coupling coordination degree, innovation environment ranking, mean value, and numerical changes from 2010 to 2020, with an average innovation coupling coordination degree of 0.1624 across 30 Chinese provinces. [ABSTRACT FROM AUTHOR]

Due to the large number of stock companies, complex stock categories and inconsistent evaluation standards of market value, it is not conducive to the choice of investors. Based on the theory and practice of traditional stock performance evaluation model, this paper integrates the algorithm thought structure of Fama–French five-factor model and proposes a machine learning algorithm model for stock performance research. In addition, this paper also builds a model that can evaluate the style and timing ability of fund managers to improve the fund performance evaluation system to a greater extent. With the help of the performance evaluation updating function of the model, it provides a new experience material in the empirical research composition of the fund performance field. In the system test module, the former prediction data and the actual experimental data are integrated, and the two are sorted out and compared, which proves the feasibility and effectiveness of the proposed algorithm model. The final experimental results verify the usefulness of the model in stock return prediction and analysis of influencing factors. [ABSTRACT FROM AUTHOR]

Economic progress has been founded on environmental pressure by generating all types of environmental harm, such as an increase in greenhouse gases in the atmosphere and significant climate change, which has forced people to reflect. Building a people-oriented, comprehensive, coordinated system to compile experience and lessons assists the government in formulating appropriate policies according to the meaning of the scientific development viewpoint. Based on the above, this research designs Cost–Benefit Decision Tree (CBDT) Algorithm for the economic protection development level using a Decision Tree (DT) and Ensemble Algorithm. In the design of ML Algorithm, this research work initially introduces the Decision Tree model for economic protection evaluation by emphasizing its value as a basic machine-learning framework for fully examining many aspects of economic protection development. Second, it investigates the critical role of Ensemble Algorithms, such as Random Forest in augmenting the capabilities of DT. Third, the paper focuses on the development of a complete Economic Protection Evaluation Index System using the DT Algorithm. To provide a robust, scientifically sound, and practicable framework for evaluating economic protection, this approach integrates scientificity, comparability, systematization, hierarchy, relative decoupling, and data availability principles. Finally, the study constructs the suggested ML Algorithm using the insights from the preceding parts. This algorithm combines the Decision Tree and Random Forest models to generate a single, effective tool for evaluating economic development levels. The experimental findings suggest that the proposed hybrid assessment technique is effective across several dimensions. The proposed CBDT demonstrated its capacity to adapt to changing data circumstances in evaluating low-carbon efficiency using real-world data from 30 major Chinese cities. Furthermore, the algorithm regularly beats rival techniques regarding efficiency improvements, with an average improvement of 12.5% across all cities. Notably, it outperforms other algorithms regarding computational efficiency, with a quicker execution time and an exceptional accuracy rate of 93.2%. The proposed ML Algorithm improves decision-making in the economic protection development level field by effectively balancing cost and benefit considerations. It will improve accuracy and efficiency to outperform existing approaches, thereby advancing economic protection evaluation and decision-making processes in this domain. [ABSTRACT FROM AUTHOR]

In this paper, we study numerical solution of ruin probability of continuous time model. We develop an effective optimal adaptive particle swarm optimization-triangular neural network (PSO-TNN), which consists of three parts: particle swarm optimization algorithm (PSO) improved trigonometric function, extreme learning machine algorithm with initial conditions (IELM) and improved reduction algorithm. The results obtained that PSO-TNN is superior to triangular neural network (TNN) and physics-informed neural networks (PINNs), and PSO is superior to Aquila Optimizer (AO), Smell Agent Optimization (SAO), African vultures optimization algorithm (AVOA), Arithmetic optimization algorithm (AOA) in the optimization of neural network. Because the relationship between the number of neural networks and the mean square error is uncertain, we propose the adaptive reduction algorithm (AR). Through the comparison of numerical solutions with the analytical solutions and traditional numerical solutions, the PSO-TNN algorithm clearly reduced the mean square error and relative error. The PSO-TNN algorithm shows a clear improvement in terms of accuracy and overall efficiency. [ABSTRACT FROM AUTHOR]

In this paper, the quantum technology is exploited to empower the OPTICS unsupervised learning algorithm, which is a density-based clustering algorithm with numerous applications in the real world. We design an algorithm called Quantum Ordering Points To Identify the Clustering Structure (QOPTICS) and demonstrate that its computational complexity outperforms that of its classical counterpart. On the other hand, we propose a Deep self-learning approach for modeling the improvement of two Swarm Intelligence Algorithms, namely Artificial Orca Algorithm (AOA) and Elephant Herding Optimization (EHO) in order to improve their effectiveness. The deep self-learning approach is based on two well-known dynamic mutation operators, namely Cauchy mutation operator and Gaussian mutation operator. And in order to improve the efficiency of these algorithms, they are hybridized with QOPTICS and executed on just one cluster it yields. This way, both effectiveness and efficiency are handled. To evaluate the proposed approaches, an intelligent application is developed to manage the dispatching of emergency vehicles in a large geographic region and in the context of Covid-19 crisis in order to avoid an important loss in human lives. A theoretical model is designed to describe the issue mathematically. Extensive experiments are then performed to validate the mathematical model and evaluate the performance of the proposed deep self-learning algorithms. Comparison with a state-of-the-art technique shows a significant positive impact of hybridizing Quantum Machine Learning (QML) with Deep Self Learning (DSL) on solving the Covid-19 EMS transportation. [ABSTRACT FROM AUTHOR]

Hyperparameter optimization plays a significant role in the overall performance of machine learning algorithms. However, the computational cost of algorithm evaluation can be extremely high for complex algorithm or large dataset. In this paper, we propose a model-based reinforcement learning with experience variable and meta-learning optimization method to speed up the training process of hyperparameter optimization. Specifically, an RL agent is employed to select hyperparameters and treat the k-fold cross-validation result as a reward signal to update the agent. To guide the agent's policy update, we design an embedding representation called "experience variable" and dynamically update it during the training process. Besides, we employ a predictive model to predict the performance of machine learning algorithm with the selected hyperparameters and limit the model rollout in short horizon to reduce the impact of the inaccuracy of the model. Finally, we use the meta-learning technique to pre-train the model for fast adapting to a new task. To prove the advantages of our method, we conduct experiments on 25 real HPO tasks and the experimental results show that with the limited computational resources, the proposed method outperforms the state-of-the-art Bayesian methods and evolution method. [ABSTRACT FROM AUTHOR]

The stability of a feature selection (FS) algorithm is one of the most crucial issues when working with a machine learning model. Until now, various stability measures based on a subset of features have been proposed. However, they lack consideration for feature ranking which is equally important to judge the robustness of algorithms. This paper proposes a novel frequency-based stability measure called rank stability (RSt) that evaluates FS algorithms on both criteria, i.e., subsets of features and feature rankings. The proposed measure evaluates the variation of feature rankings generated by FS algorithms after making a small perturbation to the training set. We mathematically justify the proposed measure based on the earlier and newly defined desirable properties. Additionally, we explore various heterogeneous ensemble techniques and compare them with traditional FS algorithms on real-world datasets. We perform extensive experiments to demonstrate that the heterogeneous ensemble techniques perform better than traditional FS algorithms with respect to the proposed measure and other performance metrics. [ABSTRACT FROM AUTHOR]

It is hard to come up with a strong learning algorithm with high cross-media retrieval accuracy, but finding a weak learning algorithm with slightly higher accuracy than random prediction is simple. This paper proposes an innovative Bagging-based cross-media retrieval algorithm (called BCMR) based on this concept. First, we use bootstrap sampling to take a random sample from the original set. The amount of sample abstracted by bootstrapping is set to be the same as the amount of sample abstracted by the original dataset. Secondly, 50 bootstrap replicates are used to train 50 weak classifiers. In our experiments, we used homogeneous individual classifiers and eight different baseline methods. Last but not least, we generate the final strong classifier from 50 weak classifiers using the sample voting integration strategy. Using collective wisdom, we can get rid of bad decisions, giving the integrated model a much better generalization ability. Extensive experiments on three datasets show that BCMR can significantly improve cross-media retrieval accuracy. [ABSTRACT FROM AUTHOR]

Reconstruction of cross-cut shredded text documents (RCCSTD) has important applications for information security and judicial evidence collection. The traditional method of manual construction is a very time-consuming task, so the use of computer-assisted efficient reconstruction is a crucial research topic. Fragment consensus information extraction and fragment pair compatibility measurement are two fundamental processes in RCCSTD. Due to the limitations of the existing classical methods of these two steps, only documents with specific structures or characteristics can be spliced, and pairing error is larger when the cutting is more fine-grained. In order to reconstruct the fragments more effectively, this paper improves the extraction method for consensus information and constructs a new global pairwise compatibility measurement model based on the extreme learning machine algorithm. The purpose of the algorithm's design is to exploit all available information and computationally suggest matches to increase the algorithm's ability to discriminate between data in various complex situations, then find the best neighbor of each fragment for splicing according to pairwise compatibility. The overall performance of our approach in several practical experiments is illustrated. The results indicate that the matching accuracy of the proposed algorithm is better than that of the previously published classical algorithms and still ensures a higher matching accuracy in the noisy datasets, which can provide a feasible method for RCCSTD intelligent systems in real scenarios. [ABSTRACT FROM AUTHOR]

Label-specific features learning can effectively exploit the unique features of each label, which alleviates the high dimensionality and improves the classification performance of multi-label. However, most existing label-specific features learning algorithms assume that label space is complete, ignoring the effect of missing labels on the classification accuracy. Some methods try to recover the missing labels first and then learn the mapping between the completed label matrix and the feature matrix. However, early intervention in the recovery of missing labels may affect the distribution of original labels to a certain extent. In this paper, feature-label dual-mapping for missing label-specific features learning is proposed. According to the information that the label depends on the feature, the dual-mapping weight of the complete feature space and the missing label space is jointly learned. Therefore, the proposed algorithm is to conduct latent missing labels recovery by feature-label dual-mapping to directly obtain target weight in this paper, avoiding the negative influence of early label recovery intervention. Compared with several state-of-the-art methods in 10 benchmark multi-label data sets, the results show that the proposed algorithm is reasonable and effective. [ABSTRACT FROM AUTHOR]

In order to solve the problems of low learning efficiency and slow convergence speed when mobile robot uses reinforcement learning method for path planning in complex environment, a reinforcement learning method based on each round path planning result is proposed. Firstly, the algorithm adds obstacle learning matrix to improve the success rate of path planning; and introduces heuristic reward to speed up the learning process by reducing the search space; then proposes a method of dynamically adjusting the exploration factor to balance the exploration and utilization in path planning, so as to further improve the performance of the algorithm. Finally, the simulation experiment in grid environment shows that compared with Q-learning algorithm, the improved algorithm not only shortens the average path length of the robot to reach the target position, but also speeds up the learning efficiency of the algorithm, so that the robot can find the optimal path more quickly. The code of EPRQL algorithm proposed in this paper has been published to GitHub: https://github.com/panpanpanguoguoqian/mypaper1.git. [ABSTRACT FROM AUTHOR]

Heart disease is the most life-threatening disease globally, affecting human life very critically. On-time and precise diagnosis of heart disease is vital for the prevention and treatment of heart failure. In the earlier stage, several detection techniques were developed to detect heart disease using machine learning techniques. But the heart problems have not been detected accurately with the minimum required time. This paper presented an effective heart disease prediction system that accurately diagnoses abnormality within a short duration. The feature selection process is carried with stochastic gradient boosting with a recursive feature elimination approach. For classification, the features are clustered by using the adaptive Harris hawk optimization clustering approach. Based on clustered features, the classification is processed with an enhanced deep genetic algorithm. This method improves the performance of the deep neural network by augmenting its initial weights with an enhanced genetic algorithm, which recommends better weights for the neural network. The demonstration of the proposed work is simulated in the MATLAB platform and the dataset used in UCI machine learning repository. The experimental outcome shows that the developed feature selection and classification approach attain 98.36% and 97.3% accuracy compared with the state-of-the-art techniques. [ABSTRACT FROM AUTHOR]

Fuzzy support vector machine and their variants are prominent classification techniques that reduce the adverse effects of noises and outliers as compare to classical support vector machine. However, in these methods, only the distance between the training pattern and the class center is considered, and hence, the edge support vectors cannot be distinguished from noises and outliers properly. These limitations are overcome by intuitionistic fuzzy-based support vector machine which allocate two parameters (membership and non-membership degrees) to each pattern of a dataset and hence define score number based on the importance of a pattern. In this paper, an intuitionistic fuzzy proximal support vector machine for multi-category classification problems is proposed. The method significantly reduces the impacts of noises and outliers present in the dataset by assigning the intuitionistic fuzzy score function to each training point based on its location and surroundings. Moreover, the method is computationally efficient as the robust classifiers are obtained by solving the system of linear equations instead of large size quadratic programming problems. In the proposed method, using polynomial and Gaussian kernels, the hyperplanes are also developed in the feature space. The geometrical advantages of the suggested method over the existing techniques are ascertained using the simulated two-dimensional artificial dataset having three target classes. Further, extensive experimental studies on ten UCI benchmark datasets have been performed which demonstrate that the proposed algorithm predicts more precisely about future data as comparison to some well-established algorithms. Figures are also illustrated by varying different parameters involved in the model which confirms the performance of the method over the existing algorithms. Moreover, the analysis of the predictive behavior of the proposed approach is done using the Friedman test, a nonparametric alternative to the analysis of variance test at 5 % significance level. Further, the proposed method has also been applied to image classification and gesture-phase segmentation problems which confirms the efficiency and handling capabilities of the proposed algorithm in practical applications. [ABSTRACT FROM AUTHOR]

In recent decades, researches on optimizing the parameter of the artificial neural network (ANN) model has attracted significant attention from researchers. Hybridization of superior algorithms helps improving optimization performance and capable of solving complex applications. As a traditional gradient-based learning algorithm, ANN suffers from a slow learning rate and is easily trapped in local minima when training techniques such as gradient descent (GD) and back-propagation (BP) algorithm are used. The characteristics of randomization and selection of the best or near-optimal solution of metaheuristic algorithm provide an effective and robust solution; therefore, it has always been used in training of ANN to improve and overcome the above problems. New metaheuristic algorithms are proposed every year. Therefore, the review of its latest developments is essential. This article attempts to summarize the metaheuristic algorithms which have been proposed from the year 1975 to 2020 from various journals, conferences, technical papers, and books. The comparison of the popularity of the metaheuristic algorithm is presented in two time frames, such as algorithms proposed in the recent 20 years and those proposed earlier. Then, some of the popular metaheuristic algorithms and their working principle are reviewed. This article further categorizes the latest metaheuristic search algorithm in the literature to indicate their efficiency in training ANN for various industry applications. More and more researchers tend to develop new hybrid optimization tools by combining two or more metaheuristic algorithms to optimize the training parameters of ANN. Generally, the algorithm's optimal performance must be able to achieve a fine balance of their exploration and exploitation characteristics. Hence, this article tries to compare and summarize the properties of various metaheuristic algorithms in terms of their convergence rate and the ability to avoid the local minima. This information is useful for researchers working on algorithm hybridization by providing a good understanding of the convergence rate and the ability to find a global optimum. [ABSTRACT FROM AUTHOR]

Efficient face recognition can realize fast and accurate face recognition and make it widely used in essential fields such as human–computer interaction and access control. At present, there are many face recognition methods whose recognition rate can reach high accuracy, but the training of the model and the recognition of samples take much time, which leads to insufficient real-time performance. This paper designs a fusion facial semantic feature (FFSF) and an incremental learning mechanism (ILM) for efficient face recognition. FFSF feature is a fusion of facial contour features and facial semantic component features, which can extract contour features and interior features of facial organs (eyes, mouth, nose, and eyebrow) according to facial organs' position. FFSF features can ensure that the extracted features are concentrated in the face's most discriminative region, making the extracted features have good discriminative characteristics. Then, we use a clustering algorithm to construct a hierarchical incremental learning tree (HIL-Tree) with a hierarchical structure and use the HIL-Tree to implement the ILM. ILM achieves fast and accurate sample classification by retrieving the nodes in HIL-Tree, and the training samples can be directly added to the HIL-Tree by retrieval instead of rebuilding the HIL-Tree during the training process. Extensive experiments on several public data sets demonstrate the proposed efficient face recognition method's excellent accuracy and efficiency. [ABSTRACT FROM AUTHOR]

Formal concept analysis (FCA) is an unsupervised machine learning technique used for knowledge discovery and representation. A major task in FCA is the enumeration of the implications to construct the implication base. Even though there are many efficient classical and parallel algorithms proposed for constructing the implication base, the existing algorithms are not well suited for large formal contexts because of their architectural complexity. All the existing works use either stem-base or proper-premise approach to find the implication base in exponential time. Hence, we introduce a distributed algorithm to find the implication base quickly in larger datasets in polynomial time. In this paper, we propose a scalable algorithm to find the implication base using machine learning technique FP-growth, big data processing framework Apache Spark and executed on large formal contexts. Extensive experiments on the real-world datasets show that the proposed algorithm has an improved gain in performance metrics such as execution time, CPU and memory usage. The statistical validations on the experimental results prove that the proposed algorithm has the better potential to find the implication base. [ABSTRACT FROM AUTHOR]

Machine learning (ML) algorithms, such as neural networks, random forest, and more recent deep learning, are illustrating their utility for waste recycling. The increasing computational power of ML makes waste generation prediction, even at municipal level, possible with satisfying accuracy. ML is so critical and efficient and yet it is severely under-researched in recycling business. Also, the ML application in the recycling business is still a niche area judged by the limitations in its literature sources, the research domains, the ML algorithms' use and benefits involved or reported in the literature. To unlock the value of ML in recycling business, this paper reviewed 51 related articles systematically and presents the current obstacles and future directions in applying ML to waste recycling industries. [ABSTRACT FROM AUTHOR]

Classification is one of the foremost machine learning tasks in this modern era. Neural Network (NN) is one of the powerful classification techniques. NN can achieve high classification accuracy on highly imbalanced and complex datasets, but lacks in explanation of its reasoning process which limits its applicability in various domains which require transparent decision along with good accuracy. There are some techniques which extract rules from NN and make it transparent; however, attribute pruning, rule pruning and class overlap algorithms are not sufficiently effective. Therefore, this paper proposes a rule extraction algorithm, called Transparent Rule Extraction using Neural Network (TRENN) to convert NN into white box with greater emphasis on attribute pruning and rule pruning. The proposed TRENN is a pedagogical approach and an extension of one of the existing algorithms named Rule Extraction from Neural Network using Classified and Misclassified data (RxNCM). The proposed TRENN extends the RxNCM with sequential floating backward search for feature and rule selection to improve the comprehensibility of the generated rules. Besides, the proposed TRENN uses probabilistic approach for the treatment of class overlapping problem in the rule updating phase instead of reclassification used in RxNCM where the overlap may persist. Experiments are conducted with eight real datasets collected from the UCI repository. Performance of the TRENN is measured with Precision, Recall, FP-Rate, F-measure, and local and global comprehensibility. It is observed from the experimental results that TRENN performs better than Re-RX, RxNCM and RxREN. [ABSTRACT FROM AUTHOR]

In this paper, we present a new evolution-based algorithm that optimizes cell detection image processing workflows in a self-adaptive fashion. We use evolution strategies to optimize the parameters for all steps of the image processing pipeline and improve cell detection results. The algorithm reliably produces good cell detection results without the need for extensive domain knowledge. Our algorithm also needs no labeled data to produce good cell detection results compared to the state-of-the-art neural network approaches. Furthermore, the algorithm can easily be adapted to different applications by modifying the processing steps in the pipeline and has high scalability since it supports multithreading and computation on graphical processing units (GPUs). [ABSTRACT FROM AUTHOR]

Clustering ensemble can overcome the instability of clustering and improve clustering performance. With the rapid development of clustering ensemble, we find that not all clustering solutions are effective in their final result. In this paper, we focus on selection strategy in selective clustering ensemble. We propose a multiple clustering and selecting approach (MCAS), which is based on different original clustering solutions. Furthermore, we present two combining strategies, direct combining and clustering combining, to combine the solutions selected by MCAS. These combining strategies combine results of MCAS and get a more refined subset of solutions, compared with traditional selective clustering ensemble algorithms and single clustering and selecting algorithms. Experimental results on UCI machine learning datasets show that the algorithm that uses multiple clustering and selecting algorithms with combining strategy performs well on most datasets and outperforms most selective clustering ensemble algorithms. [ABSTRACT FROM AUTHOR]

Recently, the problem of indoor localization based on WLAN signals is attracting increasing attention due to the development of mobile devices and the widespread construction of networks. However, no definitive solution for achieving a low-cost and accurate positioning system has been found. In most traditional approaches, solving the indoor localization problem requires the availability of a large number of labeled training samples, the collection of which requires considerable manual effort. Previous research has not provided a means of simultaneously reducing human calibration effort and improving location accuracy. This paper introduces fusion semi-supervised extreme learning machine (FSELM), a novel semi-supervised learning algorithm based on the fusion of information from Wi-Fi and Bluetooth Low Energy (BLE) signals. Unlike previous semi-supervised methods, which consider multiple signals individually, FSELM fuses multiple signals into a unified model. When applied to sparsely calibrated localization problems, our proposed method is advantageous in three respects. First, it can dramatically reduce the human calibration effort required when using a semi-supervised learning framework. Second, it utilizes fused Wi-Fi and BLE fingerprints to markedly improve the location accuracy. Third, it inherits the beneficial properties of ELMs with regard to training and testing speeds because the input weights and biases of hidden nodes can be generated randomly. As demonstrated by experimental results obtained on practical indoor localization datasets, FSELM possesses a better semi-supervised manifold learning ability and achieves higher location accuracy than several previous batch supervised learning approaches (ELM, BP and SVM) and semi-supervised learning approaches (SELM, S-RVFL and FS-RVFL). Moreover, FSELM needs less training and testing time, making it easier to apply in practice. We conclude through experiments that FSELM yields good results when applied to a multi-signal-based semi-supervised learning problem. The contributions of this paper can be summarized as follows: First, the findings indicate that effective multi-data fusion can be achieved not only through data-layer fusion, feature-layer fusion and decision-layer fusion but also through the fusion of constraints within a model. Second, for semi-supervised learning problems, it is necessary to combine the advantages of different types of data by optimizing the model’s parameters. [ABSTRACT FROM AUTHOR]

The qualities of new data used in the sequential learning phase of the online sequential extreme learning machine algorithm (OS-ELM) have a significant impact on the performance of OS-ELM. This paper proposes a novel data filter mechanism for OS-ELM from the perspective of fuzziness and a fuzziness-based online sequential extreme learning machine algorithm (FOS-ELM). In FOS-ELM, when new data arrive, a fuzzy classifier first picks out the meaningful data according to the fuzziness of each sample. Specifically, the new samples with high-output fuzziness are selected and then used in sequential learning. The experimental results on eight binary classification problems and three multiclass classification problems have shown that FOS-ELM updated by the new samples with high-output fuzziness has better generalization performance than OS-ELM. Since the unimportant data are discarded before sequential learning, FOS-ELM can save more memory and have higher computational efficiency. In addition, FOS-ELM can handle data one-by-one or chunk-by-chunk with fixed or varying sizes. The relationship between the fuzziness of new samples and the model performance is also studied in this paper, which is expected to provide some useful guidelines for improving the generalization ability of online sequential learning algorithms. [ABSTRACT FROM AUTHOR]

Nowadays, it has become well known that efficient training of deep neural networks plays a vital role in various successful applications. To achieve this goal, it is impractical to use only one computer, especially when the scale of models is large and some efficient computing resources are available. In this paper, we present a distributed parallel computing framework for training deep belief networks (DBNs) by employing the great power of high-performance clusters (i.e., a system consists of many computers). Motivated by the greedy layer-wise learning algorithm of DBNs, the whole training process is divided layer by layer and distributed to different machines. At the same time, rough representations are exploited to parallelize the training process. By conducting experiments on several large-scale real datasets, the novel algorithms are shown to significantly accelerate the training speed of DBNs while achieving better or competitive prediction accuracy in comparison with the original algorithm. [ABSTRACT FROM AUTHOR]

Feature selection is one of the hottest machine learning topics in recent years. The main purposes of it are to simplify the original model, improve the readability of the model, and prevent over-fitting by searching for a suitable subset of features. There are many methods for this problem, including evolutionary algorithms and particle swarm optimization. Among them, the competitive swarm optimizer is a new optimization algorithm proposed in recent years, which is based on particle swarm optimization algorithm, and has achieved good results in high-dimensional feature selection problems, but it also has the problems of high computation time cost and easily being premature. Aiming at these problems, this paper proposes to add the crossover operator and mutation operator in the genetic algorithm to the competitive swarm optimization, so as to improve the generation speed of new individuals in the algorithm and prevent premature population. After testing on UC Irvine Machine Learning Repository, the new algorithm not only improves the computational efficiency, but also avoids the problem that the competitive swarm optimization algorithm is easy to fall into the local optimum, which greatly improves the calculation effect. [ABSTRACT FROM AUTHOR]

Neural network (NN) finds role in variety of applications due to combined effect of feature extraction and classification availability in deep learning algorithms. In this paper, we have chosen SVM, logistic regression machine learning algorithms and NN for EEG signal classification. Two-layer LSTM and four-layer improved NN deep learning algorithms are proposed to improve the performance in EEG classification. Novelty lies in one-dimensional gradient descent activation functions with radial basis operations used in the initial layers of improved NN which help in achieving better performance. Statistical features namely mean, standard deviation, kurtosis and skewness are extracted for input EEG collected from Bonn database and then applied for various classification techniques. Accuracy, precision, recall and F1 score are the performance metrics used for analyzing the algorithms. Improved NN and LSTM give better performance compared to all other architectures. The simulations are carried out with variety of activation functions, optimizers and loss models to analyze the performance using Python in keras. [ABSTRACT FROM AUTHOR]

The internet has provided numerous modes for secure data transmission from one end station to another, and email is one of those. The reason behind its popular usage is its cost-effectiveness and facility for fast communication. In the meantime, many undesirable emails are generated in a bulk format for a monetary benefit called spam. Despite the fact that people have the ability to promptly recognize an email as spam, performing such task may waste time. To simplify the classification task of a computer in an automated way, a machine learning method is used. Due to limited availability of datasets for email spam, constrained data and the text written in an informal way are the most feasible issues that forced the current algorithms to fail to meet the expectations during classification. This paper proposed a novel, spam mail detection method based on the document labeling concept which classifies the new ones into ham or spam. Moreover, algorithms like Naive Bayes, Decision Tree and Random Forest (RF) are used in the classification process. Three datasets are used to evaluate how the proposed algorithm works. Experimental results illustrate that RF has higher accuracy when compared with other methods. [ABSTRACT FROM AUTHOR]

In high-dimensional data, many of the features are either irrelevant to the machine learning task or are redundant. These situations lead to two problems, firstly overfitting and secondly high computational overhead. The paper proposes a feature selection method to identify the relevant subset of features for the machine-learning task using wrapper approach. The wrapper approach uses the Binary Bat algorithm to select the set of features and One-pass Generalized Classifier Neural Network (OGCNN) to evaluate the selected set of features using a novel fitness function. The proposed fitness function accounts for the entropy of sensitivity and specificity along with accuracy of classifier and fraction of selected features. The fitness function is compared using four classifiers (Radial Basis Function Neural Network, Probabilistic Neural Network, Extreme Learning Machine and OGCNN) on six publicly available datasets. One-pass classifiers are chosen as these are computationally faster. The results suggest that OGCNN along with the novel fitness function performs well in the majority of cases. [ABSTRACT FROM AUTHOR]

Reconstructing gene regulatory networks (GRNs) from gene expression data is an important and challenging problem in system biology. In general, the problem of reconstructing GRNs can be modeled as an optimization problem. Recurrent neural network (RNN) has been widely used for GRNs. However, in a real GRN, the number of genes is very large and the relationships between genes are usually very sparse. In this paper, we design a memetic algorithm to learn partial parameters of RNN, and develop a framework based on the least absolute shrinkage and selection operator (LASSO) to reconstruct GRNs based on RNN, which is termed as MALASSORNN-GRN. In the LASSO, the task of reconstructing GRNs is decomposed into a sparse signal reconstructing problem. In the experiments, MALASSORNN-GRN is applied on synthetic data and well-known benchmark datasets DREAM3 and DREAM4. The effect of parameters on MALASSORNN-GRN is discussed, and MALASSORNN-GRN is compared with three other algorithms which are all state-of-the-art RNN learning algorithms. The results show that MALASSORNN-GRN performs best and is capable of reconstructing large-scale GRNs. [ABSTRACT FROM AUTHOR]

To provide a new numerical algorithm for solving elliptic partial differential equations (PDEs), the Legendre neural network (LNN) and improved extreme learning machine (IELM) algorithm are introduced to propose a Legendre improved extreme learning machine (L-IELM) method, which is applied to solving elliptic PDEs in this paper. The product of two Legendre polynomials is chosen as basis functions of hidden neurons. Single hidden layer LNN is used to construct approximate solutions and its derivatives of differential equations. IELM algorithm is used for network weights training, and the algorithm steps of the proposed L-IELM method are summarized. Finally, in order to evaluate the present algorithm, various test examples are selected and solved by the proposed approach to validate the calculation accuracy. Comparative study with the earlier methods in literature is described to verify the superiority of the presented L-IELM method. Experiment results show that the proposed L-IELM algorithm can perform well in terms of accuracy and execution time, which in addition provides a new algorithm for solving elliptic PDEs. [ABSTRACT FROM AUTHOR]

Evolutionary algorithms are widely used for solving multiobjective optimization problems but are often criticized because of a large number of function evaluations needed. Approximations, especially function approximations, also referred to as surrogates or metamodels are commonly used in the literature to reduce the computation time. This paper presents a survey of 45 different recent algorithms proposed in the literature between 2008 and 2016 to handle computationally expensive multiobjective optimization problems. Several algorithms are discussed based on what kind of an approximation such as problem, function or fitness approximation they use. Most emphasis is given to function approximation-based algorithms. We also compare these algorithms based on different criteria such as metamodeling technique and evolutionary algorithm used, type and dimensions of the problem solved, handling constraints, training time and the type of evolution control. Furthermore, we identify and discuss some promising elements and major issues among algorithms in the literature related to using an approximation and numerical settings used. In addition, we discuss selecting an algorithm to solve a given computationally expensive multiobjective optimization problem based on the dimensions in both objective and decision spaces and the computation budget available. [ABSTRACT FROM AUTHOR]

Imbalanced problems are quite pervasive in many real-world applications. In imbalanced distributions, a class or some classes of data, called minority class(es), is/are under-represented compared to other classes. This skewness in the data underlying distribution causes many difficulties for typical machine learning algorithms. The notion becomes even more complicated when machine learning algorithms are to combat multi-class imbalanced problems. The presented solutions for tackling the issues arising from imbalanced distributions, generally fall into two main categories: data-oriented methods and model-based algorithms. Focusing on the latter, this paper suggests an elegant blend of boosting and over-sampling paradigms, which is called MDOBoost, to bring considerable benefits to the learning ability of multi-class imbalanced data sets. The over-sampling technique introduced and adopted in this paper, Mahalanobis distance-based over-sampling technique (MDO in short), is delicately incorporated into boosting algorithm. In fact, the minority classes are over-sampled via MDO technique in such a way that they almost preserve the original minority class characteristics. MDO, in comparison with the popular method in this field, SMOTE, generates more similar minority class examples to original class samples. Moreover, the broader representation of minority class examples is provided via MDO, and this, in turn, causes the classifier to build larger decision regions. MDOBoost increases the generalization ability of a classifier, since it indicates better results with pruned version of C4.5 classifier; unlike other over-sampling/boosting procedures, which have difficulties with pruned version of C4.5. MDOBoost is applied to real-world multi-class imbalanced benchmarks and its performance is then compared with several data-level and model-based algorithms. The empirical results and theoretical analyses reveal that MDOBoost offers superior advantages compared to popular class decomposition and over-sampling techniques in terms of MAUC, G-mean, and minority class recall. [ABSTRACT FROM AUTHOR]

Focusing on non-iterative approaches in training feed-forward neural networks, this special issue includes 12 papers to share the latest progress, current challenges, and potential applications of this topic. This editorial presents a background of the special issue and a brief introduction to the 12 contributions. [ABSTRACT FROM AUTHOR]

Learning from categorical data is a critical yet challenging task. Current research focuses on either leveraging the complex interaction between and within categorical values to generate a numerical representation, or designing a model that can tackle this types of data directly. However, both of these paradigms overlook the relation between the data characteristics and learning model hypothesis. In this paper, we propose a model-aware categorical data embedding framework that jointly reveals the intrinsic categorical data characteristics and optimizes the fitness of the representation for the follow-up learning model. An ELM-aware and a SVM-aware representation methods have been instantiated under this framework. Extensive experiments of classification with the embedded representation on 17 data sets demonstrate that the proposed framework can significantly improve the categorical data representation performance compared with state-of-the-art competitors. [ABSTRACT FROM AUTHOR]

With the rapid development of machine learning, artificial intelligence (AI) has drawn much more attention. Under this circumstances, abstract strategy games, such as chess, checkers and Go, have been a fascinating problem of AI research. Most of the existing state-of-the-art Go programs used deep neural network technology, like convolutional neural networks (CNNs). However, CNNs require multiple iterations to optimize weights and spend a lot of training time. Therefore, in this paper, in order to solve the above shortcomings, we propose a new learning algorithm ECNN, which integrates CNNs with extreme learning machine (ELM). We remove pooling layers of CNNs and insert ELM layers between convolutional layers. The newly added ELM layers will be updated in back-propagation process, and they accelerate the convergence of weights in CNNs. Therefore, our ECNN can reduce the training time of CNNs. Further, we propose ECNN-Go algorithm, which applies ECNN to Go game. Because of the advantage of ECNN, ECNN-Go algorithm has the fast learning speed to make move prediction in Go game. Finally, the experimental results show the efficiency and accuracy of ECNN algorithm and demonstrate the strength of ECNN-Go. [ABSTRACT FROM AUTHOR]

Reasonable burden distribution matrix is one of important requirements that can realize low consumption, high efficiency, high quality and long campaign life of the blast furnace. This paper proposes a data-driven prediction model of adjusting the burden distribution matrix based on the improved multilayer extreme learning machine (ML-ELM) algorithm. The improved ML-ELM algorithm is based on our previously modified ML-ELM algorithm (named as PLS-ML-ELM) and the ensemble model. It is named as EPLS-ML-ELM. The PLS-ML-ELM algorithm uses the partial least square (PLS) method to improve the algebraic property of the last hidden layer output matrix for the ML-ELM algorithm. However, the PLS-ML-ELM algorithm may have different results in different trails of simulations. The ensemble model can overcome this problem. Moreover, it can improve the generalization performance. Hence, the EPLS-ML-ELM algorithm is consisted of several PLS-ML-ELMs. The real blast furnace data are used to testify the data-driven prediction model. Compared with other prediction models which are based on the SVM algorithm, the ELM algorithm, the ML-ELM algorithm and the PLS-ML-ELM algorithm, the simulation results demonstrate that the data-driven prediction model based on the EPLS-ML-ELM algorithm has better prediction accuracy and generalization performance. [ABSTRACT FROM AUTHOR]

Extreme learning machine (ELM) is a non-iterative algorithm for training single-hidden layer feed-forward networks, whose training speed is much faster than those of conventional neural networks. However, its objective is only to minimize the empirical risk, which may cause overfitting easily. To overcome this defect, this paper proposes a novel algorithm named LGE2LM based on the localized generalization error model which provides an upper bound of generalization error through adopting the stochastic sensitivity. LGE2LM aims to improve the generalization capability of ELM by using the regularization technique which makes a trade-off between the empirical risk and the stochastic sensitive measure. The essence of LGE2LM is a quadratic problem without iterative process. Similar to ELM, all the parameters of this new algorithm are obtained without tuning, which makes the efficiency of LGE2LM much higher than those of traditional neural networks. Several experiments conducted on both artificial and real-world datasets show that LGE2LM has much better generalization capability and stronger robustness in comparison with ELM. [ABSTRACT FROM AUTHOR]

Density peaks clustering (DPC) algorithm is able to get a satisfactory result with the help of artificial selecting the clustering centers, but such selection can be hard for a large amount of clustering tasks or the data set with a complex decision diagram. The purpose of this paper is to propose an automatic clustering approach without human intervention. Inspired by the visual selection rule of DPC, the judgment index which equals the lower value within density and distance (after normalization) is proposed for selecting the clustering centers. The judgment index approximately follows the generalized extreme value (GEV) distribution, and each clustering center’s judgment index is much higher. Hence, it is reasonable that the points are selected as clustering centers if their judgment indices are larger than the upper quantile of GEV. This proposed method is called density peaks clustering based on generalized extreme value distribution (DPC-GEV). Furthermore, taking the computational complexity into account, an alternative method based on density peak detection using Chebyshev inequality (DPC-CI) is also given. Experiments on both synthetic and real-world data sets show that DPC-GEV and DPC-CI can achieve the same accuracy as DPC on most data sets but consume much less time. [ABSTRACT FROM AUTHOR]

Urban traffic congestion prediction is a very hot topic due to the environmental and economical impacts that currently implies. In this sense, to be able to predict bottlenecks and to provide alternatives to the circulation of vehicles becomes an essential task for traffic management. A novel methodology, based on ensembles of machine learning algorithms, is proposed to predict traffic congestion in this paper. In particular, a set of seven algorithms of machine learning has been selected to prove their effectiveness in the traffic congestion prediction. Since all the seven algorithms are able to address supervised classification, the methodology has been developed to be used as a binary classification problem. Thus, collected data from sensors located at the Spanish city of Seville are analyzed and models reaching up to 83 % are generated. [ABSTRACT FROM AUTHOR]

Instance selection is an important research problem of data pre-processing in the data mining field. The aim of instance selection is to reduce the data size by filtering out noisy data, which may degrade the mining performance, from a given dataset. Genetic algorithms have presented an effective instance selection approach to improve the performance of data mining algorithms. However, current approaches only pursue the simplest evolutionary process based on the most reasonable and simplest rules. In this paper, we introduce a novel instance selection algorithm, namely a genetic-based biological algorithm (GBA). GBA fits a 'biological evolution' into the evolutionary process, where the most streamlined process also complies with the reasonable rules. In other words, after long-term evolution, organisms find the most efficient way to allocate resources and evolve. Consequently, we can closely simulate the natural evolution of an algorithm, such that the algorithm will be both efficient and effective. Our experiments are based on comparing GBA with five state-of-the-art algorithms over 50 different domain datasets from the UCI Machine Learning Repository. The experimental results demonstrate that GBA outperforms these baselines, providing the lowest classification error rate and the least storage requirement. Moreover, GBA is very computational efficient, which only requires slightly larger computational cost than GA. [ABSTRACT FROM AUTHOR]

Fuzzy neural network (FNN) has long been recognized as an efficient and powerful learning machine for general machine learning problems. Recently, Wilcoxon fuzzy neural network (WFNN), which generalizes the rank-based Wilcoxon approach for linear parametric regression problems to nonparametric neural network, was proposed aiming at improving robustness against outliers. FNN and WFNN are nonparametric models in the sense that they put no restrictions, except possibly smoothness, on the functional form of the regression function. However, they may be difficult to interpret and, even worse, yield poor estimates with high computational cost when the number of predictor variables is large. To overcome this drawback, semiparametric models have been proposed in statistical regression theory. A semiparametric model keeps the easy interpretability of its parametric part and retains the flexibility of its nonparametric part. Based on this, semiparametric FNN and semiparametric WFNN will be proposed in this paper. The learning rules are based on the backfitting procedure frequently used in semiparametric regression. Simulation results show that the semiparametric models perform better than their nonparametric counterparts. [ABSTRACT FROM AUTHOR]

In the classification framework there are problems in which the number of examples per class is not equitably distributed, formerly known as imbalanced data sets. This situation is a handicap when trying to identify the minority classes, as the learning algorithms are not usually adapted to such characteristics. An usual approach to deal with the problem of imbalanced data sets is the use of a preprocessing step. In this paper we analyze the usefulness of the data complexity measures in order to evaluate the behavior of undersampling and oversampling methods. Two classical learning methods, C4.5 and PART, are considered over a wide range of imbalanced data sets built from real data. Specifically, oversampling techniques and an evolutionary undersampling one have been selected for the study. We extract behavior patterns from the results in the data complexity space defined by the measures, coding them as intervals. Then, we derive rules from the intervals that describe both good or bad behaviors of C4.5 and PART for the different preprocessing approaches, thus obtaining a complete characterization of the data sets and the differences between the oversampling and undersampling results. [ABSTRACT FROM AUTHOR]

Abstract  Aiming at the common support vector machine’s biased disadvantage and computational complexity, an unbiased least squares support vector machine (LSSVM) model is proposed in this paper. The model eliminates the bias item of LSSVM by improving the form of structure risk, then the unbiased least squares support vector classifier and the unbiased least squares support vector regression are deduced. Based on this model, we design a new learning algorithm using Cholesky factorization according to the characteristic of kernel function matrix, in this way the calculation of Lagrangian multipliers is greatly simplified. Several experiments on diffenert datasets are carried out, including the common datasets classification, synthetic aperture radar image automatic target recognition and chaotic time series prediction. The experimental results of correct recognition rate and the fitting precision testify that the unbiased LSSVM model has good universal ability and fitting accuracy, better generalization capability and stability, and have a great improvement in learning speed. [ABSTRACT FROM AUTHOR]