Search

Class imbalance problems have attracted the research community, but a few works have focused on feature selection with imbalanced datasets. To handle class imbalance problems, we developed a novel fitness function for feature selection using the chaotic salp swarm optimization algorithm, an efficient meta-heuristic optimization algorithm that has been successfully used in a wide range of optimization problems. This paper proposes an AdaBoost algorithm with chaotic salp swarm optimization. The most discriminating features are selected using salp swarm optimization, and AdaBoost classifiers are thereafter trained on the features selected. Experiments show the ability of the proposed technique to find the optimal features with performance maximization of AdaBoost. [ABSTRACT FROM AUTHOR]

Summary: Scientific and technological advancements lead to the continuous generation of a large amount of data. These datasets are analyzed computationally to reveal patterns and trends. While the presence of noisy and irrelevant features or attributes in these datasets is unavoidable, they negatively impact the performance of classification techniques. Feature selection is a method to pre‐process these datasets by selecting the most informative features while concurrently improving the classification accuracy. Recently, several metaheuristic algorithms were employed in this feature selection process, including particle swarm optimization (PSO). PSO is prominent in the field of feature selection due to its simplicity and global search abilities. However, it may get stuck in local optima. To solve this problem, a new update mechanism in PSO is proposed and the PSO is hybridized with a local search method. To evaluate the performance of the proposed algorithm, benchmark datasets from the University of California in Irvine (UCI) repository were utilized, the k‐nearest neighbor as the classifier. Results show that the proposed feature selection technique outperforms other optimization algorithms on these feature selection problems. [ABSTRACT FROM AUTHOR]

• We integrate a PSO with a NN and ERNN to form PSO-NN and PSO-ERNN metaheuristic models. • The PSO trains the NN and ERNN to achieve faster convergence and avoid local minima. • The PSO-NN and PSO-ERNN models are evaluated using ten benchmark classification datasets. • The accuracy and computational efficiency of the models are improved. • The PSO-ERNN model outperforms the PSO-NN model for most of the tested datasets. There are several types of neural networks (NNs) that are widely used for data classification tasks. The supervised learning NN is an advanced network with a training algorithm for setting the weights and biases of the network in its training phase. However, traditional training algorithms such as backpropagation have some drawbacks, such as slow convergence speed and falling into local minima, which reduces the performance of the classifier. Therefore, different nature-inspired metaheuristic algorithms are integrated with the NN training algorithms to provide derivative-free solutions for complex classification problems. Consequently, this paper proposes the integration of a particle swarm optimization (PSO) algorithm with an improved Elman recurrent neural network (ERNN) to form a PSO-ERNN metaheuristic model. The key contribution of this study is the development of a new dimensional equation for ERNN architecture and the integration of PSO in ERNN learning to produce the PSO-ERNN model. The PSO is constructed to train the NN and ERNN models to achieve a fast convergence rate and avoid local minima problems. The PSO-ERNN model is validated by comparing it against the standard PSO-NN metaheuristic model and similar models from the literature. The PSO-NN and PSO-ERNN models are tested and evaluated using ten benchmark classification problems of breast cancer, heart, hepatitis, liver, wine, iris, lung cancer, yeast, Pima Indians diabetes, and ionosphere datasets. In the training phase, the results show that the PSO-ERNN model performs better than the PSO-NN model when the training set has a bigger size of samples. In the testing phase, the PSO-ERNN model outperforms the PSO-NN model for all the tested datasets except the lung cancer and yeast datasets, in which the accuracy percentage slightly decreases. In the validation phase, the PSO-ERNN model shows better performance quality in terms of accuracy percentage in six of the tested datasets. The average percentage of the training, testing, and validation accumulation show that the PSO-NN performs better than the PSO-ERNN in the lung cancer (87.27, 83.32), and heart (73.56, 70.64) datasets. On the other hand, the PSO-ERNN performs better than the PSO-NN in the iris (88.18, 86.74), hepatitis (88.60, 87.93), wine (89.16, 86.08), liver (73.56, 70.64), ionosphere (83.98, 78.94), and breast cancer (94.84, 91.17). PSO-NN and PSO-ERNN produce the same average results in the Pima Indians diabetes (84.00, 84.00) and yeast (91.31, 91.30) dataset. These results show clearly that the PSO-ERNN generally outperforms the PSO-NN when considering the overall results of the ten datasets. Nevertheless, the combinations of the PSO-NN and PSO-ERNN are proven to represent consistent and robust classification methods. The computational efficiencies of the training processes in both the PSO-NN and PSO-ERNN models are highly improved when coupled with the PSO. [ABSTRACT FROM AUTHOR]

Credit scoring is a process of calculating the risk associated with an applicant on the basis of applicant's credentials such as social status, financial status, etc. and it plays a vital role to improve cash flow for financial industry. However, the credit scoring dataset may have a large number of irrelevant or redundant features which leads to poorer classification performances and higher complexity. So, by removing redundant and irrelevant features may overcome the problem with huge number of features. This work emphasized on the role of feature selection and proposed a hybrid model by combining feature selection by utilizing Binary BAT optimization technique with a novel fitness function and aggregated with for Radial Basis Function Neural Network (RBFN) for credit score classification. Further, proposed feature selection approach is aggregated with Support Vector Machine (SVM) & Random Forest (RF), and other optimization approaches namely: Hybrid Particle Swarm Optimization and Gravitational Search Algorithm (PSOGSA), Hybrid Particle Swarm Optimization and Genetic Algorithm (PSOGA), Improved Krill Herd (IKH), Improved Cuckoo Search (ICS), Firefly Algorithm (FF) and Differential Evolution (DE) are also applied for comparative analysis. [ABSTRACT FROM AUTHOR]