Search

The efficiency and the effectiveness of a machine learning (ML) model are greatly influenced by feature selection (FS), a crucial preprocessing step in machine learning that seeks out the ideal set of characteristics with the maximum accuracy possible. Due to their dominance over traditional optimization techniques, researchers are concentrating on a variety of metaheuristic (or evolutionary) algorithms and trying to suggest cutting-edge hybrid techniques to handle FS issues. The use of hybrid metaheuristic approaches for FS has thus been the subject of numerous research works. The purpose of this paper is to critically assess the existing hybrid FS approaches and to give a thorough literature review on the hybridization of different metaheuristic/evolutionary strategies that have been employed for supporting FS. This article reviews pertinent documents on hybrid frameworks that were published in the period from 2009 to 2022 and offers a thorough analysis of the used techniques, classifiers, datasets, applications, assessment metrics, and schemes of hybridization. Additionally, new open research issues and challenges are identified to pinpoint the areas that have to be further explored for additional study. [ABSTRACT FROM AUTHOR]

Human facial analysis (HFA) has recently become an attractive topic for computer vision research due to technological progress and mobile applications. HFA explores several issues as gender recognition (GR), facial expression, age, and race recognition for automatically understanding social life. This study explores HFA from the angle of recognizing a person's gender from their face. Several hard challenges are provoked, such as illumination, occlusion, facial emotions, quality, and angle of capture by cameras, making gender recognition more difficult for machines. The Archimedes optimization algorithm (AOA) was recently designed as a metaheuristic-based population optimization method, inspired by the Archimedes theory's physical notion. Compared to other swarm algorithms in the realm of optimization, this method promotes a good balance between exploration and exploitation. The convergence area is increased By incorporating extra data into the solution, such as volume and density. Because of the preceding benefits of AOA and the fact that it has not been used to choose the best area of the face, we propose utilizing a wrapper feature selection technique, which is a real motivation in the field of computer vision and machine learning. The paper's primary purpose is to automatically determine the optimal face area using AOA to recognize the gender of a human person categorized by two classes (Men and women). In this paper, the facial image is divided into several subregions (blocks), where each area provides a vector of characteristics using one method from handcrafted techniques as the local binary pattern (LBP), histogram-oriented gradient (HOG), or gray-level co-occurrence matrix (GLCM). Two experiments assess the proposed method (AOA): The first employs two benchmarking datasets: the Georgia Tech Face dataset (GT) and the Brazilian FEI dataset. The second experiment represents a more challenging large dataset that uses Gallagher's uncontrolled dataset. The experimental results show the good performance of AOA compared to other recent and competitive optimizers for all datasets. In terms of accuracy, the AOA-based LBP outperforms the state-of-the-art deep convolutional neural network (CNN) with 96.08% for the Gallagher's dataset. [ABSTRACT FROM AUTHOR]

Over the last decade, the size and complexity of real-world problems have grown dramatically, necessitating more effective tools. Nature-inspired metaheuristic algorithms have proven to be a promising tool for solving such problems due to their performance in a variety of fields. JAYA algorithm is a novel population-based algorithm which could have been able to present reliable results. This is because it does not need any parameters to be set other than the population size and the maximum number of iteration. Despite its positive feedbacks, this algorithm should be modified to witness more efficiency. This paper aims to amend the original version of Jaya to present a high-efficiency version named Powerful Enhanced Jaya (PEJAYA). In other words, the methodology of updating position in Jaya is modified to enhance the convergence and search capabilities. This approach is assessed according to solve 20 well-known benchmark functions, feature selection, and statistical tests. The output results of proposed optimization algorithm are then evaluated by comparing it with other recent algorithms including crow search algorithm (CSA), standard version of JAYA, particle swarm optimization (PSO), dragonfly algorithm (DA), grasshopper optimization algorithm (GOA), moth-flame optimization (MFO) and sine–cosine algorithm (SCA). Solving a real-world problem is another way of checking the efficiency of this approach with other published works. Prompt escape from local minima, superior convergence, and stability demonstrate that the suggested approach is a very powerful instrument that may be employed in a variety of optimization situations. [ABSTRACT FROM AUTHOR]

Class imbalance problems have attracted the research community, but a few works have focused on feature selection with imbalanced datasets. To handle class imbalance problems, we developed a novel fitness function for feature selection using the chaotic salp swarm optimization algorithm, an efficient meta-heuristic optimization algorithm that has been successfully used in a wide range of optimization problems. This paper proposes an AdaBoost algorithm with chaotic salp swarm optimization. The most discriminating features are selected using salp swarm optimization, and AdaBoost classifiers are thereafter trained on the features selected. Experiments show the ability of the proposed technique to find the optimal features with performance maximization of AdaBoost. [ABSTRACT FROM AUTHOR]

Summary: Scientific and technological advancements lead to the continuous generation of a large amount of data. These datasets are analyzed computationally to reveal patterns and trends. While the presence of noisy and irrelevant features or attributes in these datasets is unavoidable, they negatively impact the performance of classification techniques. Feature selection is a method to pre‐process these datasets by selecting the most informative features while concurrently improving the classification accuracy. Recently, several metaheuristic algorithms were employed in this feature selection process, including particle swarm optimization (PSO). PSO is prominent in the field of feature selection due to its simplicity and global search abilities. However, it may get stuck in local optima. To solve this problem, a new update mechanism in PSO is proposed and the PSO is hybridized with a local search method. To evaluate the performance of the proposed algorithm, benchmark datasets from the University of California in Irvine (UCI) repository were utilized, the k‐nearest neighbor as the classifier. Results show that the proposed feature selection technique outperforms other optimization algorithms on these feature selection problems. [ABSTRACT FROM AUTHOR]

• GBO-kNN is a proposed framework based on a wrapper approach for features selection. • The aim of the research is to reach maximum classification accuracy. • The performance of GBO-kNN is evaluated against real benchmark datasets. • The GBO-kNN performance is compared against seven recent metaheuristic algorithms. • Results showed high effectiveness on one dataset and moderate on another. Virtual Screening (VS) in drug discovery campaigns deals with enormously large databases containing massive redundant and/or irrelevant features. Thus, the pre-selection process of virtual screening requires developing a fast and precise classification methodology for filtering such a huge database. This paper proposed a framework depending on a wrapper selection approach for features selection. It consists of 1) an optimizer: Gradient-Based Optimizer (GBO), that hybridized with 2) the classifier: k-nearest neighbor (k-NN). The performance of the introduced framework, GBO-kNN, is estimated using real-world benchmark datasets; the QSAR Biodegradation which is composed of 41 features, and the Monoamine Oxidase (MAO) that consisted of 1665 features. the GBO-kNN framework is compared against seven recent swarm intelligence algorithms: Hybrid Harris Hawks Optimization Algorithm (HHO), Grey Wolf Optimization Algorithm (GWO), Butterfly Optimization Algorithm (BOA), Dragonfly Algorithm (DA), Moth-Flame Optimization Algorithm (MFO), Sine Cosine Algorithm (SCA), and Salp Swarm Algorithm (SSA) for reaching maximum classification accuracy. The experimental results exhibited that the proposed process, in comparison with other algorithms, achieved high effective accuracy of 98.8% over the high dimensional dataset (MAO) and a moderate effective performance over the low dimensional dataset (QSAR Biodegradation). The proposed framework source code is available at https://codeocean.com/capsule/9906421/tree/v1. [ABSTRACT FROM AUTHOR]

Feature selection is an important data processing method to reduce dimension of the raw datasets while preserving the information as much as possible. In this paper, an enhanced version of Black Widow Optimization Algorithm called SDABWO is proposed to solve the feature selection problem. The Black Widow Optimization Algorithm (BWO) is a new population-based meta-heuristic algorithm inspired by the evolution process of spider population. Three main improvements were included into the BWO to overcome the shortcoming of low accuracy, slow convergence speed and being easy to fall into local optima. Firstly, a novel strategy for selecting spouses by calculating the weight of female spiders and the distance between spiders is proposed. By applying the strategy to the original algorithm, it has faster convergence speed and higher accuracy. The second improvement includes the use of mutation operator of differential evolution at mutation phase of BWO which helps the algorithm escape from the local optima. And then, three key parameters are set to adjust adaptively with the increase of iteration times. To confirm and validate the performance of the improved BWO, other 10 algorithms are used to compared with the SDABWO on 25 benchmark functions. The results show that the proposed algorithm enhances the exploitation ability, improves the convergence speed and is more stable when solving optimization problems. Furthermore, the proposed SDABWO algorithm is employed for feature selection. Twelve standard datasets from UCI repository prove that SDABWO-based method has stronger search ability in the search space of feature selection than the other five popular feature selection methods. These results confirm the capability of the proposed method simultaneously improve the classification accuracy while reducing the dimensions of the original datasets. Therefore, SDABWO-based method was found to be one of the most promising for feature selection problem over other approaches that are currently used in the literature. [ABSTRACT FROM AUTHOR]

Sine Cosine Algorithm (SCA) that is one of the population-based metaheuristic optimization algorithms basically consists of the updating mechanism based on sine and cosine functions. In this algorithm, a few random and adaptive variables are also utilized for more effective motions of the candidate solutions. SCA has some drawbacks like other some metaheuristic algorithms. SCA tends to be stuck into the local regions in the search space and this affects negatively on the computational effort required to find the best solution point in the search space. This paper presents four different improved versions of SCA. The proposed improvements on original SCA are the innovations on the updating mechanism of SCA. To evaluate the performances of Improved Sine Cosine Algorithms (ImpSCAs), well-known numerical optimization problems including CEC 2014 test suite are used. Firstly, different analyses of the proposed ImpSCAs are dealt with such as the convergence analysis, search history analysis, trajectory analysis, average distance analysis, and computational complexity analysis. Secondly, the proposed four versions of ImpSCAs are compared with the original SCA for CEC 2014 benchmark problems with dimension sizes of 10D, 30D and 50D. Finally, original SCA and ImpSCAs are adapted to select optimal feature combination and they are tested for 10 feature selection datasets taken from the UCI machine learning repository. The benchmark results show that the performances of the ImpSCA 1 , ImpSCA 2 , and ImpSCA 4 are better than that of the original SCA. From the feature selection results, it is observed that three versions of ImpSCAs (except ImpSCA 3) outperform the original SCA in 80% of the datasets. Source codes of ImpSCAs are publicly available at https://github.com/uguryuzgec/ImpSCAs. • We focused to improve the exploration and exploitation ability of the original SCA. • The basic idea is based on the innovations on the update mechanism. • The ISCAs were evaluated using CEC2014 benchmark test suite. • The proposed ISCAs were tested for 10 popular UCI datasets. • Three versions of ISCAs (except ISCA 3) outperform the SCA in 80% of the datasets. [ABSTRACT FROM AUTHOR]