Search

The efficiency and the effectiveness of a machine learning (ML) model are greatly influenced by feature selection (FS), a crucial preprocessing step in machine learning that seeks out the ideal set of characteristics with the maximum accuracy possible. Due to their dominance over traditional optimization techniques, researchers are concentrating on a variety of metaheuristic (or evolutionary) algorithms and trying to suggest cutting-edge hybrid techniques to handle FS issues. The use of hybrid metaheuristic approaches for FS has thus been the subject of numerous research works. The purpose of this paper is to critically assess the existing hybrid FS approaches and to give a thorough literature review on the hybridization of different metaheuristic/evolutionary strategies that have been employed for supporting FS. This article reviews pertinent documents on hybrid frameworks that were published in the period from 2009 to 2022 and offers a thorough analysis of the used techniques, classifiers, datasets, applications, assessment metrics, and schemes of hybridization. Additionally, new open research issues and challenges are identified to pinpoint the areas that have to be further explored for additional study. [ABSTRACT FROM AUTHOR]

Optimization is a very important issue to efficiently solve engineering problems. The clear comprehension of the elements and processes of optimizer algorithms is fundamental to ensure that engineer students are capable to apply, tune, and design new algorithms. This paper presents an educational platform based on LEGO© EV3 and MATLAB to assist the learning of the principles of classical and metaheuristic optimization algorithms at undergraduate level, by providing a simple and easy-to-follow teaching setup. The proposed study aims to accompany students through the learning of optimization fundamentals by building hands-on robotic experiments. The proposed educational platform has been successfully applied to several undergraduate courses within the Electronics Department at the University of Guadalajara. The description of each experiment and the evaluation of their impact in the student performance are both provided in the paper. [ABSTRACT FROM AUTHOR]

This paper presents a novel metaheuristic optimization algorithm inspired by the geometrical features of circles, called the circle search algorithm (CSA). The circle is the most well-known geometric object, with various features including diameter, center, perimeter, and tangent lines. The ratio between the radius and the tangent line segment is the orthogonal function of the angle opposite to the orthogonal radius. This angle plays an important role in the exploration and exploitation behavior of the CSA. To evaluate the robustness of the CSA in comparison to other algorithms, many independent experiments employing 23 famous functions and 3 real engineering problems were carried out. The statistical results revealed that the CSA succeeded in achieving the minimum fitness values for 21 out of the tested 23 functions, and the p-value was less than 0.05. The results evidence that the CSA converged to the minimum results faster than the comparative algorithms. Furthermore, high-dimensional functions were used to assess the CSA's robustness, with statistical results revealing that the CSA is robust to high-dimensional problems. As a result, the proposed CSA is a promising algorithm that can be used to easily handle a wide range of optimization problems. [ABSTRACT FROM AUTHOR]

This paper presents a powerful swarm intelligence metaheuristic optimization algorithm called Dynamic Cat Swarm Optimization. The formulation is through modifying the existing Cat Swarm Optimization Algorithm. The original Cat Swarm Optimization suffers from the shortcoming of "premature convergence," which is the possibility of entrapment in local optima which usually happens due to the off balance between exploration and exploitation phases. Therefore, the proposed algorithm suggests a new method to provide a proper balance between these phases by modifying the selection scheme and the seeking mode of the algorithm. To evaluate the performance of the proposed algorithm, 23 classical test functions, 10 modern test functions (CEC 2019) and a real-world scenario are used. In addition, the dimension-wise diversity metric is used to measure the percentage of the exploration and exploitation phases. The optimization results show the effectiveness of the proposed algorithm, which ranks first compared to several well-known algorithms available in the literature. Furthermore, statistical methods and graphs are also used to further confirm the outperformance of the algorithm. Finally, the conclusion and future directions to further improve the algorithm are discussed. [ABSTRACT FROM AUTHOR]

A novel nature-inspired metaheuristic optimization algorithm, called the quantum firefly algorithm, is proposed in this paper. The algorithm imitates (a) the social behaviour of fireflies mating in nature, (b) laws of quantum physics, and (c) laws of natural evolution. The algorithm combines the powers of two well-known algorithms: the firefly algorithm and the quantum genetic algorithm. The proposed quantum firefly algorithm's performance is tested on 15 mathematical test functions and one structural design problem. The obtained results show that the quantum firefly algorithm is very competitive compared to the firefly algorithm and the quantum genetic algorithm. [ABSTRACT FROM AUTHOR]

Feature transformation methods can be used effectively to improve the performance of the machine learning techniques, such as classification and clustering, via enhancing the discrimination among the samples. Additionally, binary representation of features may be necessary in several circumstances. For example, distributed systems may have limited bandwidth, storage, and energy that necessitate rough quantization of the measurements. This paper proposes a random projection-based feature transformation method that maps the data points from the original space into a new binary space. In the proposed transformation method, the random projection process is formulated as an optimization problem. A modified chaotic version of the sine–cosine algorithm is used to find the optimal random projector. The performance of the proposed transformation method is validated using 15 standard UCI benchmark datasets against the linear discernment analysis. Moreover, it is compared to other metaheuristic-based feature reduction methods including the gray wolf optimizer, the genetic algorithm, and the antlion optimizer. The obtained results assure the superiority of the proposed transformation method in terms of classification accuracy and storage requirements. [ABSTRACT FROM AUTHOR]

In this paper, the water cycle algorithm (WCA), a recently developed metaheuristic method is proposed for solving multi-objective optimization problems (MOPs). The fundamental concept of the WCA is inspired by the observation of water cycle process, and movement of rivers and streams to the sea in the real world. Several benchmark functions have been used to evaluate the performance of the WCA optimizer for the MOPs. The obtained optimization results based on the considered test functions and comparisons with other well-known methods illustrate and clarify the robustness and efficiency of the WCA and its exploratory capability for solving the MOPs. [ABSTRACT FROM AUTHOR]

In the crowded environment of bio-inspired population-based metaheuristics, the Salp Swarm Optimization (SSO) algorithm recently appeared and immediately gained a lot of momentum. Inspired by the peculiar spatial arrangement of salp colonies, which are displaced in long chains following a leader, this algorithm seems to provide an interesting optimization performance. However, the original work was characterized by some conceptual and mathematical flaws, which influenced all ensuing papers on the subject. In this manuscript, we perform a critical review of SSO, highlighting all the issues present in the literature and their negative effects on the optimization process carried out by this algorithm. We also propose a mathematically correct version of SSO, named Amended Salp Swarm Optimizer (ASSO) that fixes all the discussed problems. We benchmarked the performance of ASSO on a set of tailored experiments, showing that it is able to achieve better results than the original SSO. Finally, we performed an extensive study aimed at understanding whether SSO and its variants provide advantages compared to other metaheuristics. The experimental results, where SSO cannot outperform simple well-known metaheuristics, suggest that the scientific community can safely abandon SSO. • Critical analysis of the widely-used salp optimization algorithm (SSO). • Definition of an amended version of SSO that fixed SSO's structural bias. • Extensive experimental phase using the CEC 2017 benchmark suite. • Results show that SSO does not provide any advantage w.r.t. existing heuristics. • Metaphor-based approach to design metaheuristics may introduce bias. [ABSTRACT FROM AUTHOR]

• A new optimization algorithm based on Lichtenberg figure pattern is presented. • Difussion Limited Aggregation is formulated to create new agents in search space. • Lichtenberg figure pattern presents exploration–exploitation balance. • Tested on complex functions and problems and compared with renowned metaheuristics. This paper proposes a novel global optimization algorithm called Lichtenberg Algorithm (LA), inspired by the Lichtenberg figures patterns. Optimization is an essential tool to minimize or maximize functions, obtaining optimal results on costs, mass, energy, gains, among others. Actual problems may be multimodal, nonlinear, and discontinuous and may not be minimized by classical analytical methods that depend on the gradient. In this context there are metaheuristics algorithms inspired by natural phenomena to optimize real problems. There is no algorithm that is the worst or the best, but more efficient for a given type of problem. Thus, an unprecedented metaheuristic algorithm was created inspired by the physical phenomenon of radial intra-cloud lightning and Lichtenberg figures, successfully exploiting the fractal power and it is different from many in the literature as it is a hybrid algorithm composed of methods of search based on population and trajectory. Several test functions, including a design problem in a welded beam, were used to verify the robustness and to validate the Lichtenberg Algorithm. In all cases, the results were satisfactory when compared to those in the literature. LA shown to be a powerful optimization tool for both unconstraint optimizations and real problems with linear and nonlinear constraints. [ABSTRACT FROM AUTHOR]

This paper introduces a bio-inspired metaheuristic optimization algorithm named Tunicate Swarm Algorithm (TSA). The proposed algorithm imitates jet propulsion and swarm behaviors of tunicates during the navigation and foraging process. The performance of TSA is evaluated on seventy-four benchmark test problems employing sensitivity, convergence and scalability analysis along with ANOVA test. The efficacy of this algorithm is further compared with several well-regarded metaheuristic approaches based on the generated optimal solutions. In addition, we also executed the proposed algorithm on six constrained and one unconstrained engineering design problems to further verify its robustness. The simulation results demonstrate that TSA generates better optimal solutions in comparison to other competitive algorithms and is capable of solving real case studies having unknown search spaces. Note that the source codes of the proposed TSA algorithm are available at [ABSTRACT FROM AUTHOR]