Search

Today, intelligent optimization has become a science that few researchers have not used in dealing with problems in their field. Diversity and flexibility have made the use, efficiency, and usefulness of various nature-inspired optimization methods, such as evolutionary and meta-heuristic algorithms, more evident in such problems. This work first provides a comprehensive overview of all considerations governing various optimization problems with detailed corresponding categories. Then, the most comprehensive review and recent methods (during 1965–2022) are presented in evolution-based, swarm-based, physics-based, human-based, and hybrid-based categories. More than 320 new algorithms have been reviewed. All specifications including authors, year, abbreviation, inspired source, controls, and their application are considered in this regard. Statistical analyzes of papers and publishers, annually and for 57 years, along with their ranking, are also examined in detail. Among the key achievements of the paper include: the most number of algorithms with 47.71% (156 methods) have been from the swarm category, and most of them were published in the five years of 2021 (72, 22.02%), 2020 (39, 11.93%), 2022 (31, 9.48%), 2019 (26, 7.95%), and 2016 (21, 6.42%) respectively; the top five rankings of publishers of reviewed algorithms/papers were also: "Proceedings of the Congress" (33, 10.09%), "Applied Soft Computing" (19, 5.81%), "Expert Systems with Applications" (18, 5.51%), "Knowledge-Based Systems" (12, 3.67%), "Engineering Applications of Artificial Intelligence" (12, 3.67%), "Advances in Engineering Software" (12, 3.67%), " Neural Computing and Applications " (12, 3.67%), and " Information Sciences " (11, 3.36%). The paper's data is available at: https://github.com/ali-ece. [Display omitted] • A detailed overview of optimization and its variants. • A literature review on state-of-the-art algorithms from 1965 to 2022. • Statistical analyzes and explanations in each year and during the 57 years. [ABSTRACT FROM AUTHOR]

This paper introduces an improved differential evolution algorithm based on cooperative multi-population (CMp-DE for short), which combines diverse population collaboration mechanisms and catalytic factors into an improved differential evolution framework. By harnessing various population collaboration mechanisms, the algorithm enhances the diversity of individuals within populations during initial iterations and reduces it during later iterations, thereby harmonizing the algorithm's exploratory and exploitative capabilities. Furthermore, a novel mutation operator is proposed that divides the iterative process into exploration and exploitation phases, thereby augmenting the algorithm's global exploration prowess. Lastly, a catalytic operator is introduced to generate new individuals near post-crossover individuals based on a specified rule, which enhances the algorithm's ability to escape local optima and increasing stability. The proposed CMp-DE is benchmarked against the CEC2017 benchmark test functions and compared against 13 algorithms, including five differential evolution algorithms and their variants, as well as eight state-of-the-art metaheuristic optimization algorithms. This evaluation assesses the CMp-DE's solution accuracy, convergence, stability, and scalability. Finally, the applicability of CMp-DE is validated by addressing six practical optimization problems. The experimental results show that CMp-DE surpasses other algorithms in terms of both convergence accuracy and robustness. Moreover, integrating a catalytic operator with other optimization algorithms notably boosts performance in convergence accuracy and stability. The inclusion of the catalytic operator has significantly enhanced the performance of algorithms compared to their performance before its addition. This underscores the potential of the catalytic operator in improving the performance of various algorithms, particularly in terms of convergence accuracy and robustness. [ABSTRACT FROM AUTHOR]

This paper introduces an improved differential evolution algorithm based on cooperative multi-population (CMp-DE for short), which combines diverse population collaboration mechanisms and catalytic factors into an improved differential evolution framework. By harnessing various population collaboration mechanisms, the algorithm enhances the diversity of individuals within populations during initial iterations and reduces it during later iterations, thereby harmonizing the algorithm's exploratory and exploitative capabilities. Furthermore, a novel mutation operator is proposed that divides the iterative process into exploration and exploitation phases, thereby augmenting the algorithm's global exploration prowess. Lastly, a catalytic operator is introduced to generate new individuals near post-crossover individuals based on a specified rule, which enhances the algorithm's ability to escape local optima and increasing stability. The proposed CMp-DE is benchmarked against the CEC2017 benchmark test functions and compared against 13 algorithms, including five differential evolution algorithms and their variants, as well as eight state-of-the-art metaheuristic optimization algorithms. This evaluation assesses the CMp-DE's solution accuracy, convergence, stability, and scalability. Finally, the applicability of CMp-DE is validated by addressing six practical optimization problems. The experimental results show that CMp-DE surpasses other algorithms in terms of both convergence accuracy and robustness. Moreover, integrating a catalytic operator with other optimization algorithms notably boosts performance in convergence accuracy and stability. The inclusion of the catalytic operator has significantly enhanced the performance of algorithms compared to their performance before its addition. This underscores the potential of the catalytic operator in improving the performance of various algorithms, particularly in terms of convergence accuracy and robustness. [ABSTRACT FROM AUTHOR]

This paper proposes a novel hybrid algorithm which is mathematically modelled by amalgamating the superior features of recently developed Grey Wolf Optimizer (GWO), Sine Cosine Algorithm (SCA), and Crow Search Algorithm (CSA). Researchers have already implemented the aforementioned three algorithms and obtained superior quality results for solving diverse optimization problems. The novel hybrid Variegated GWO Algorithm (VGWO) developed in this proposed research work is initially realized and validated for solving IEEE CEC-C06 2019 benchmark functions. Thereafter, the proposed VGWO is utilized as an optimization tool to solve three emerging and complex power system optimization problems which includes energy management of microgrid systems operated in both islanded and grid-connected mode, dynamic economic emission dispatch and reactive power planning (RPP) problem. A comparative analysis of the proposed VGWO approach with other established metaheuristics is undertaken for each optimization problem. Numerical results show that the novel hybrid VGWO algorithm outperformed an ample number of optimization techniques in providing better quality solutions. The proposed hybrid algorithm yielded a 36.93% reduction in active power loss and 36.80% reduction in operating cost with respect to base case condition for RPP problem. Likewise while solving microgrid energy management problems 9–30% savings was realized in the generation cost compared to the ones mentioned in literature. The capability of handling many complex constraints within a minimum amount of computational time to provide consistently best solutions prioritize the proposed hybrid algorithm among its kinds. Statistical analysis validates the authenticity and viability of the proposed algorithm. [ABSTRACT FROM AUTHOR]

New metaheuristic algorithms have soared over the past ten years. A common practice in proposing a new algorithm is validating it on several benchmark functions and engineering problems. Although CEC benchmark problems are specifically designed to validate the performance of new meta-heuristics, engineering design problems from pressure vessels to springs have been used in hundreds of papers to prove algorithm efficiency. To date, no benchmark practices have been established yet, i.e., researchers design their own benchmark to validate their algorithm. Thus, the high number of new algorithms combined with the high number of different benchmarking setups complicates the comparing and validating processes. In this paper, we study benchmark practices related to engineering applications. In particular, our exhaustive qualitative systematic review focuses on metaheuristics applied to the tension/compression spring design problem (TCSDP). The aim of this study is threefold: (i) evaluate where the field stands in regards of algorithm performance on the TCSDP, (ii) evaluate benchmarking practices, and (iii) facilitate future algorithm comparison. For these purposes, we first review all the existing metaheuristics applied to the TCSDP in their first publication. For each paper, we gather the data regarding the problem definition, the simulation setup, and the optimized design. We evaluated the data through several metrics to find the best-optimized design so far. Our findings and analysis concluded that the field of metaheuristics and its benchmarking practice have not reached maturity yet. Thus, we recommend some actions to address the issues and provide future research directions. [ABSTRACT FROM AUTHOR]

Solving multi-objective optimization problems plays an important role in several applications. Recently, the Marine Predator Algorithm (MPA) was introduced for solving single objective optimization problems inspired by the behaviour of marine predator in their search for a prey. This paper proposes a modified MPA based framework called Guided Multi-objective Marine Predator Algorithm (GMOMPA) to solve multi-objective optimization problems. The proposed GMOMPA incorporates an external archive to help store the optimal Pareto set solution and guide the particles during the exploitation of the search space. For obtaining non-dominated solutions, the Pareto dominance concept is utilized while the epsilon dominance is considered to update the archive's sorted solutions. In this context, the epsilon dominance concept extends the diversity and exploration of the solutions. Further, a fast non-dominated solution and crowding distance are introduced to update the particle's position, while maintaining the diversity and ensuring a fast convergence towards the Pareto optimal. The proposed GMOMPA is evaluated on several different benchmark test functions including multi-objective ZDT, DTLZ, UF, and WFG test functions as well as the recent multi-objective multimodal CEC 2020 test functions. Moreover, the performance of the proposed GMOMPA is compared with well-known multi-objective optimization algorithms. The obtained results show that the proposed GMOMPA is a good tool for multi-objective optimization and has significant advantages over several state-of-the-art algorithms in almost all of the test functions. [ABSTRACT FROM AUTHOR]

The imitating behaviour of the slime mould algorithm (SMA) supports the collective efficiency, whereas the evolutionary algorithm (EA) smoothens the global effectiveness through a crossover. This observation leads to the integration of the EA with SMA. Thus, in this paper, an attempt has been made to hybridize the said algorithms in a parallel and series manner. In parallel structure, EA and SMA are executed parallelly and solutions obtained from both are combined to obtain the best solution which is further saved and updated as to a global best solution. Whereas, in a series structure, the population is fed to the EA initially to obtain the best solution which is again fed to SMA to obtain the global best solution. Under such guidance, the global search ability and search efficiency of EA and SMA are enhanced. The proposed PSEASMA and SSEASMA are tested on 23 classical benchmark functions and ten CEC2019 functions. The Wilcoxon rank-sum test is also carried out to validate the efficacy of the proposed work. The proposed work has been compared with other renowned metaheuristic algorithms in terms of average and standard deviation. Based on average and standard deviation, the ranks of each algorithm have been assigned through the Friedman test. The results suggested that the proposed method outperformed the other state of arts. The PSEASMA and SSEASMA have also been applied to classical engineering design problems. The performance of the proposed work is significantly superior compared to basic SMA, EA and other meta-heuristic algorithms. • A hybrid algorithm has been proposed by combining evolutionary algorithm with slime mould algorithm. • The hybridization is done through series and parallel construction. • The proposed PSEASMA and SSEASMA optimizes the conventional design problems in terms of optimum weight and optimum cost. • The Friedman and Wilcoxon test is carried out to validate the superiority of the proposed work. [ABSTRACT FROM AUTHOR]

In this paper, a new bio-inspired meta-heuristic algorithm, named artificial rabbits optimization (ARO), is proposed and tested comprehensively. The inspiration of the ARO algorithm is the survival strategies of rabbits in nature, including detour foraging and random hiding. The detour foraging strategy enforces a rabbit to eat the grass near other rabbits' nests, which can prevent its nest from being discovered by predators. The random hiding strategy enables a rabbit to randomly choose one burrow from its own burrows for hiding, which can decrease the possibility of being captured by its enemies. Besides, the energy shrink of rabbits will result in the transition from the detour foraging strategy to the random hiding strategy. This study mathematically models such survival strategies to develop a new optimizer. The effectiveness of ARO is tested by comparison with other well-known optimizers by solving a suite of 31 benchmark functions and five engineering problems. The results show that ARO generally outperforms the tested competitors for solving the benchmark functions and engineering problems. ARO is applied to the fault diagnosis of a rolling bearing, in which the back-propagation (BP) network optimized by ARO is developed. The case study results demonstrate the practicability of the ARO optimizer in solving challenging real-world problems. The source code of ARO is publicly available at https://seyedalimirjalili.com/aro and https://ww2.mathworks.cn/matlabcentral/fileexchange/110250-artificial-rabbits-optimization-aro. • A new bio-inspired artificial rabbits optimization (ARO) algorithm is proposed. • ARO is inspired by the survival strategies of rabbits in nature. • The results on 31 well-known test functions show the efficiency of ARO. • ARO yields superior results over its competitors on 5 engineering problems. • ARO is successfully applied in fault diagnosis of rolling bearing. [ABSTRACT FROM AUTHOR]

Land readjustment and redistribution (LR) is an important approach used to realize development plans by converting rural lands to urban land and also providing urban infrastructure. The LR problem, which is a complex challenging real-world problem, is a discrete optimization problem because its structure is similar to TSP (Traveling Salesman Problem) and scheduling problems which are combinatorial optimization problems. Since classical mathematical methods are insufficient for solving NP (Nondeterministic Polynomial) optimization problems due to time limitations, meta-heuristic optimization algorithms are commonly utilized for solving these kinds of problems. In this paper, meta-heuristic algorithms including genetic, particle swarm, differential evolution, artificial bee, and tree seed algorithms are utilized for solving LR problems. The stated meta-heuristic algorithms are used by applying spatial-based crossover and mutation operators depending upon the LR problem on each algorithm. Moreover, a synthetic dataset is used to ensure that the quality of the solution obtained is acceptable to everyone, to prove an optimal solution easily. By utilizing the suggested spatial-based crossover and mutation operators, finding the ideal solution is aimed using the synthetic dataset. In addition, five different modifications on TSA (Tree-Seed Algorithm) are performed and used to solve LR problems. All the modified versions of TSA are carried out only by changing the mechanism of seed reproduction. The novel TSA approaches are respectively named as tcTSA (tournament current), tbTSA (tournament best), pbTSA (personal-best based), t2TSA (double tournament), and elTSA (elitism based). In the experimental studies, the hybrid approach, which includes the crossover and mutation operators, is successfully applied in all of the algorithms under equal conditions for a fair comparison. According to experimental results performed using the dataset, it can be clearly stated that especially t2TSA outperforms all the algorithms in terms of performance and time. [ABSTRACT FROM AUTHOR]

Sine Cosine Algorithm (SCA) that is one of the population-based metaheuristic optimization algorithms basically consists of the updating mechanism based on sine and cosine functions. In this algorithm, a few random and adaptive variables are also utilized for more effective motions of the candidate solutions. SCA has some drawbacks like other some metaheuristic algorithms. SCA tends to be stuck into the local regions in the search space and this affects negatively on the computational effort required to find the best solution point in the search space. This paper presents four different improved versions of SCA. The proposed improvements on original SCA are the innovations on the updating mechanism of SCA. To evaluate the performances of Improved Sine Cosine Algorithms (ImpSCAs), well-known numerical optimization problems including CEC 2014 test suite are used. Firstly, different analyses of the proposed ImpSCAs are dealt with such as the convergence analysis, search history analysis, trajectory analysis, average distance analysis, and computational complexity analysis. Secondly, the proposed four versions of ImpSCAs are compared with the original SCA for CEC 2014 benchmark problems with dimension sizes of 10D, 30D and 50D. Finally, original SCA and ImpSCAs are adapted to select optimal feature combination and they are tested for 10 feature selection datasets taken from the UCI machine learning repository. The benchmark results show that the performances of the ImpSCA 1 , ImpSCA 2 , and ImpSCA 4 are better than that of the original SCA. From the feature selection results, it is observed that three versions of ImpSCAs (except ImpSCA 3) outperform the original SCA in 80% of the datasets. Source codes of ImpSCAs are publicly available at https://github.com/uguryuzgec/ImpSCAs. • We focused to improve the exploration and exploitation ability of the original SCA. • The basic idea is based on the innovations on the update mechanism. • The ISCAs were evaluated using CEC2014 benchmark test suite. • The proposed ISCAs were tested for 10 popular UCI datasets. • Three versions of ISCAs (except ISCA 3) outperform the SCA in 80% of the datasets. [ABSTRACT FROM AUTHOR]

Differential evolution is an effective and practical approach that is widely applied for solving global optimization problems. Nevertheless, its effectiveness and scalability are decreased when the problems' dimension is increased. Hence, this paper is devoted to proposing a novel DE algorithm named quantum-based avian navigation optimizer algorithm (QANA) inspired by the extraordinary precision navigation of migratory birds during long-distance aerial paths. In the QANA, the population is distributed by partitioning into multi flocks to explore the search space effectively using proposed self-adaptive quantum orientation and quantum-based navigation consisted of two mutation strategies, DE/quantum/I and DE/quantum/II. Except for the first iteration, each flock is assigned using an introduced success-based population distribution (SPD) policy to one of the quantum mutation strategies. Meanwhile, the information flow is shared through the population using a new communication topology named V-echelon. Furthermore, we introduce two long-term and short-term memories to provide meaningful knowledge for partial landscape analysis and a qubit-crossover operator to generate the next search agents. The effectiveness and scalability of the proposed QANA were extensively evaluated using benchmark functions CEC 2018 and CEC 2013 as LSGO problems. The results were statistically analyzed by the Wilcoxon signed-rank sum test, ANOVA, and mean absolute error tests. Finally, the applicability of the QANA to solve real-world problems was evaluated by four engineering problems. The experimental results and statistical analysis prove that the QANA is superior to the competitor DE and swarm intelligence algorithms in test functions CEC 2018 and CEC 2013, with overall effectiveness of 80.46% and 73.33%, respectively. • Proposing an optimizer algorithm (QANA) inspired by migratory birds' navigation behaviors. • Introducing LTM and STM memories to share information and partial landscape analysis. • Introducing a V-echelon topology to spread information flow throughout search agents. • Introducing a quantum mutation strategy equipped by two meaningful search strategies. • The proposed QANA optimizer is very competitive and superior to compared algorithms. [ABSTRACT FROM AUTHOR]