Search

The success of the supervised learning process for feedforward neural networks, especially multilayer perceptron neural network (MLP), depends on the suitable configuration of its controlling parameters (i.e., weights and biases). Normally, the gradient descent method is used to find the optimal values of weights and biases. The gradient descent method suffers from the local optimal trap and slow convergence. Therefore, stochastic approximation methods such as metaheuristics are invited. Coronavirus herd immunity optimizer (CHIO) is a recent metaheuristic human-based algorithm stemmed from the herd immunity mechanism as a way to treat the spread of the coronavirus pandemic. In this paper, an external archive strategy is proposed and applied to direct the population closer to more promising search regions. The external archive is implemented during the algorithm evolution, and it saves the best solutions to be used later. This enhanced version of CHIO is called ACHIO. The algorithm is utilized in the training process of MLP to find its optimal controlling parameters thus empowering their classification accuracy. The proposed approach is evaluated using 15 classification datasets with classes ranging between 2 to 10. The performance of ACHIO is compared against six well-known swarm intelligence algorithms and the original CHIO in terms of classification accuracy. Interestingly, ACHIO is able to produce accurate results that excel other comparative methods in ten out of the fifteen classification datasets and very competitive results for others. [ABSTRACT FROM AUTHOR]

Economic load dispatch (ELD) is a crucial problem in the power system which is tackled by distributing the required generation power through a set of units to minimize the fuel cost required. This distribution is subject to two main constraints: (1) equality and inequality related to power balance and power output, respectively. In the optimization context, ELD is formulated as a non-convex, nonlinear, constrained optimization problem which cannot be easily solved using calculus-based techniques. Several optimization algorithms have been adapted. Due to the complexity nature of ELD search space, the theoretical concepts of these optimization algorithms have been modified or hybridized. In this paper, the grey wolf optimizer (GWO) which is a swarm intelligence is hybridized with β -hill climbing optimizer (β HC) which is a local search algorithm, to improve convergence properties. GWO is very powerful in a wide search, while β HC is very powerful in deep search. By combining the wide and deep search ability in a single optimization framework, the balance between the exploration and exploitation is correctly managed. The proposed hybrid algorithm is named β -GWO which is evaluated using five different test cases of ELD problems: 3 generating units with 850 MW; 13 generating units with 1800 MW; 13 generating units with 2520 MW; 40 generating units with 10,500 MW; and 80 generating units with 21,000 MW. β -GWO is comparatively measured using 49 comparative methods. The results obtained by β -GWO outperform others in most test cases. In conclusion, the proposed β -GWO is proved to be a powerful method for ELD problem or for any other similar problems in the power system domain. [ABSTRACT FROM AUTHOR]

Artificial bee colony (ABC) algorithm is one of the most recent swarm intelligence-based algorithms simulate the foraging behavior of honey bees in their hive. ABC starts with a colony of artificial bees with sole aim of discovering the place of food sources with high nectar amount using the solution search equation in the employed bee and onlooker bee operators. However, the solution search equation is good in exploration and poor in exploitation. In this paper, the solution search equation of the onlooker bee is modified by using a value of the fittest food sources selected by a set of selection schemes inspired from the evolutionary algorithms. This is to guide the search process of onlooker bee toward the fittest food sources from the population in order to empower the exploitation capability and convergence. Four selection schemes are incorporated with the ABC algorithm to choose the fittest food sources in four versions as follows: global-best, tournament, linear rank, and exponential rank. For evaluation purposes, 10 classical benchmark optimization functions are used to study the sensitivity analysis of each ABC algorithm to its parameters. The performance of the proposed ABC versions is compared with the original ABC version in order to study the effectiveness of the modifications. In addition, a comparative evaluation of ABC algorithms is carried out against the state-of-the-art methods that worked on CEC2005 benchmark functions, CEC2015 benchmark functions, and two real-world cases of economic load dispatch problem. The experimental results show that the selection schemes incorporated within the search equation of the onlooker bee directly affects the performance of ABC algorithm. [ABSTRACT FROM AUTHOR]

The selection process is the most attractive operator in the optimization algorithms. It normally mimics the natural selection of survival of the fittest principle. When the selection is too greedy, the selection pressure will be high and therefore the search becomes biased toward exploitation. In contrast, when the selection has a tendency to be random, the selection pressure will be low and thus the exploration is observed more. The selection process in Grey Wolf Optimizer (GWO) tends to be too greedy since the search is driven by the three best solutions. In this paper, different selection methods extracted from other evolutionary algorithms (EAs) are investigated for GWO. Along with the original selection method of GWO called greedy-based selection method, five others selection methods which are proportional, tournament, universal sampling, linear rank, and random selection methods are investigated. Accordingly, six versions of GWO are proposed which are Greedy-based GWO (GGWO), Proportional-based GWO (PGWO), Tournament-based GWO (TGWO), Universal sampling-based GWO (UGWO), Linear rank-based GWO (LGWO), Random-based GWO (RGWO). The six versions are evaluated using 23 test functions circulated in the literature with different characteristics and complexity. The sensitivity analysis of the control parameters of some new versions are discussed. Interestingly, TGWO achieved the best results for almost all benchmark functions. This proves that the selection methods have a high impact on the performance of GWO. [ABSTRACT FROM AUTHOR]

In this paper, alternative selection mechanisms in the bat-inspired algorithm for global optimization problems are studied. The bat-inspired algorithm is a recent swarm-based intelligent system which mimics the echolocation system of micro-bats. In the bat-inspired algorithm, the bats randomly fly around the best bat locations found during the search so as to improve their hunting of prey. In practice, one bat location from a set of best bat locations is selected. Thereafter, that best bat location is used by local search with a random walk strategy to inform other bats about the prey location. This selection mechanism can be improved using other natural selection mechanisms adopted from other advanced algorithms like Genetic Algorithm. Therefore, six selection mechanisms are studied to choose the best bat location: global-best, tournament, proportional, linear rank, exponential rank, and random. Consequently, six versions of bat-inspired algorithm are proposed and studied which are global-best bat-inspired algorithm (GBA), tournament bat-inspired algorithm (TBA), proportional bat-inspired algorithm (PBA), linear rank bat-inspired algorithm (LBA), exponential rank bat-inspired algorithm (EBA), and random bat-inspired algorithm (RBA). Using two sets of global optimization functions, the bat-inspired versions are evaluated and the sensitivity analyses of each version to its parameters studied. Our results suggest that there are positive effects of the selection mechanisms on the performance of the classical bat-inspired algorithm which is GBA. For comparative evaluation, eighteen methods are selected using 25 IEEE-CEC2005 functions. The results show that the bat-inspired versions with various selection schemes observing the “survival-of-the-fittest” principle are largely competitive to established methods. [ABSTRACT FROM AUTHOR]

Bat-inspired algorithm (BA) is a robust swarm intelligence algorithm that finds success in many problem domains. The ecosystem of bat animals inspires the main idea of BA. This review paper scanned and analysed the state-of-the-art researches investigated using BA from 2017 to 2021. BA has very impressive characteristics such as its easy-to-use, simple in concepts, flexible and adaptable, consistent, and sound and complete. It has strong operators that incorporate the natural selection principle through survival-of-the-fittest rule within the intensification step attracted by local-best solution. Initially, the growth of the recent solid works published in Scopus indexed articles is summarized in terms of the number of BA-based Journal articles published per year, citations, top authors, work with BA, top institutions, and top countries. After that, the different versions of BA are highlighted to be in line with the complex nature of optimization problems such as binary, modified, hybridized, and multiobjective BA. The successful applications of BA are reviewed and summarized, such as electrical and power system, wireless and network system, environment and materials engineering, classification and clustering, structural and mechanical engineering, feature selection, image and signal processing, robotics, medical and healthcare, scheduling domain, and many others. The critical analysis of the limitations and shortcomings of BA is also mentioned. The open-source codes of BA code are given to build a wealthy BA review. Finally, the BA review is concluded, and the possible future directions for upcoming developments are suggested such as utilizing BA to serve in dynamic, robust, multiobjective, large-scaled optimization as well as improve BA performance by utilizing structure population, tuning parameters, memetic strategy, and selection mechanisms. The reader of this review will determine the best domains and applications used by BA and can justify their BA-related contributions. [ABSTRACT FROM AUTHOR]

This paper presents a novel meta-heuristic algorithm so-called White Shark Optimizer (WSO) to solve optimization problems over a continuous search space. The core ideas and underpinnings of WSO are inspired by the behaviors of great white sharks, including their exceptional senses of hearing and smell while navigating and foraging. These aspects of behavior are mathematically modeled to accommodate a sufficiently adequate balance between exploration and exploitation of WSO and to assist search agents to explore and exploit each potential area of the search space in order to achieve optimization. The search agents of WSO randomly update their position in connection with best-so-far solutions, to eventually arrive at the optimal outcome. The performance of WSO was comprehensively benchmarked on a set of 29 test functions from the CEC-2017 test suite for several dimensions. WSO was further applied to solve the benchmark problems of the CEC-2011 evolutionary algorithm competition to prove its reliability and applicability to real-world problems. A thorough analysis of computational and convergence results was presented to shed light on the efficacy and stability levels of WSO. The performance score of WSO in terms of several statistical methods was compared with 9 well-established meta-heuristics based on the solutions generated. Friedman's and Holm's tests of the results showed that WSO revealed reasonable solutions, in terms of global optimality, avoidance of local minima and solution quality, compared to other existing meta-heuristics. [ABSTRACT FROM AUTHOR]