Search

In recent decades, researches on optimizing the parameter of the artificial neural network (ANN) model has attracted significant attention from researchers. Hybridization of superior algorithms helps improving optimization performance and capable of solving complex applications. As a traditional gradient-based learning algorithm, ANN suffers from a slow learning rate and is easily trapped in local minima when training techniques such as gradient descent (GD) and back-propagation (BP) algorithm are used. The characteristics of randomization and selection of the best or near-optimal solution of metaheuristic algorithm provide an effective and robust solution; therefore, it has always been used in training of ANN to improve and overcome the above problems. New metaheuristic algorithms are proposed every year. Therefore, the review of its latest developments is essential. This article attempts to summarize the metaheuristic algorithms which have been proposed from the year 1975 to 2020 from various journals, conferences, technical papers, and books. The comparison of the popularity of the metaheuristic algorithm is presented in two time frames, such as algorithms proposed in the recent 20 years and those proposed earlier. Then, some of the popular metaheuristic algorithms and their working principle are reviewed. This article further categorizes the latest metaheuristic search algorithm in the literature to indicate their efficiency in training ANN for various industry applications. More and more researchers tend to develop new hybrid optimization tools by combining two or more metaheuristic algorithms to optimize the training parameters of ANN. Generally, the algorithm's optimal performance must be able to achieve a fine balance of their exploration and exploitation characteristics. Hence, this article tries to compare and summarize the properties of various metaheuristic algorithms in terms of their convergence rate and the ability to avoid the local minima. This information is useful for researchers working on algorithm hybridization by providing a good understanding of the convergence rate and the ability to find a global optimum. [ABSTRACT FROM AUTHOR]

This paper proposes a novel metaheuristic-based optimization technique called search space reduction (SSR) optimization algorithm. This algorithm attempts to solve the common pitfalls in the existing algorithms in the literature by randomly generating the search agents in every iteration instead of following the best solution. This new algorithm is simple, computationally efficient, which is based on the concept of reducing the search space. The performance of this algorithm is tested over classical test functions and CEC'17 benchmark test functions. The results are compared with well-established algorithms in the literature. The test results show that the proposed algorithm exhibits good exploration and exploitation capabilities. Further, this algorithm also outperforms other algorithms in solving multimodal optimization problems. In addition to this, the computational complexity of this algorithm is also presented according to CEC'17 guidelines. The proposed algorithm is also employed to solve three engineering design problems and a more complex re-entry trajectory optimization problem to show its effectiveness. [ABSTRACT FROM AUTHOR]