Search

• In this paper, proposing a novel design of DE for Knapsack problems is reported. • A dual representation of solutions in continuous and binary is introduced. • New efficient fitness evaluation and repairing method is proposed. • Results demonstrated the efficiency of Novel DE in solving Knapsack problems. • Novel DE defined new solutions, better than best-known ones for 5 large instances. The capability of the conventional differential evolution algorithm to solve optimization problems in continuous spaces has been well demonstrated and documented in the literature. However, differential evolution has been commonly considered inapplicable for several binary/permutation-based real-world problems because of its arithmetic reproduction operator. Moreover, many limitations of the standard differential evolution algorithm, such as slow convergence and becoming trapped in local optima, have been defined. In this paper, a novel technique which makes a simple differential evolution algorithm suitable and very effective for solving binary-based problems, such as binary knapsack ones, is proposed. It incorporates new components, such as representations of solutions, a mapping method and a diversity technique. Also, a new efficient fitness evaluation approach for calculating and, at the same time, repairing knapsack candidate solutions, is introduced. To assess the performance of this new algorithm, four datasets with a total of 44 instances of binary knapsack problems are considered. Its performance and those of 22 state-of-the-art algorithms are compared, with the experimental results demonstrating its superiority in terms of both the quality of solutions and computational times. It is also capable of finding new solutions which are better than the current best ones for five large knapsack problems. [ABSTRACT FROM AUTHOR]

• The concept and verification method of affine invariance are presented. • Six algorithms are employed to analyze their affine invariances. • PSO, OFA and DE are affine invariant, GWO, SCA and BOA are not affine invariant. • Multiple experimental comparisons are executed to verify algorithms' affine invariance. An algorithm whose performance depends on the objective function being aligned with a privileged coordinate system is a poor choice in general because it is unlikely that the optimal orientation will be known in advance. In this paper, a property of meta -heuristic algorithms, named affine invariance, is introduced to verify whether the algorithm is depended on the privileged coordinate system or not. The concept of affine invariance is described in detail, and some classical algorithms, efficient in most test and actual problems, are proved to be affine invariant. While some recent algorithms in the literature are proved to be not affine invariant. As a conclusion, particle swarm optimization (PSO), differential evolution (DE) and optimal foraging algorithm (OFA) are affine invariant, while grey wolf optimizer (GWO), sine cosine algorithm (SCA) and butterfly optimization algorithm (BOA) are not affine invariant. Furthermore, comparison tests are designed to support the theoretical analysis results. In these tests, same random numbers and initial population are used to avoid the influence of randomness, thus, the conclusion is reliable. [ABSTRACT FROM AUTHOR]

In the last decade, the decomposition-based multiobjective optimization evolutionary algorithm (MOEA/D) has displayed promising performance when dealing with multiobjective optimization problems (MOPs). However, for some complex MOPs, the conventional MOEA/D often leads to the loss of population diversity in the iterative process, and the convergence performance of the population is weakened in the mean time. In this paper, a novel MOEA/D, based on improved multiple adaptive dynamic selection strategies and elite archive strategy (MOEA/D-IMA), is proposed to improve the population diversity and convergence. First, a novel differential evolution (DE) operator is constructed, which constitutes an operator pool with other DE operators. According to the search information of the current population, an adaptive dynamic selection strategy is proposed, which is used by MOEA/D-IMA to select a suitable DE operator to replace the simulated binary crossover (SBX) operator. Second, a parameter adaptive dynamic selection strategy is proposed to enhance the robustness of MOEA/D-IMA by using the information of population evolution state. Third, an elite archive strategy is introduced to improve the convergence and diversity of the population where mutual dominance of individuals and their aggregation distance is employed. Finally, the proposed MOEA/D-IMA is compared with several state-of-the-art algorithms on three suits of 18 test problems. Experimental results indicate that the proposed MOEA/D-IMA can significantly improve the optimization performance when coping with MOPs. [ABSTRACT FROM AUTHOR]

The challenge of solving nonlinear equation systems is how to locate multiple optimal solutions simultaneously in a single run. To address this issue, this paper proposes a novel algorithm by combining a diversity indicator, multi-objective optimization technique, and clustering technique. Firstly, a diversity indicator is designed to maintain the diversity of the population. Then, a K-means clustering-based selection strategy is introduced to locate the promising solutions. Finally, the local search is used to accelerate the convergence of population. The experimental results on 30 nonlinear equation systems show that the proposed algorithm is better than six state-of-the-art algorithms in terms of convergence rate and success rate. [ABSTRACT FROM AUTHOR]

Abstract Differential evolution (DE) is a simple yet powerful evolutionary algorithm that has been used to solve various complex optimization problems in numerous engineering fields. However, DE has some problems, such as premature convergence and sensitivity to parameter settings. To improve the performance of DE and extend its application, an adaptive differential evolution with the Lagrange interpolation argument algorithm (ADELI) is proposed in this paper. To accelerate the convergence speed of DE, a local search with Lagrange interpolation (LSLI) is introduced into DE. LSLI performs a local search in the neighborhood of the best individual in the current generation to enhance the exploitation capability of DE. Meanwhile, an adaptive argument strategy is presented to adaptively determine whether to use LSLI in terms of its performance in the previous generation, which can balance the global exploration capability and the local exploitation capability of ADELI. To verify the feasibility and effectiveness of ADELI, 30 test functions in the CEC 2014 benchmark sets with different dimensions were simulated. Moreover, a path synthesis problem was also optimized. The results demonstrated that ADELI considerably outperforms other EAs in most functions and obtains the most accurate solution among the compared algorithms in the application of path generation. [ABSTRACT FROM AUTHOR]

Abstract This paper develops a novel algorithm to solve real-world constrained optimization problems, which hybridizes multiobjective optimization techniques with an ϵ-constrained method. First, a constrained optimization problem at hand is transformed into a bi-objective optimization problem. By the transformation, the advantage of multiobjective optimization techniques can be utilized in the constrained optimization area to balance population diversity and convergence. Meanwhile, the ϵ-constrained method is applied, which keeps the population evolving toward feasible region of the constrained optimization problem. In our proposed algorithm, the differential evolution is employed as a search engine to create offspring at each generation. Further, different combinations of mutation operators have been developed to improve the search ability and the population convergence at different stages. The performance of our approach is evaluated on 64 benchmark test functions from three popular test suits. Experimental results demonstrate that our proposed approach is capable of obtaining high-quality solutions on the majority of benchmark test functions, when compared with some other state-of-the-art constrained optimization algorithms. [ABSTRACT FROM AUTHOR]

Over the last two decades, many different differential evolution algorithms for solving optimization problems have been introduced. Although most of these algorithms used a single mutation strategy, several with multiple mutation strategies have recently been proposed. Multiple-operator-based algorithms have been proven to be more effective and efficient than single-operator-based algorithms for solving a wide range of benchmark and practical problems. In these algorithms, adaptive operator selection mechanisms are generally applied to place greater emphasis on the best-performing evolutionary operators based on their performance histories for generating new offspring. In this paper, we investigate using problem landscape information in an adaptive operator selection mechanism. For this purpose, a new algorithm, which considers both this problem landscape information and the performance histories of the operators, for dynamically selecting the most suitable differential evolution operator during the evolutionary process, is proposed. The contributions of each component of the selection mechanism are analyzed and the performance of the proposed algorithm is evaluated by solving 45 unconstrained optimization problems. The results demonstrate the effectiveness and superiority of the proposed algorithm to state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]

Abstract: Differential Evolution (DE) is one of the most popular optimization methods for real-valued problems and a large number of its variants have been proposed so far. However, bringing together different ideas that already led to successful DE versions is rare in the literature. In the present paper a novel DE algorithm is proposed, in which three among the most efficient concepts already applied separately within DE framework are gathered together, namely: (1) the adaptation of algorithm control parameters and probabilities of using different mutation strategies; (2) the use of Nelder–Mead algorithm as a local search method hybridized with DE; and (3) the splitting mutation into Global and Local models, when Local mutation model is based on the concept of neighborhood of individuals organized on a ring topology. The performance of the novel algorithm, called Adaptive Memetic DE with Global and Local neighborhood-based mutation operators is compared with 13 different DE variants on a set of 25 popular problems which include rotated, shifted and hybrid composition functions. It is found that, although none DE algorithm outperforms all the others for the majority of problems, on average the proposed approach perform better than all 13 DE algorithms selected for comparison. The proposed algorithm is another heuristic approach developed to solve optimization problems. The question may arise, whether proposing novel methods is useful as No Free Lunch theorems for optimization state that the expected performance of all possible heuristics on all possible problems is equal. In the last section of the paper the limitations and implications of No Free Lunch theorems are discussed based on rich, but unfortunately frequently neglected literature. A very simple continuous and differentiable minimization problem is proposed, for which it is empirically verified that each among considered 14 DE algorithms perform poorer than random sampling. It is also empirically shown that when all considered DE algorithms search for the maximum of the proposed problem, they found lower minimum than DE algorithms searching for the minimum. Such result is not unexpected according to No Free Lunch theorems and should be considered as a precaution from generalization of good performance of heuristic optimization methods. [Copyright &y& Elsevier]

Abstract: Motivated by the recent success of diverse approaches based on differential evolution (DE) to solve constrained numerical optimization problems, in this paper, the performance of this novel evolutionary algorithm is evaluated. Three experiments are designed to study the behavior of different DE variants on a set of benchmark problems by using different performance measures proposed in the specialized literature. The first experiment analyzes the behavior of four DE variants in 24 test functions considering dimensionality and the type of constraints of the problem. The second experiment presents a more in-depth analysis on two DE variants by varying two parameters (the scale factor F and the population size NP), which control the convergence of the algorithm. From the results obtained, a simple but competitive combination of two DE variants is proposed and compared against state-of-the-art DE-based algorithms for constrained optimization in the third experiment. The study in this paper shows (1) important information about the behavior of DE in constrained search spaces and (2) the role of this knowledge in the correct combination of variants, based on their capabilities, to generate simple but competitive approaches. [ABSTRACT FROM AUTHOR]

Abstract: How much attention should be paid to the promising infeasible solutions during the evolution process is investigated in this paper. Stochastic ranking has been demonstrated as an effective technique for constrained optimization. In stochastic ranking, the comparison probability will affect the position of feasible solution after ranking, and the quality of the final solutions. In this paper, the dynamic stochastic selection (DSS) is put forward within the framework of multimember differential evolution. Firstly, a simple version named DSS-MDE is given, where the comparison probability decreases linearly. The algorithm DSS-MDE has been compared with two state-of-the-art evolution strategies and three competitive differential evolution algorithms for constrained optimization on 13 common benchmark functions. DSS-MDE is also evaluated on four well-studied engineering design examples, and the experimental results are significantly better than current available results. Secondly, other dynamic settings of the comparison probability for DSS-MDE are also designed and tested. From the experimental results, DSS-MDE is effective for constrained optimization. Finally, DSS-MDE with a square root adjusted comparison probability is evaluated on the 22 benchmark functions in CEC’06, and the experimental results on most functions are competitive. [Copyright &y& Elsevier]

Abstract: In this paper, several variation operators based on Pareto efficiency, extracted from Differential Evolution, Estimation of Distribution Algorithms, Evolution Strategies and Evolutionary Programming, are compared in order to determine whether or not they increase the performance of the non-Pareto based versions. Firstly, we compare the selected variation operators in pairs, each operator with a modification of itself, in which we remove those elements related to the Pareto efficiency. Then, in a second experiment we compare among the selected operators, the variation operators used in the NSGA-II algorithm and the ones presented by the authors, PBCO and RBMO. In all the experiments the variation operators are incorporated in a well-known algorithm usually considered as a reference for making the comparisons, the NSGA-II algorithm. The experiments show that the Pareto based variation operators selected from the literature do not usually present a better behavior than their non-Pareto based versions; and none of them presents a better performance than the one reached by the variation operators defined by the authors, which were entirely built around the Pareto information of the individuals. These facts suggest that more effort should be placed in the design of variation operators devoted to multi-objective algorithms in order to achieve superior results to those obtained by means of general variation operators. [Copyright &y& Elsevier]

Abstract: This paper proposes a novel and unconventional Memetic Computing approach for solving continuous optimization problems characterized by memory limitations. The proposed algorithm, unlike employing an explorative evolutionary framework and a set of local search algorithms, employs multiple exploitative search within the main framework and performs a multiple step global search by means of a randomized perturbation of the virtual population corresponding to a periodical randomization of the search for the exploitative operators. The proposed Memetic Computing approach is based on a populationless (compact) evolutionary framework which, instead of processing a population of solutions, handles its statistical model. This evolutionary framework is based on a Differential Evolution which cooperatively employs two exploitative search operators: the first is based on a standard Differential Evolution mutation and exponential crossover, and the second is the trigonometric mutation. These two search operators have an exploitative action on the algorithmic framework and thus contribute to the rapid convergence of the virtual population towards promising candidate solutions. The action of these search operators is counterbalanced by a periodical stochastic perturbation of the virtual population, which has the role of “disturbing” the excessively exploitative action of the framework and thus inhibits its premature convergence. The proposed algorithm, namely Disturbed Exploitation compact Differential Evolution, is a simple and memory-wise cheap structure that makes use of the Memetic Computing paradigm in order to solve complex optimization problems. The proposed approach has been tested on a set of various test problems and compared with state-of-the-art compact algorithms and with some modern population based meta-heuristics. Numerical results show that Disturbed Exploitation compact Differential Evolution significantly outperforms all the other compact algorithms present in literature and reaches a competitive performance with respect to modern population algorithms, including some memetic approaches and complex modern Differential Evolution based algorithms. In order to show the potential of the proposed approach in real-world applications, Disturbed Exploitation compact Differential Evolution has been implemented for performing the control of a space robot by simulating the implementation within the robot micro-controller. Numerical results show the superiority of the proposed algorithm with respect to other modern compact algorithms present in literature. [Copyright &y& Elsevier]

Differential evolution (DE) was very successful in solving the global continuous optimization problem. It mainly uses the distance and direction information from the current population to guide its further search. Estimation of distribution algorithm (EDA) samples new solutions from a probability model which characterizes the distribution of promising solutions. This paper proposes a combination of DE and EDA (DE/EDA) for the global continuous optimization problem. DE/EDA combines global information extracted by EDA with differential information obtained by DE to create promising solutions. DE/EDA has been compared with the best version of the DE algorithm and an EDA on several commonly utilized test problems. Experimental results demonstrate that DE/EDA outperforms the DE algorithm and the EDA. The effect of the parameters of DE/EDA to its performance is investigated experimentally. [ABSTRACT FROM AUTHOR]