Search

• In this paper, proposing a novel design of DE for Knapsack problems is reported. • A dual representation of solutions in continuous and binary is introduced. • New efficient fitness evaluation and repairing method is proposed. • Results demonstrated the efficiency of Novel DE in solving Knapsack problems. • Novel DE defined new solutions, better than best-known ones for 5 large instances. The capability of the conventional differential evolution algorithm to solve optimization problems in continuous spaces has been well demonstrated and documented in the literature. However, differential evolution has been commonly considered inapplicable for several binary/permutation-based real-world problems because of its arithmetic reproduction operator. Moreover, many limitations of the standard differential evolution algorithm, such as slow convergence and becoming trapped in local optima, have been defined. In this paper, a novel technique which makes a simple differential evolution algorithm suitable and very effective for solving binary-based problems, such as binary knapsack ones, is proposed. It incorporates new components, such as representations of solutions, a mapping method and a diversity technique. Also, a new efficient fitness evaluation approach for calculating and, at the same time, repairing knapsack candidate solutions, is introduced. To assess the performance of this new algorithm, four datasets with a total of 44 instances of binary knapsack problems are considered. Its performance and those of 22 state-of-the-art algorithms are compared, with the experimental results demonstrating its superiority in terms of both the quality of solutions and computational times. It is also capable of finding new solutions which are better than the current best ones for five large knapsack problems. [ABSTRACT FROM AUTHOR]

In evolutionary multiobjective optimization, effectiveness refers to how an evolutionary algorithm performs in terms of converging its solutions into the Pareto front and also diversifying them over the front. This is not an easy job, particularly for optimization problems with more than three objectives, dubbed many-objective optimization problems. In such problems, classic Pareto-based algorithms fail to provide sufficient selection pressure towards the Pareto front, whilst recently developed algorithms, such as decomposition-based ones, may struggle to maintain a set of well-distributed solutions on certain problems (e.g., those with irregular Pareto fronts). Another issue in some many-objective optimizers is rapidly increasing computational requirement with the number of objectives, such as hypervolume-based algorithms and shift-based density estimation (SDE) methods. In this paper, we aim to address this problem and develop an effective and efficient evolutionary algorithm (E3A) that can handle various many-objective problems. In E3A, inspired by SDE, a novel population maintenance method is proposed to select high-quality solutions in the environmental selection procedure. We conduct extensive experiments and show that E3A performs better than 11 state-of-the-art many-objective evolutionary algorithms in quickly finding a set of well-converged and well-diversified solutions. [ABSTRACT FROM AUTHOR]

Distributed optimization algorithms have the advantages of privacy protection and parallel computing. However, the distributed nature of these algorithms makes the system vulnerable to external attacks. This paper presents two penalty function based resilient algorithms for constrained distributed optimization under static and dynamic attacks. The objective function of the optimization problem is extended to nonsmooth ones and the convergence of the proposed algorithms in this case are proved under some mild conditions. Simulation experiments are performed and compared with some existing resilient primal-dual optimization algorithms using median-based mean estimator. For static attack, the proposed algorithm has better performance and faster convergence rate in the simulation experiments. For dynamic attack, the proposed algorithm has better performance and robustness in the simulation experiments, which illustrate that the proposed algorithms are more effective. [ABSTRACT FROM AUTHOR]

• A supervised multi-view model is proposed to realize a block-based feature selection. • The proposed model is composed of all sharing sub-models in each class. • The sparse regularizer can enhance the sparsity of blocks from features and views. • The proposed algorithm can realize the block separation and independent solution. • Numerical experiments show the effectiveness of our method on large-scale datasets. With the increasing scale of obtained multi-view data, how to deal with large-scale multi-view data quickly and efficiently is a significant problem. In this paper, a novel supervised multi-view feature selection method based on locally sparse regularization and block computing is proposed to solve the problem. Specifically, the multi-view dataset is firstly divided into sub-blocks according to classes and views. Then with the aid of the Alternating Direction Method of Multipliers (ADMM), a sharing sub-model is proposed to perform feature selection on each class by integrating each view's locally sparse regularizers and shared loss that makes all views share a common penalty and regresses samples to their labels. Finally, all the sharing sub-models are fused to form the final general additive feature selection model, in which each sub-block adjusts its corresponding variables to perform block-based feature selection. In the optimization process, the proposed model can be decomposed into multiple separate subproblems, and an efficient optimization algorithm is proposed to solve them quickly. The comparison experiments with several state-of-the-art feature selection methods show that the proposed method is superior in classification accuracy and training speed. [ABSTRACT FROM AUTHOR]

Particle swarm optimization (PSO) is a population-based random-search optimization technique that has become an increasingly important branch of swarm intelligence studies. Population diversity is an effective measurement that shows the distribution of particles in a search space. In this paper, we propose a diversity-based PSO algorithm that is combined with multiple techniques, and population diversity is used as a search-strategy selection criterion for particles. When diversity is high, we suggest implementing a search strategy that has a strong exploration ability. When diversity is low, we suggest implementing a search strategy that has a strong exploitation ability. In addition to our diversity-based method, we introduce a gradient-based local-search technique, multi-crossover operation, and disturbance strategy to help improve the performance of the proposed algorithm. In the experiments, we compare the proposed algorithm with 10 advanced PSO variants based on 40 widely used benchmark functions, including the CEC2017 benchmark. The results indicate that the proposed algorithm yields a better solution accuracy and convergence speed than those of other PSO variants. [ABSTRACT FROM AUTHOR]

In this paper, we investigate the online convex optimization (OCO) with long-term constraints which is widely used in various resource allocations and recommendation systems. Different from the most existing works, our work adopts a dynamic benchmark to analyze the optimization performance since the dynamic benchmark is more common than the static benchmark in practical applications. Moreover, compared with many constrained OCO works ignoring the Slater condition, we study the effect of the Slater condition on the constraint violation bounds and obtain the better performance of the constraint violations when the Slater condition holds. More importantly, we propose a novel iterative optimization algorithm based on the virtual queues to achieve sublinear regret and constraint violations. Finally, we apply our dynamic OCO model to a resource allocation problem in cloud computing and the results of the experiments validate the effectiveness of our algorithm. [ABSTRACT FROM AUTHOR]

• A new algorithm, called BTLBO, is proposed to balance between exploration and exploitation. • A new Tutoring Phase is added to TLBO to accelerate the convergence to the global optimum. • A new Restarting Phase is added to TLBO to promote convergence to the global optimum. • Control parameters are self-adaptively tuned. • The superiority of BTLBO is verified by solving standard benchmarks and real world optimization problems. Teaching-learning-based optimization (TLBO) is a population-based metaheuristic algorithm which simulates the teaching and learning mechanisms in a classroom. The TLBO algorithm has emerged as one of the most efficient and attractive optimization techniques. Even though the TLBO algorithm has an acceptable exploration capability and fast convergence speed, there may be a possibility to converge into a local optimum during solving complex optimization problems and there is a need to keep a balance between exploration and exploitation capabilities. Hence, a Balanced Teaching-Learning-Based Optimization (BTLBO) algorithm is proposed in this paper. The proposed BTLBO algorithm is a modification of the TLBO algorithm and it consists of four phases: (1) Teacher Phase in which a weighted mean is used instead of a mean value for keeping the diversity, (2) Learner Phase, which is same as the learner phase of basic TLBO algorithm, (3) Tutoring Phase, which is a powerful local search for exploiting the regions around the best ever found solution, and (4) Restarting Phase, which improves exploration capability by replacing inactive learners with new randomly initialized learners. An acceptable balance between the exploration and exploitation capabilities is achieved by the proposed BTLBO algorithm. To evaluate the performance of BTLBO algorithm, several experimental studies are conducted on standard benchmark suits and the results are compared with several TLBO variants and state-of-the-art population-based optimization algorithms. The results are in excellent agreement and confirm the efficiency of BTLBO algorithm with accelerated exploitation and exploration capabilities with an appropriate balance between such criteria for solving complex optimization problems. [ABSTRACT FROM AUTHOR]

• The concept and verification method of affine invariance are presented. • Six algorithms are employed to analyze their affine invariances. • PSO, OFA and DE are affine invariant, GWO, SCA and BOA are not affine invariant. • Multiple experimental comparisons are executed to verify algorithms' affine invariance. An algorithm whose performance depends on the objective function being aligned with a privileged coordinate system is a poor choice in general because it is unlikely that the optimal orientation will be known in advance. In this paper, a property of meta -heuristic algorithms, named affine invariance, is introduced to verify whether the algorithm is depended on the privileged coordinate system or not. The concept of affine invariance is described in detail, and some classical algorithms, efficient in most test and actual problems, are proved to be affine invariant. While some recent algorithms in the literature are proved to be not affine invariant. As a conclusion, particle swarm optimization (PSO), differential evolution (DE) and optimal foraging algorithm (OFA) are affine invariant, while grey wolf optimizer (GWO), sine cosine algorithm (SCA) and butterfly optimization algorithm (BOA) are not affine invariant. Furthermore, comparison tests are designed to support the theoretical analysis results. In these tests, same random numbers and initial population are used to avoid the influence of randomness, thus, the conclusion is reliable. [ABSTRACT FROM AUTHOR]

For many-objective problems, how to maintain the diversity and convergence of the distribution of the solution set over Pareto front (PF) has always been the research emphasis. In the iteration process, the state of population is critical to improve the level of evolution. Therefore, this paper will use two convergence and diversity indicators to further strengthen the usage of evolutionary state information and propose a dynamic learning strategy. In addition, a dynamic learning strategy based many-objective evolutionary algorithm (MaOEA) is proposed, called dynamic learning evolution algorithm (DLEA), which continuously changes the direction of learning: convergence and diversity in the iteration process. The purpose is to make the algorithm prefer to convergence in the early iteration and prefer to diversity when it is close to PF in the late iteration, so that the convergence and diversity of the final solution set can be well maintained. And then, the performance of DLEA is measured by two indicators. Meanwhile, DLEA will be compared with four state-of-the-art algorithms on the DTLZ and MaF, and its performance will be verified on a many-objective combinatorial problem. And the experimental results and Friedman test show that DLEA has great advantages. [ABSTRACT FROM AUTHOR]

Constrained multi-objective optimization problems (CMOPs) are difficult to handle because objectives and constraints need to be considered simultaneously, especially when the constraints are extremely complex. Some recent algorithms work well when dealing with CMOPs with a simple feasible region; however, the effectiveness of most algorithms degrades considerably for CMOPs with complex feasible regions. To address this issue, this paper proposes a multi-stage evolutionary algorithm, where constraints are added one after the other and handled in different stages of evolution. Specifically, in the early stages, the algorithm only considers a small number of constraints, which can make the population efficiently converge to the potential feasible region with good diversity. As the algorithm moves to the later stages, more constraints are considered to search the optimal solutions based on the solutions obtained in the previous stages. Furthermore, a strategy for sorting the constraint-handling priority according to the impact on the unconstrained Pareto front is proposed, which can accelerate the convergence of the algorithm. Experimental results on five benchmark suites and three real-world applications showed that the proposed algorithm outperforms several state-of-the-art constraint multi-objective evolutionary algorithms when dealing with CMOPs, especially for problems with complex constraints. [ABSTRACT FROM AUTHOR]

This paper presents a new fractal search space decomposition-based algorithm to address the issue of scaling up the divide and conquer approach to deal with large scale problems (up to 50 continuous decision variables). The proposed algorithm, called polyFrac, fractally decomposes the search space using hyper-polytopes. It allows moving throughout different granularity levels by only computing the average of vertices of a hyper-polytope to obtain the coordinates of the centroids. Only the most promising hyper-polytopes are decomposed into child-polytopes. Then, a simple deterministic local search (single solution-based metaheuristic) is used to perform the intensification process to find the best solution within the selected lowest hyper-polytope. The proposed algorithm performance is evaluated on the well-known SOCO 2011, CEC 2013, and CEC 2017 benchmarks and compared with 26 states of the art algorithms. A real-world optimization problem is also used to calibrate its performance. The obtained results show that polyFrac outperforms all the algorithms. Moreover, experimental results and analysis suggest that polyFrac is a highly competitive optimization algorithm for solving large-scale and complex optimization problems. [ABSTRACT FROM AUTHOR]

In the last decade, the decomposition-based multiobjective optimization evolutionary algorithm (MOEA/D) has displayed promising performance when dealing with multiobjective optimization problems (MOPs). However, for some complex MOPs, the conventional MOEA/D often leads to the loss of population diversity in the iterative process, and the convergence performance of the population is weakened in the mean time. In this paper, a novel MOEA/D, based on improved multiple adaptive dynamic selection strategies and elite archive strategy (MOEA/D-IMA), is proposed to improve the population diversity and convergence. First, a novel differential evolution (DE) operator is constructed, which constitutes an operator pool with other DE operators. According to the search information of the current population, an adaptive dynamic selection strategy is proposed, which is used by MOEA/D-IMA to select a suitable DE operator to replace the simulated binary crossover (SBX) operator. Second, a parameter adaptive dynamic selection strategy is proposed to enhance the robustness of MOEA/D-IMA by using the information of population evolution state. Third, an elite archive strategy is introduced to improve the convergence and diversity of the population where mutual dominance of individuals and their aggregation distance is employed. Finally, the proposed MOEA/D-IMA is compared with several state-of-the-art algorithms on three suits of 18 test problems. Experimental results indicate that the proposed MOEA/D-IMA can significantly improve the optimization performance when coping with MOPs. [ABSTRACT FROM AUTHOR]

Selecting the most appropriate algorithm to use when attempting to solve a black-box continuous optimization problem is a challenging task. Such problems typically lack algebraic expressions, it is not possible to calculate derivative information, and the problem may exhibit uncertainty or noise. In many cases, the input and output variables are analyzed without considering the internal details of the problem. Algorithm selection requires expert knowledge of search algorithm efficacy and skills in algorithm engineering and statistics. Even with the necessary knowledge and skills, success is not guaranteed. In this paper, we present a survey of methods for algorithm selection in the black-box continuous optimization domain. We start the review by presenting Rice’s (1976) selection framework. We describe each of the four component spaces – problem, algorithm, performance and characteristic – in terms of requirements for black-box continuous optimization problems. This is followed by an examination of exploratory landscape analysis methods that can be used to effectively extract the problem characteristics. Subsequently, we propose a classification of the landscape analysis methods based on their order, neighborhood structure and computational complexity. We then discuss applications of the algorithm selection framework and the relationship between it and algorithm portfolios, hybrid meta-heuristics, and hyper-heuristics. The paper concludes with the identification of key challenges and proposes future research directions. [ABSTRACT FROM AUTHOR]

The challenge of solving nonlinear equation systems is how to locate multiple optimal solutions simultaneously in a single run. To address this issue, this paper proposes a novel algorithm by combining a diversity indicator, multi-objective optimization technique, and clustering technique. Firstly, a diversity indicator is designed to maintain the diversity of the population. Then, a K-means clustering-based selection strategy is introduced to locate the promising solutions. Finally, the local search is used to accelerate the convergence of population. The experimental results on 30 nonlinear equation systems show that the proposed algorithm is better than six state-of-the-art algorithms in terms of convergence rate and success rate. [ABSTRACT FROM AUTHOR]

This paper is concerned with the private distributed optimization problem for multi-agent systems, where all agents cooperatively minimize the sum of individual convex objective functions with the additional requirement that the functions remain differential privacy. Based on the augmented Lagrangian algorithm, an effective distributed algorithm is presented to ensure the privacy by perturbing primal estimates with additive Laplace noises. The proposed algorithm is more likely to have a faster convergence rate compared to the primal-based algorithms, and has less computational burden contrast with the ADMM-based private algorithms. By means of an important factorization of weighted Laplacian matrix, it is proven that the error between optimal solution and ergodic average estimates is bounded, which is related to the privacy level. Within this framework, trade-offs between privacy level and convergence accuracy are analyzed. Finally the effectiveness of the proposed algorithm is illustrated by numerical examples. [ABSTRACT FROM AUTHOR]

It is well known that one of the basic advantages of evolutionary programming is in deciding the most suitable place for breeding offspring and finding the route toward the global minimum. To reach this goal, the algorithm needs to estimate the coordinates of the global minimum and then steer the new point toward it. In this paper, the estimation of the global minimum is calculated by weighted mean coordination of individuals (WMP), and then a road is mapped between the coordinates of the parents and the WMP. In the proposed method, fuzzy logic is used for deciding on the road and the best coordination to breed offspring. The proposed algorithm is tested on 65 well-known cost functions and is compared with five algorithms inside the EP family. In the next section of the paper, the algorithm is tested on the high-dimensional problem of modeling ozone layer data, which includes almost 26,000 unknown parameters. The results demonstrate the capability of the proposed method in having acceptable speed and accuracy. [ABSTRACT FROM AUTHOR]

• The first study of the data repairing problem for jointly resolving inconsistencies and conflicts. • An iterative algorithm to jointly infer the source reliability degrees and the repaired result under DCs. • Two scalable strategies for the iterative algorithm by optimal grouping entities and pruning candidate values, respectively. • Experimental results clearly demonstrate that the proposed method outperforms both constraint-based data repairing and conflict resolution baselines. It is crucial to identify and resolve the inconsistencies and conflicts in data. To tackle the inconsistencies, integrity constraints are involved to constrain the attribute values of related entities. As for the multi-source conflicts, the true values of each entity are identified by trusting the reliable sources. In practice, it is common that inconsistencies and conflicts simultaneously appear. To deal with this case, traditional techniques would separately resolve the inconsistencies and conflicts, by conducting different approaches based on the above principles. However, such a procedure may not be the appropriate solution. Specifically, locally resolving conflicts for a certain entity may overlook the information from its related entities, while enforcing constraints on related entities may miss correct values of these entities in turn. To jointly resolve the inconsistencies and conflicts, this paper proposes a novel technique powered by integrity constraints and source reliability. The key component of our solution is to incorporate denial constraints, an expressive type of integrity constraint, into the process of conflict resolution. We formulate it as an optimization problem and develop an iterative algorithm to solve it. Benefiting from this algorithm, the repaired result is not only supported by reliable sources but also satisfies the denial constraints. Additionally, we also propose two optimal strategies to ensure that it is scalable under massive constraints. Experimental results on real-world datasets demonstrate the high accuracy and scalability of the proposed approach. [ABSTRACT FROM AUTHOR]

Abstract: Differential Evolution (DE) is one of the most popular optimization methods for real-valued problems and a large number of its variants have been proposed so far. However, bringing together different ideas that already led to successful DE versions is rare in the literature. In the present paper a novel DE algorithm is proposed, in which three among the most efficient concepts already applied separately within DE framework are gathered together, namely: (1) the adaptation of algorithm control parameters and probabilities of using different mutation strategies; (2) the use of Nelder–Mead algorithm as a local search method hybridized with DE; and (3) the splitting mutation into Global and Local models, when Local mutation model is based on the concept of neighborhood of individuals organized on a ring topology. The performance of the novel algorithm, called Adaptive Memetic DE with Global and Local neighborhood-based mutation operators is compared with 13 different DE variants on a set of 25 popular problems which include rotated, shifted and hybrid composition functions. It is found that, although none DE algorithm outperforms all the others for the majority of problems, on average the proposed approach perform better than all 13 DE algorithms selected for comparison. The proposed algorithm is another heuristic approach developed to solve optimization problems. The question may arise, whether proposing novel methods is useful as No Free Lunch theorems for optimization state that the expected performance of all possible heuristics on all possible problems is equal. In the last section of the paper the limitations and implications of No Free Lunch theorems are discussed based on rich, but unfortunately frequently neglected literature. A very simple continuous and differentiable minimization problem is proposed, for which it is empirically verified that each among considered 14 DE algorithms perform poorer than random sampling. It is also empirically shown that when all considered DE algorithms search for the maximum of the proposed problem, they found lower minimum than DE algorithms searching for the minimum. Such result is not unexpected according to No Free Lunch theorems and should be considered as a precaution from generalization of good performance of heuristic optimization methods. [Copyright &y& Elsevier]

Abstract: Some real-world optimization problems are plagued by a limited hardware availability. This situation can occur, for example, when the optimization must be performed on a device whose hardware is limited due to cost and space limitations. This paper addresses this class of optimization problems and proposes a novel algorithm, namely compact Particle Swarm Optimization (cPSO). The proposed algorithm employs the search logic typical of Particle Swarm Optimization (PSO) algorithms, but unlike classical PSO algorithms, does not use a swarm of particles and does not store neither the positions nor the velocities. On the contrary, cPSO employs a probabilistic representation of the swarm’s behaviour. This representation allows a modest memory usage for the entire algorithmic functioning, the amount of memory used is the same as what is needed for storing five solutions. A novel interpretation of compact optimization is also given in this paper. Numerical results show that cPSO appears to outperform other modern algorithms of the same category (i.e. which attempt to solve the optimization despite a modest memory usage). In addition, cPSO displays a very good performance with respect to its population-based version and a respectable performance also with respect to some more complex population-based algorithms. A real world application in the field of power engineering and energy generation is given. The presented case study shows how, on a model of an actual power plant, an advanced control system can be online and real-time optimized. In this application example the calculations are embedded directly on the real-time control system. [Copyright &y& Elsevier]

Abstract: A note published by Črepinšek et al. [3] (A note on teaching–learning-based optimization algorithm, Information Sciences 212 (2012) 79–93) reported three “important mistakes” regarding teaching–learning-based optimization (TLBO) algorithm. Furthermore, the authors had presented some experimental results for constrained and unconstrained benchmark functions and tried to invalidate the performance supremacy of the TLBO algorithm. However, the authors had not reviewed the latest research literature on TLBO algorithm and their observations about TLBO algorithm were based only on two papers that were published initially. The views and the experimental results presented by Črepinšek et al. [3] are questionable and this paper re-examines the experimental results and corrects the understanding about the TLBO algorithm in an objective manner. The latest literature on TLBO algorithm is also presented and the algorithm-specific parameter-less concept of TLBO is explained. The results of the present work demonstrate that the TLBO algorithm performs well on the problems where the fitness-distance correlations are low by proper tuning of the common control parameters of the algorithm. [Copyright &y& Elsevier]

Abstract: Most real world multi-objective problems (MOPs) have a complicated solution space. Facing such problems, a direction vectors based co-evolutionary multi-objective optimization algorithm (DVCMOA) that introduces the decomposition idea from MOEA/D to co-evolutionary algorithms is proposed in this paper. It is novel in the sense that DVCMOA applies the concept of direction vectors to co-evolutionary algorithms. DVCMOA first divides the entire population into several subpopulations on the basis of the initial direction vectors in the objective space. Then, it solves MOPs through the co-evolutionary interaction among the subpopulations in which individuals are classified according to their direction vectors. Finally, it explores the less developed regions to maintain the relatively uniform distribution of the solution space. In this way, DVCMOA has advantages in convergence, diversity and uniform distribution of the non-dominated solution set, which are explained through comparison with other state-of-the-art multi-objective optimization evolutionary algorithms (MOEAs) in this paper. DVCMOA is shown to be effective on 6 multi-objective 0–1 knapsack problems. [Copyright &y& Elsevier]

Abstract: This paper is devoted to the study of an extension of dynamic programming approach which allows sequential optimization of approximate decision rules relative to the length and coverage. We introduce an uncertainty measure R(T) which is the number of unordered pairs of rows with different decisions in the decision table T. For a nonnegative real number β, we consider β-decision rules that localize rows in subtables of T with uncertainty at most β. Our algorithm constructs a directed acyclic graph Δ β (T) which nodes are subtables of the decision table T given by systems of equations of the kind “attribute=value”. This algorithm finishes the partitioning of a subtable when its uncertainty is at most β. The graph Δ β (T) allows us to describe the whole set of so-called irredundant β-decision rules. We can describe all irredundant β-decision rules with minimum length, and after that among these rules describe all rules with maximum coverage. We can also change the order of optimization. The consideration of irredundant rules only does not change the results of optimization. This paper contains also results of experiments with decision tables from UCI Machine Learning Repository. [Copyright &y& Elsevier]

Abstract: The research on optimal design of infinite-impulse response (IIR) filters based on optimization techniques has gained much attention in recent years. However, due to the limited performance of the applied optimization techniques, the orders of the filters, which can be obtained, are very low in the previous research. Memetic algorithms (MAs) are widely recognized to have better convergence capability than their conventional counterparts. However, the universality of the MAs, e.g. the ability of solving diverse kinds of digital IIR filter designs, is still limited. In this paper, we design a Two-Stage ensemble Memetic Algorithm (TSMA) framework to more appropriately synthesize the strengths of the evolutionary global search and local search techniques. In the first optimization stage, a competition is held among the candidate local search techniques. Its major idea is to choose the best local search technique and to obtain good initial state. Inheriting the good information of the first stage, the second optimization stage is to implement effective adaptive MA to pursue high-quality solution. The experimental studies presented in this paper contain three aspects: (1) the benefits of the TSMA framework are experimentally investigated by comparing TSMA with its sub-optimizers and recent effective evolutionary algorithms (EAs) on 26 test functions; then (2) TSMA is compared with 4 MAs on the CEC05 functions to comprehensively show the advantages of TSMA; and (3) the TSMA and 6 state-of-the-art algorithms are applied to design high-order digital infinite-impulse response (IIR) filters. The experimental results definitely demonstrate the excellent effectiveness, efficiency and reliability of TSMA on both function optimization and digital IIR filter design tasks. [Copyright &y& Elsevier]

Abstract: Teaching–Learning-Based Optimization (TLBO) seems to be a rising star from amongst a number of metaheuristics with relatively competitive performances. It is reported that it outperforms some of the well-known metaheuristics regarding constrained benchmark functions, constrained mechanical design, and continuous non-linear numerical optimization problems. Such a breakthrough has steered us towards investigating the secrets of TLBO’s dominance. This paper reports our findings on TLBO qualitatively and quantitatively through code-reviews and experiments, respectively. Our findings have revealed three important mistakes regarding TLBO: (1) at least one unreported but important step; (2) incorrect formulae on a number of fitness function evaluations; and (3) misconceptions about parameter-less control. Additionally, unfair experimental settings/conditions were used to conduct experimental comparisons (e.g., different stopping criteria). The experimental results for constrained and unconstrained benchmark functions under fairly equal conditions failed to validate its performance supremacy. The ultimate goal of this paper is to provide reminders for metaheuristics’ researchers and practitioners in order to avoid similar mistakes regarding both the qualitative and quantitative aspects, and to allow fair comparisons of the TLBO algorithm to be made with other metaheuristic algorithms. [Copyright &y& Elsevier]

Abstract: Flow matrices are widely used in many disciplines, but few methods can estimate them. This paper presents a knowledge-based system as capable of estimating and updating large-size time-evolving flow matrix. The system in this paper consists of two major components with the purposes of matrix estimation and parallel optimization. The matrix estimation algorithm interprets and follows users’ query scripts, retrieves data from various sources and integrates them for the matrix estimation. The parallel optimization component is built upon a supercomputing facility to utilize its computational power to efficiently process a large amount of data and estimate a large-size complex matrix. The experimental results demonstrate its outstanding performance and the acceptable accuracy by directly and indirectly comparing the estimation matrix with the actual matrix constructed by surveys. [Copyright &y& Elsevier]

Abstract Achieving a balance between convergence and diversity in many-objective optimization is a great challenge. This paper suggests an evolutionary algorithm based on a region search strategy to deal with different kinds of benchmark problems. In the proposed algorithm, each solution is associated with a region, and the region search strategy is applied to constrain the updating process; this strategy will enhance the diversity of population without losing convergence. A new normalization procedure is used for dealing with scaled problems. Moreover, the comparison of two solutions is based on both dominance relation and perpendicular distance; the result shows the algorithm's reliability for solving both convex and concave problems. The performance of the proposed algorithm is validated by several well-known benchmark problems with different properties. Seven state-of-the-art algorithms are compared and the experimental results demonstrate that the introduced algorithm performs the best on almost all benchmark problems. Furthermore, the proposed strategy depicts a high computational efficiency for solving the problems with a high dimension of objectives. [ABSTRACT FROM AUTHOR]

Abstract Salient object detection has received much attention in the past decades. One of the representative approaches is utilizing the convex hull prior to find the salient object in the image. Recently, researchers have proposed many variant methods, which are based the convex hull prior. Nevertheless, most of them used a single center to construct the convex hull prior (CHP) map, while few attention has been made on the use of multiple centers. In this paper, we propose a multi-center convex hull prior based solution for salient object detection. To strengthen our solution, we also integrate two non-trivial optimizations: the first one is used to obtain an enhanced global color distinction prior (GCDP) map, and the second one is used to refine the preliminary saliency map. We conduct extensive experiments based on several widely used benchmarking datasets. The experimental results demonstrate that our solution is effective and competitive, compared against state-of-the-art saliency detection algorithms. [ABSTRACT FROM AUTHOR]

Highlights • Two simple and efficient correntropy-based adaptation algorithms, l0-MCC and MB-l0-MCC, are proposed for robust CS reconstruction. • A novel and comprehensive theoretical analysis on convergence of l0-MCC is given. • Experiment results demonstrate that the proposed algorithms achieve superior performance as compared to existing state-of-the-art robust reconstruction algorithms in many aspects. Abstract Robust compressive sensing (CS) aims to recover the sparse signals from noisy measurements perturbed by non-Gaussian (i.e., heavy-tailed) noises, where traditional CS reconstruction algorithms may perform poorly owing to utilizing the l 2 error norm in optimization. In this paper, we propose a novel maximum correntropy adaptation approach for robust CS reconstruction. The task is formulated as a l 0 regularized maximum correntropy criterion (l 0 -MCC) optimization problem and is solved by adaptive filtering approach. The proposed l 0 -MCC algorithm has a simple algorithm structure and can adaptively estimate the sparsity. It can efficiently alleviate the negative impact of noise in the presence of large outliers. Moreover, a novel theoretical analysis on convergence of l 0 -MCC is also performed. Furthermore, a mini-batch-based l 0 -MCC (MB- l 0 -MCC) algorithm is developed to speed up the convergence. Comparison with existing robust CS reconstruction algorithms is conducted via simulations, showing that the proposed methods can achieve better performance than existing state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]

Abstract Since noise is an inevitable factor in real-world applications, designing robust image recovery technologies is crucial for the application of a compressive sensing (CS) system. However, current CS approaches rarely consider noise, or they only consider the noise generated in the process of transmission. Almost all CS approaches will breakdown when the original image is corrupted by noise due to natural or artificial factors, especially non-Gaussian noise. In this paper, we propose a nonconvex m-estimator-based robust image CS approach to recover the original clean images from the compressed measurements of their corrupted versions. We simultaneously conduct reconstructing and denoising in a unified framework. We also use a weighted schatten- p norm to better exploit the nonlocal low-rank property. In addition, we developed an efficient iterative scheme based on the half-quadratic theory and the alternating direction method of multipliers to solve the resulting nonconvex optimization problem. The experimental results show that the proposed algorithm can recover the clean images accurately when the original images are corrupted by non-Gaussian noise. [ABSTRACT FROM AUTHOR]

Highlights • A mapping between the covering array domain and the graph domain. • A greedy algorithm to construct CAs and MCAs in the graph domain. • Matching and improvement of upper bounds for CAs and MCAs. Abstract Combinatorial interaction testing is an effective method to assess the functionality of hardware and software components, and usually, covering arrays (CAs) and mixed covering arrays (MCAs) are used as test-suites. The main contributions of this work are the development of a graph representation for the problem of constructing CAs and MCAs, and the creation of a competitive greedy algorithm to solve the construction problem of CAs and MCAs in the graph domain. The representation that we introduce in this paper is denoted as Coverage in Nodes (CN) and our algorithm is called Graph Based Greedy Algorithm (GBGA). We have compared the performance of GBGA with other state-of-the-art greedy algorithm regarding the construction of CAs and MCAs. It is remarkable to note that we were able to define 13 new upper bounds for MCAs. [ABSTRACT FROM AUTHOR]

Abstract As a new evolutionary computation method, the structure of backtracking search optimization algorithm (BSA) is simple and the exploration capability of it is strong. However, the global performance of the BSA is significantly affected by mutation strategies and control parameters. Designing appropriate mutation strategies and control parameters is important to improve the global performance of the BSA. In this paper, an adaptive BSA with knowledge learning (KLBSA) is developed to improve the global performance of the BSA. In the method, an adaptive control parameter based on the global and local information of the swarms in the current iteration is designed to adjust the search step length of individuals, which helps to balance the exploration and exploitation abilities of the algorithm. Moreover, a new mutation strategy based on the guidance of different information is designed to improve the optimization ability of the algorithm. In addition, a multi-population strategy is implemented to thoroughly improve the searching ability of the algorithm for different searching areas. To this end, experiments on three groups of benchmark functions and three real-world problems are implemented to verify the performance of the proposed KLBSA algorithm. The results indicate that the proposed algorithm performs competitively and effectively when compared to some other evolutionary algorithms. [ABSTRACT FROM AUTHOR]

Abstract Differential evolution (DE) is a simple yet powerful evolutionary algorithm that has been used to solve various complex optimization problems in numerous engineering fields. However, DE has some problems, such as premature convergence and sensitivity to parameter settings. To improve the performance of DE and extend its application, an adaptive differential evolution with the Lagrange interpolation argument algorithm (ADELI) is proposed in this paper. To accelerate the convergence speed of DE, a local search with Lagrange interpolation (LSLI) is introduced into DE. LSLI performs a local search in the neighborhood of the best individual in the current generation to enhance the exploitation capability of DE. Meanwhile, an adaptive argument strategy is presented to adaptively determine whether to use LSLI in terms of its performance in the previous generation, which can balance the global exploration capability and the local exploitation capability of ADELI. To verify the feasibility and effectiveness of ADELI, 30 test functions in the CEC 2014 benchmark sets with different dimensions were simulated. Moreover, a path synthesis problem was also optimized. The results demonstrated that ADELI considerably outperforms other EAs in most functions and obtains the most accurate solution among the compared algorithms in the application of path generation. [ABSTRACT FROM AUTHOR]

Abstract: Digital watermarking is a useful solution for digital rights management systems, and it has been a popular research topic in the last decade. Most watermarking related literature focuses on how to resist deliberate attacks by applying benchmarks to watermarked media that assess the effectiveness of the watermarking algorithm. Only a few papers have concentrated on the error-resilient transmission of watermarked media. In this paper, we propose an innovative algorithm for vector quantization (VQ) based image watermarking, which is suitable for error-resilient transmission over noisy channels. By incorporating watermarking with multiple description coding (MDC), the scheme we propose to embed multiple watermarks can effectively overcome channel impairments while retaining the capability for copyright and ownership protection. In addition, we employ an optimization technique, called tabu search, to optimize both the watermarked image quality and the robustness of the extracted watermarks. We have obtained promising simulation results that demonstrate the utility and practicality of our algorithm. [Copyright &y& Elsevier]

Abstract This paper develops a novel algorithm to solve real-world constrained optimization problems, which hybridizes multiobjective optimization techniques with an ϵ-constrained method. First, a constrained optimization problem at hand is transformed into a bi-objective optimization problem. By the transformation, the advantage of multiobjective optimization techniques can be utilized in the constrained optimization area to balance population diversity and convergence. Meanwhile, the ϵ-constrained method is applied, which keeps the population evolving toward feasible region of the constrained optimization problem. In our proposed algorithm, the differential evolution is employed as a search engine to create offspring at each generation. Further, different combinations of mutation operators have been developed to improve the search ability and the population convergence at different stages. The performance of our approach is evaluated on 64 benchmark test functions from three popular test suits. Experimental results demonstrate that our proposed approach is capable of obtaining high-quality solutions on the majority of benchmark test functions, when compared with some other state-of-the-art constrained optimization algorithms. [ABSTRACT FROM AUTHOR]

Abstract This paper focuses on the problem of sparse learning-to-rank , where the learned ranking models usually have very few non-zero coefficients. An exponential gradient algorithm is proposed to learn sparse models for learning-to-rank, which can be formulated as a convex optimization problem with the ℓ 1 constraint. Our proposed algorithm has a competitive theoretical worst-case performance guarantee, that is, we can obtain an ϵ-accurate solution after O (1 ϵ) iterations. An early stopping criterion based on Fenchel duality is proposed to make the algorithm be more efficient in practice. Extensive experiments are conducted on some benchmark datasets. The results demonstrate that a sparse ranking model can significantly improve the accuracy of ranking prediction compared to dense models, and the proposed algorithm shows stable and competitive performance compared to several state-of-the-art baseline algorithms. [ABSTRACT FROM AUTHOR]

Abstract: Motivated by the recent success of diverse approaches based on differential evolution (DE) to solve constrained numerical optimization problems, in this paper, the performance of this novel evolutionary algorithm is evaluated. Three experiments are designed to study the behavior of different DE variants on a set of benchmark problems by using different performance measures proposed in the specialized literature. The first experiment analyzes the behavior of four DE variants in 24 test functions considering dimensionality and the type of constraints of the problem. The second experiment presents a more in-depth analysis on two DE variants by varying two parameters (the scale factor F and the population size NP), which control the convergence of the algorithm. From the results obtained, a simple but competitive combination of two DE variants is proposed and compared against state-of-the-art DE-based algorithms for constrained optimization in the third experiment. The study in this paper shows (1) important information about the behavior of DE in constrained search spaces and (2) the role of this knowledge in the correct combination of variants, based on their capabilities, to generate simple but competitive approaches. [ABSTRACT FROM AUTHOR]

Abstract: Most contemporary multi-objective evolutionary algorithms (MOEAs) store and handle a population with a linear list, and this may impose high computational complexities on the comparisons of solutions and the fitness assignment processes. This paper presents a data structure for storing the whole population and their dominating information in MOEAs. This structure, called a Dominance Tree (DT), is a binary tree that can effectively and efficiently store three-valued relations (namely dominating, dominated or non-dominated) among vector values. This paper further demonstrates DT’s potential applications in evolutionary multi-objective optimization with two cases. The first case utilizes the DT to improve NSGA-II as a fitness assignment strategy. The second case demonstrates a DT-based MOEA (called a DTEA), which is designed by leveraging the favorable properties of the DT. The simulation results show that the DT-improved NSGA-II is significantly faster than NSGA-II. Meanwhile, DTEA is much faster than SPEA2, NSGA-II and an improved version of NSGA-II. On the other hand, in regard to converging to the Pareto optimal front and maintaining the diversity of solutions, DT-improved NSGA-II and DTEA are found to be competitive with NSGA-II and SPEA2. [Copyright &y& Elsevier]

Abstract: How much attention should be paid to the promising infeasible solutions during the evolution process is investigated in this paper. Stochastic ranking has been demonstrated as an effective technique for constrained optimization. In stochastic ranking, the comparison probability will affect the position of feasible solution after ranking, and the quality of the final solutions. In this paper, the dynamic stochastic selection (DSS) is put forward within the framework of multimember differential evolution. Firstly, a simple version named DSS-MDE is given, where the comparison probability decreases linearly. The algorithm DSS-MDE has been compared with two state-of-the-art evolution strategies and three competitive differential evolution algorithms for constrained optimization on 13 common benchmark functions. DSS-MDE is also evaluated on four well-studied engineering design examples, and the experimental results are significantly better than current available results. Secondly, other dynamic settings of the comparison probability for DSS-MDE are also designed and tested. From the experimental results, DSS-MDE is effective for constrained optimization. Finally, DSS-MDE with a square root adjusted comparison probability is evaluated on the 22 benchmark functions in CEC’06, and the experimental results on most functions are competitive. [Copyright &y& Elsevier]

This paper describes an evolutionary algorithm for optimization of continuous problems that combines advanced recombination techniques for discrete representations with advanced mutation techniques for continuous representations. Discretization is used to transform solutions between the discrete and continuous domains. The proposed algorithm combines the strengths of purely continuous and purely discrete approaches and eliminates some of their disadvantages. The paper tests the proposed algorithm with the recombination operator of the Bayesian optimization algorithm, σ-self-adaptive mutation, and three discretization methods. The empirical results on three problems suggest that the tested variant of the algorithm scales up well on all tested problems, indicating good scalability over a broad range of continuous problems. [Copyright &y& Elsevier]

This paper addresses a sequence dependent setup times no-wait flowshop with learning and forgetting effects to minimize total flowtime. This problem is NP-hard and has never been considered before. A position-based learning and forgetting effects model is constructed. Processing times of operations change with the positions of corresponding jobs in a schedule. Objective increment properties are deduced and based on them three accelerated neighbourhood construction heuristics are presented. Because of the simplicity and excellent performance shown in flowshop scheduling problems, an iterated greedy heuristic is proposed. The proposed iterated greedy algorithm is compared with some existing algorithms for related problems on benchmark instances. Comprehensive computational and statistical tests show that the presented method obtains the best performance among the compared methods. [ABSTRACT FROM AUTHOR]

This paper investigates the task assignment problem for a team of autonomous aerial/marine vehicles driven by constant thrust and maneuvering in a planar lateral drift field. The aim is to minimize the total traveling time in order to guide the vehicles to deliver a number of customized sensors to a set of target points with different sensor demands in the drift field. To solve the problem, we consider together navigation strategies and target assignment algorithms; the former minimizes the traveling time between two given locations in the drift field and the latter allocates a sequence of target locations to each vehicle. We first consider the effect of the weight of the carried sensors on the speed of each vehicle, and construct a sufficient condition to guarantee that the whole operation environment is reachable for the vehicles. Then from optimal control principles, time-optimal path planning is carried out to navigate each vehicle from an initial position to its given target location. Most importantly, to assign the targets to the vehicles, we combine the virtual coding strategy, multiple offspring method, intermarriage crossover strategy, and the tabu search mechanism to obtain a co-evolutionary multi-population genetic algorithm, short-named CMGA. Simulations on sensor delivery scenarios in both fixed and time-varying drift fields are shown to highlight the satisfying performances of the proposed approach against popular greedy algorithms. [ABSTRACT FROM AUTHOR]

Although dynamic optimization and multi-objective optimization have made considerable progress individually, solving dynamic multi-objective optimization problems remains a monumental challenge since their multiple, conflicting objectives could change over time. In this paper, we propose a Domain Adaptation and Nonparametric Estimation-based Estimation of Distribution Algorithm, called DANE-EDA, to solve dynamic multi-objective optimization problems. Notable features of the proposed algorithm include the importance sampling, nonparametric density estimation, probabilistic prediction, and a domain adaptation technique seamlessly unified under an innovative framework. The design takes full advantage of the powerful Monte-Carlo method and transfer learning technique. This kind of combination will help the proposed algorithm to maintain a delicate exploration-exploitation trade-off from temporal and spatial perspectives. At the same time, it will help the proposed algorithm to overcome the shortcomings caused by transfer learning, specifically, the loss of the diversity. After proving convergence and analyzing the computational complexity of the DANE-EDA, we compare the proposed method with nine EDAs or dynamic multi-objective optimization algorithms on twelve different test instances. The experimental results affirm the effectiveness of the proposed method in addressing dynamic multi-objective optimization problems. [ABSTRACT FROM AUTHOR]

“ Fuzzy Theoretic Approach to Signals and Systems ” assumes all system variables and parameters as uncertain (i.e. being characterized by membership functions), develops a mathematical theory for analytically determining the membership functions on system variables and parameters, derives algorithms for estimating the parameters of membership functions, and establishes robustness and convergence properties of the estimation algorithms. The membership functions are analytically determined via solving a variational optimization problem that maximizes the “ over-uncertainties-averaged-log-membership ” of the observed data around an initial guess. This paper develops the analytical fuzzy theory for the particular case of a multi-input single-output static system affected by noises. The theory facilitates designing an adaptive filtering algorithm. The robustness of the adaptive filtering algorithm is proved theoretically via a mathematical analysis. Numerical experiments further demonstrate the robustness of the filtering algorithm. A comparison of the algorithm with the state-of-art methods is made using the practical biomedical applications related to the modeling and analysis of heart rate signals for assessing the physiological state of an individual. [ABSTRACT FROM AUTHOR]

Over the last two decades, many different differential evolution algorithms for solving optimization problems have been introduced. Although most of these algorithms used a single mutation strategy, several with multiple mutation strategies have recently been proposed. Multiple-operator-based algorithms have been proven to be more effective and efficient than single-operator-based algorithms for solving a wide range of benchmark and practical problems. In these algorithms, adaptive operator selection mechanisms are generally applied to place greater emphasis on the best-performing evolutionary operators based on their performance histories for generating new offspring. In this paper, we investigate using problem landscape information in an adaptive operator selection mechanism. For this purpose, a new algorithm, which considers both this problem landscape information and the performance histories of the operators, for dynamically selecting the most suitable differential evolution operator during the evolutionary process, is proposed. The contributions of each component of the selection mechanism are analyzed and the performance of the proposed algorithm is evaluated by solving 45 unconstrained optimization problems. The results demonstrate the effectiveness and superiority of the proposed algorithm to state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]

Estimation of distribution algorithms (EDAs) have become a reliable alternative to solve a broad range of single and multi-objective optimization problems. Recently, distance-based exponential models, such as Mallows Model (MM) and Generalized Mallows Model (GMM), have demonstrated their validity in the context of EDAs to deal with permutation-based optimization problems. The aim of this paper is two-fold. First, we introduce a novel general multi-objective decomposition-based EDA using Kernels of Mallows models (MEDA/D-MK framework) for solving multi-objective permutation-based optimization problems. Second, in order to demonstrate the validity of the MEDA/D-MK, we have applied it to solve the multi-objective permutation flowshop scheduling problem (MoPFSP) minimizing the total flow time and the makespan. The permutation flowshop scheduling problem is one of the most studied problems of this kind due to its fields of application and algorithmic challenge. The results of our experiments show that MEDA/D-MK outperforms an improved MOEA/D variant specific tailored for minimizing makespan and total flowtime. Furthermore, our approach achieves competitive results compared to the best-known approximated Pareto fronts reported in the literature for the benchmark considered. [ABSTRACT FROM AUTHOR]

A counterexample is provided to illustrate the incorrectness of I 0 in Rule 1 presented by Guo et al. [F.F. Guo, L.P. Pang, D. Meng, Z.Q. Xia. An algorithm for solving optimization problems with fuzzy relational inequality constraints, Information Sciences 252 (2013) 20-31]. In other words, (7b) and (7 b * ) in the referenced paper above are not equivalent unless index set I 0 is revised, since the definition of I 0 in Rule 1 can only be correct when the constraints are fuzzy relational equations. And finally the correct of I 0 is also presented in this note. [ABSTRACT FROM AUTHOR]

The advantages and applications of rule-based systems have caused them to be widely recognized as one of the most popular systems in human decision-making, due to their accuracy and efficiency. To improve the performance of rule-based systems, there are several issues proposed to be focused. First, it is unnecessary to take the entire rule base into consideration during each decision-making process. Second, there is no need to visit the entire rule base to search for the key rules. Last, the key rules for each decision-making process should be different. This paper focuses on an advanced extended belief rule base (EBRB) system and proposes a multi-attribute search framework (MaSF) to reconstruct the relationship between rules in the EBRB to form the MaSF-based EBRB. MaSFs can be divided into k -dimensional tree (KDT)-based MaSFs and Burkhard–Keller (BKT)-based MaSFs. The former is targeted at decision-making problems with small-scale attribute datasets, while the latter is for those with large-scale attribute datasets. Based on the MaSF-based EBRB, the k -neighbor search and the best activated rule set algorithms are further proposed to find both the unique and the desired rules for each decision-making process without visiting the entire EBRB, especially when handling classification problems with large attribute datasets. Two sets of experiments based on benchmark datasets with different numbers of attributes are performed to analyze the difference between KDT-based MaSFs and BKT-based MaSFs, and to demonstrate how to use MaSFs to improve the accuracy and efficiency of EBRB systems. MaSFs and their corresponding algorithms are also regarded as a general optimization framework that can be used with other rule-based systems. [ABSTRACT FROM AUTHOR]

According to the literature, a linear optimization problem subjected to a system of bipolar fuzzy relational equations with max-Łukasiewicz composition can be translated into a 0–1 integer linear programming problem and solved using integer optimization techniques. However, the technique of integer optimization may involve hight computation complexity. To improve computational efficiency for solving such an optimization problem, this paper proves that each component of an optimal solution obtained from such an optimization problem can either be the corresponding component’s lower bound or upper bound value. Because of this characteristic, a simple value matrix with some simplified rules can be proposed to reduce the problem size first. A simple solution procedure is then presented for determining optimal solutions without translating such an optimization problem into a 0–1 integer linear programming problem. Two examples are provided to illustrate the simplicity and efficiency of the proposed algorithm. [ABSTRACT FROM AUTHOR]

Considering the practical application background in peer-to-peer network system, we investigate the single-variable term semi-latticized fuzzy relation geometric programming with max-product operator in this paper. Based on the characteristics of the objective function and feasible domain, we develop a matrix approach to deal with the proposed problem. A step-by-step algorithm is proposed to find an optimal solution without solving all the minimal solutions of the constraint. Two examples are given to illustrate the feasibility and efficiency of the algorithm. [ABSTRACT FROM AUTHOR]

The diversity of solutions is of great importance for multi-objective evolutionary algorithms. In this paper, a new multi-objective particle swarm optimization algorithm based on decomposition (MPSO/D) is proposed. Firstly, the objective space of a multi-objective problem is decomposed into a set of sub-regions based on a set of direction vectors. Then MPSO/D makes each sub-region have a solution to maintain the diversity. Secondly, considering the convergence of solutions, MPSO/D uses the crowding distance to calculate the fitness values of the reserved solutions for selection operator, and uses the neighboring particles of a particle to determine the global best historical position ( gbest ) of the particle. The proposed algorithm has been compared with NSGAII, MOEA/D and NNIA on sixteen test sets. The experimental results illustrate that the proposed algorithm outperforms NSGAII, MOEA/D and NNIA in terms of convergence and diversity. [ABSTRACT FROM AUTHOR]