Search

• An analysis of lexicographic optimization for feature selection and data classification. • Cooperative co-evolution for feature selection while the classifier hyperparameters are also being optimized. • Optimization of multiple objectives using a simple evolutionary algorithm. • A new lexicographic ranking methodology to compare the results of different feature selection methods. • Quite good results for real high-dimensional datasets. This paper starts with two hypotheses. The first one is that the simultaneous optimization of the hyperparameters regulating the classifier within a wrapper method, while the best subset of features is being determined, should improve the results with respect to those obtained with a pre-parameterized classifier. The second one is that solving these two problems can be formulated as a lexicographic optimization problem, allowing the use of a simple single-objective evolutionary algorithm to solve this multi-objective problem. The fitness function is of key importance for such wrapper methods. It is responsible for guiding the search towards potentially good solutions and it also consumes most of the runtime. Having these issues in mind, this paper also proposes a new lexicographic fitness function, designed to minimize the runtime of the algorithm and also to avoid over-fitting. Furthermore, the execution time and the quality of the results obtained by the wrapper procedure also depend on some algorithmic hyperparameters: the similarity thresholds used when comparing two different solutions lexicographically and the percentage of data samples used for validation during the training process. Thus, an experimental analysis has been carried out to find adequate values for these hyperparameters. Finally, the lexicographic cooperative co-evolutionary wrapper approach, using the new fitness function proposed in this paper, has been tested with several datasets belonging to the University of California, Irvine (UCI) repository and also with some real high-dimensional datasets, obtaining quite good results, compared to other state-of-the-art wrapper methods. The comparison has also been made lexicographically, with a new methodology proposed in this paper. [ABSTRACT FROM AUTHOR]

Adversarial sample generation problem is a hot issue in the security field of deep learning. Evolutionary algorithm has been widely used to solve this problem in recent years because of its good global search ability. However, existing methods still suffer from the "curse of dimensionality" when attacking high-resolution images. In this paper, a two-stage frequency domain generation algorithm of black-box adversarial samples based on differential evolution is proposed. In the first stage, a representative image-guided differential evolution method is proposed to quickly generate a universal adversarial perturbation with a high attack success rate in the frequency-domain. In the second stage, a space reduction strategy based on frequency-domain pixel blocks is designed to reduce the search space and alleviate the problem of "curse of dimensionality". In addition, a new space–frequency interaction sensitivity measure is introduced to evaluate the similarity between the adversarial samples and the original images. The adversarial perturbations obtained by the measure are more in line with the subjective perception of the human eye. Finally, compared with several typical black-box adversarial sample generation algorithms, experimental results show that the proposed algorithm can achieve higher attack success rate with less prediction times. • Proposing a two-stage evolutionary generation framework of adversarial samples. • Developing a space–frequency interaction sensitivity measure. • Presenting a representative image-guided differential evolutionary algorithm. • Designing an individual adversarial perturbation generation algorithm. [ABSTRACT FROM AUTHOR]

The fitness landscape is a theory applied to the evolutionary dynamics of biological evolution to explain the behavior of evolutionary algorithms in the solution of optimization problems. With the continuous advancement of evolutionary algorithm optimization, a fitness landscape can present more abundant feature information, such as the local fitness, fitness distance correlation, and landscape roughness. These landscape features reflect the optimal solution distribution, quantity, and local unimodal topology of the optimization problem from various angles. This paper expresses the adaptability landscape features of typical optimization problems, engages in a quantitative analysis of the fitness distance correlation information, evaluates the difficulty of solving the problem within the search space, and obtains the correlation degree classification result. The search strategy adapts the mixed mutation and the fitness distance correlation for differential evolution. Empirical studies show that, the fitness distance correlation search strategy for the differential evolution algorithm can avoid falling into the local optimum, improve accuracy and convergence, and solve the single-objective optimization problem in a more comprehensive manner. [ABSTRACT FROM AUTHOR]

Coal consumption and free calcium oxide (f-CaO) content are two important production indicators in the cement calcination process, and its collaborative optimization is of great significance to improve the production performance. However, due to the multiple dynamic interferences and multiple conflicts between coal consumption and f-CaO, product quality is unstable and coal consumption becomes high. To address the problems, this paper proposes a multi-objective collaborative optimization method for cement calcination process. This method takes the coal consumption and f-CaO content as the optimization objectives to establish a multi-objective optimization model. In addition, to solve the problem that static single-step optimization is difficult to track the continuous change of working conditions, we propose a time domain rolling multi-objective Jaya algorithm (TDRM-Jaya) to optimize the model. The algorithm, involving a population update strategy, a selection strategy and a time domain rolling strategy, realizes the dynamic rolling optimization for the cement calcination process. The test comparison with several common intelligent optimization algorithms demonstrates the advantages of using TDRM-Jaya. Besides, practical industrial data validates the effectiveness of the proposed optimization method. [Display omitted] • A multi-objective optimization model of cement calcination process is developed. • A TDRM-Jaya algorithm is proposed applied to solve the optimization model. • The multi-objective collaborative optimization using data-driven model is studied. • Computational results show that the expected optimization effect can be achieved. [ABSTRACT FROM AUTHOR]

A large number of metaheuristic algorithms have been proposed in the last three decades, but no metaheuristic algorithm is superior to the others for all the optimization problems. It is laborious to select an appropriate metaheuristic algorithm to solve a problem, especially for laymen. In this paper, a framework for co-evolutionary algorithm using Q-learning with the meme is proposed, which is called as QLMA. The solution generation method in the metaheuristic algorithm is named meme, which is also viewed as the action for an agent in Q-learning, and multiple memes form the action set. In the initial stage, the tent map and opposition based learning are employed to obtain the initial population. In updating stage, a new population is generated by an action that is chosen from the action set by the agent in Q-learning, then the disruption operation is applied, avoiding excessive aggregation of solutions around the current global optimal solution and improving the balance between exploration and exploitation. QLMA is compared to sixteen algorithms on 23 classical benchmark functions, CEC 2017, and CEC 2019 benchmark functions. The experimental results demonstrate that QLMA is superior to the peer algorithms and has a good balance between exploration and exploitation. [ABSTRACT FROM AUTHOR]

Abstract: The environmental/economic dispatch (EED) is an important daily optimization task in the operation of many power systems. It involves the simultaneous optimization of fuel cost and emission objectives which are conflicting ones. The EED problem can be formulated as a large-scale highly constrained nonlinear multiobjective optimization problem. In recent years, many metaheuristic optimization approaches have been reported in the literature to solve the multiobjective EED. In terms of metaheuristics, recently, scatter search approaches are receiving increasing attention, because of their potential to effectively explore a wide range of complex optimization problems. This paper proposes an improved scatter search (ISS) to deal with multiobjective EED problems based on concepts of Pareto dominance and crowding distance and a new scheme for the combination method. In this paper, we have considered the standard IEEE (Institute of Electrical and Electronics Engineers) 30-bus system with 6-generators and the results obtained by proposed ISS algorithm are compared with the other recently reported results in the literature. Simulation results demonstrate that the proposed ISS algorithm is a capable candidate in solving the multiobjective EED problems. [Copyright &y& Elsevier]

Abstract: This paper presents an evolutionary algorithm for wind speed reconstruction from synoptic pressure patterns. The algorithm operates in a search space formed by grids of pressure measures, and must classify the different situations into classes, in such a way that a measure of wind speed in a given point is minimized among patterns assigned to the same class. Then, each class is assigned a mean wind speed and direction, so the wind speed reconstruction is possible for a new grid of synoptic pressures. In this paper we present the problem model and the specific description of the evolutionary algorithm proposed to solve the problem. We also show the good performance of the proposed method in the reconstruction of the average wind speed in six wind towers in Spain. The proposed method is applicable to wind speed reconstruction or reconstruction of wind missing data of wind series, specially when there is no other variable or related measure available. [Copyright &y& Elsevier]

Abstract: Evolutionary algorithms (EAs) are useful tools in design optimization. Due to their simplicity, ease of use, and suitability for multi-objective design optimization problems, EAs have been applied to design optimization problems from various areas. In this paper we review the recent progress in design optimization using evolutionary algorithms to solve real-world aerodynamic problems. Examples are given in the design of turbo pump, compressor, and micro-air vehicles. The paper covers the following topics that are deemed important to solve a large optimization problem from a practical viewpoint: (1) hybridized approaches to speed up the convergence rate of EAs; (2) the use of surrogate model to reduce the computational cost stemmed from EAs; (3) reliability based design optimization using EAs; and (4) data mining of Pareto-optimal solutions. [Copyright &y& Elsevier]

Wind energy has become the world's fastest growing energy source. Although wind farm layout is a well known problem, its solution used to be heuristic, mainly based on the designer experience. A key in search trend is to increase power production capacity over time. Furthermore the production of wind energy often involves uncertainties due to the stochastic nature of wind speeds. The addressed problem contains a novel aspect with respect of other wind turbine selection problems in the context of wind farm design. The problem requires selecting two different wind turbine models (from a list of 26 items available) to minimize the standard deviation of the energy produced throughout the day while maximizing the total energy produced by the wind farm. The novelty of this new approach is based on the fact that wind farms are usually built using a single model of wind turbine. This paper describes the usage of multi-objective evolutionary algorithms (MOEAs) in the context of power energy production, selecting a combination of two different models of wind turbine along with wind speeds distributed over different time spans of the day. Several MOEAs variants belonging to the most renowned and widely used algorithms such as SPEA2 NSGAII, PESA and msPEA have been investigated, tested and compared based on the data gathered from Cancun (Mexico) throughout the year of 2008. We have demonstrated the powerful of MOEAs applied to wind turbine selection problem (WTS) and estimate the mean power and the associated standard deviation considering the wind speed and the dynamics of the power curve of the turbines. Among them, the performance of PESA algorithm looks a little bit superior than the other three algorithms. In conclusion, the use of MOEAs is technically feasible and opens new perspectives for assisting utility companies in developing wind farms. [ABSTRACT FROM AUTHOR]

Students generally attempt to improve themselves with different manners in their spare time. Inspired by this fact, this paper presents a multi-objective elitist feedback teaching–learning-based optimization (MEFTO) algorithm for multi-objective optimization problems. To promote the exploration capacity and convergence of the basic teaching–learning-based optimization (TLBO), a feedback phase that simulates the spare-time learning phenomenon is introduced at the end of the learner phase. Students should compare their score with the average class score to select an appropriate means for further improvement. Poorly performing students can learn from the teacher directly for rapid improvement, whereas high-performing students prefer to motivate themselves for reinforcement learning. Non-dominated sorting is incorporated to permit this heuristic to solve problems with several objectives. Crowding distance calculation is adopted to maintain the diversity of the obtained solution set in a single run. Elitism strategy is also employed to provide a great improvement for the algorithm. The performance of the MEFTO algorithm is compared with seven other well-known algorithms by using a set of unconstrained benchmark test problems and three constrained engineering optimization problems. The qualitative and quantitative results indicate that the proposed algorithm can provide considerably competitive results and outperforms the other algorithms. • A novel multi-objective evolutionary algorithm (MEFTO) is developed. • The developed algorithm is evaluated on a series of benchmark functions. • The performance of the MEFTO is demonstrated using various metrics. • The developed algorithm is applied to solve three constrained engineering problem. [ABSTRACT FROM AUTHOR]

In this paper, a new compact algorithm is proposed. Two sinusoidal formulas are used to automatically adjust the crossover rate and the mutation scaling factor in the compact Differential Evolution (cDE) metaheuristic. The proposed algorithm, called Compound Sinusoidal cDE, CScDE, is compared to seven state-of-the-art compact algorithms on the well-known BBOB test-bed, the CEC-2014 test suite for continuous optimisation, as well as five real-world optimisation problems chosen from the CEC-2011 benchmarks. The CScDE algorithm outperformed its competitors for most problem categories and over most dimensions. It is also compared to some well-established population-based metaheuristics. • A compact compound sinusoidal differential evolution, CScDE, is proposed. • CScDE uses sinusoidal formulas to adjust the parameters of compact DE. • Both binomial and exponential crossover are tested. • CScDE is applied on 89 reference problems with several dimensions. • CScDE outperformed state-of-the-art compact algorithms. [ABSTRACT FROM AUTHOR]

• A two-stage evolution strategy is proposed for solving multi-objective problem. • The convergence and diversity should be balanced in multi-objective optimization. • A local searching method can improve the diversity of solutions in the space. • Experimental results have been presented by using statistical method. The balance of convergence and diversity plays a significant role to the performance of multi-objective evolutionary algorithms (MOEAs). The MOEA/D is a very popular multi-objective optimization algorithm and has been used to solve various real world problems. Like many other algorithms, the MOEA/D also has insufficient ability of convergence and diversity when tackling certain complex multi-objective optimization problems (MOPs). In this paper, a novel algorithm named MOEA/D-TS is proposed for effectively solving MOPs. The new algorithm adopts two stages evolution strategies, the first stage is focused on pushing the solutions into the area of the Pareto front and speeding up its convergence ability, after that, the second stage conducts in the operating solution's diversity and makes the solutions distributed uniformly. The performance of MOEA/D-TS is validated in the ZDT, DTLZ and IMOP problems. Compared with others popular and variants algorithms, the experimental results demonstrate that the proposed algorithm has advantage over other algorithms with regard to the convergence and diversity in most of the tested problems. [ABSTRACT FROM AUTHOR]

This paper tackles the short-term hydro-power unit commitment problem in a multi-reservoir system — a cascade-based operation scenario. For this, we propose a new mathematical modeling in which the goal is to maximize the total energy production of the hydro-power plant in a sub-daily operation, and, simultaneously, to maximize the total water content (volume) of reservoirs. For solving the problem, we discuss the Multi-objective Evolutionary Swarm Hybridization (MESH) algorithm, a recently proposed multi-objective swarm intelligence-based optimization method which has obtained very competitive results when compared to existing evolutionary algorithms in specific applications. The MESH approach has been applied to find the optimal water discharge and the power produced at the maximum reservoir volume for all possible combinations of turbines in a hydro-power plant. The performance of MESH has been compared with that of well-known evolutionary approaches such as NSGA-II, NSGA-III, SPEA2, and MOEA/D in a realistic problem considering data from a hydro-power energy system with two cascaded hydro-power plants in Brazil. Results indicate that MESH showed a superior performance than alternative multi-objective approaches in terms of efficiency and accuracy, providing a profit of $412,500 per month in a projection analysis carried out. • An efficient Multi-objective Evolutionary Swarm Hybrid algorithm is proposed. • Development of a nonlinear model to operational control of Hydro-power plants. • Hydro-power plant data regression obtains the maximum efficiency of the power units. • Efficiency energy goals achieved an increasing the profit in the energy production. [ABSTRACT FROM AUTHOR]

With the development of cloud computing (CC), service-oriented architecture (SOA), and container technology, modeling and simulation (M&S) resources, such as simulation software and different sorts of models, can be shared and reused in a cloud environment. Modeling and Simulation as a Service (MSaaS), as a new paradigm, supports sharing simulation models or modeling tools and has enabled a wide range of model reuse. However, reusing or combining some immature models may result in inefficient M&S activities or even false simulation results. To make sure the appropriate reuse and composition of simulation models in cloud environments, which is also termed as model service composition for simulation (MSCS), this paper incorporates model maturity with service cooperation as a metric to evaluate the quality of model composition in cloud. Then, as a multi-objective optimization problem with multiple constraints, the MSCS problem and its process are described in detail. To solve the MSCS problem, a novel evolutionary algorithm named CA-AO-NSGAII is proposed. In the algorithm, adaptive crossover and mutation operators, as well as probabilistic initialization are developed. Furthermore, a half-local search algorithm in an elitist mechanism is designed for efficient decision-making. To validate the performance of CA-AO-NSGAII, experiments with respect to four different cases are conducted. Results show that the proposed method for addressing MSCS issue is effective and feasible. [ABSTRACT FROM AUTHOR]

Abstract: In recent years, indicator-based evolutionary algorithms, allowing to implicitly incorporate user preferences into the search, have become widely used in practice to solve multiobjective optimization problems. When using this type of methods, the optimization goal changes from optimizing a set of objective functions simultaneously to the single-objective optimization goal of finding a set of points that maximizes the underlying indicator. Understanding the difference between these two optimization goals is fundamental when applying indicator-based algorithms in practice. On the one hand, a characterization of the inherent optimization goal of different indicators allows the user to choose the indicator that meets her preferences. On the other hand, knowledge about the sets of points with optimal indicator values–the so-called optimal -distributions–can be used in performance assessment whenever the indicator is used as a performance criterion. However, theoretical studies on indicator-based optimization are sparse. One of the most popular indicators is the weighted hypervolume indicator. It allows to guide the search towards user-defined objective space regions and at the same time has the property of being a refinement of the Pareto dominance relation with the result that maximizing the indicator results in Pareto-optimal solutions only. In previous work, we theoretically investigated the unweighted hypervolume indicator in terms of a characterization of optimal -distributions and the influence of the hypervolume’s reference point for general bi-objective optimization problems. In this paper, we generalize those results to the case of the weighted hypervolume indicator. In particular, we present general investigations for finite , derive a limit result for going to infinity in terms of a density of points and derive lower bounds (possibly infinite) for placing the reference point to guarantee the Pareto front’s extreme points in an optimal -distribution. Furthermore, we state conditions about the slope of the front at the extremes such that there is no finite reference point that allows to include the extremes in an optimal -distribution—contradicting previous belief that a reference point chosen just above the nadir point or the objective space boundary is sufficient for obtaining the extremes. However, for fronts where there exists a finite reference point allowing to obtain the extremes, we show that for to infinity, a reference point that is slightly worse in all objectives than the nadir point is a sufficient choice. Last, we apply the theoretical results to problems of the ZDT, DTLZ, and WFG test problem suites. [Copyright &y& Elsevier]

This paper proposes a multi-level multi-energy management framework for the coordinated and interactive operation of heterogeneous multi-microgrids (MMGs) based on many-criteria optimality. With the proposed framework, the highly nonlinear and complex MMG multi-energy management (MMGMEM) problem is formulated into tri-level scheduling subproblems with multi-energy couplings and multi-level interactions, in which the multi-energy trading with energy networks and multi-energy couplings within MGs are optimized in the upper and middle level, and a middle level is added to correct scheduling decisions of the upper level for coordinating the MMG multi-energy sharing. Then, a multi-step matrix decomposition technique is developed to decompose the high dimensional multi-energy coupling matrix of MMGs into the sum of three linear and sparse submatrices for improving the computation efficiency and scalability. Furthermore, a many-criteria decision making (MCDM) model is proposed for the multi-energy sharing problem to achieve an optimum tradeoff in which all microgrids (MGs) can benefit from electricity-gas exchanges, and an evolutionary many-objective optimization based on hyperplane transformation algorithm is used to solve the MCDM problem. Simulation results verify that the proposed framework can achieve a cost saving for each MG (over 19%), and validate its scalability in solving large-scale MMGMEM problems. • A tri-level interactive framework is proposed for the coordinated operation of MMGs. • An extended multi-energy coupling matrix with MMG interactions is formulated. • A multi-step matrix decomposition technique is used to reduce the problem complexity. • A many-criteria optimality model is proposed for the tradeoff of all MGs' benefits. • The utilization of renewables can be enhanced with the minimal total operation cost. [ABSTRACT FROM AUTHOR]

Recently, decomposition has gained a wide interest in solving multi-objective optimization problems involving more than three objectives also known as Many-objective Optimization Problems (MaOPs). In the last few years, there have been many proposals to use decomposition to solve unconstrained problems. However, fewer is the amount of works that has been devoted to propose new decomposition-based algorithms to solve constrained many-objective problems. In this paper, we propose the ISC-Pareto dominance (Isolated Solution-based Constrained Pareto dominance) relation that has the ability to: (1) handle constrained many-objective problems characterized by different types of difficulties and (2) favor the selection of not only infeasible solutions associated to isolated sub-regions but also infeasible solutions with smaller CV (Constraint Violation) values. Our constraint handling strategy has been integrated into the framework of the Constrained Non-Dominated Sorting Genetic Algorithm-III (C-NSGA-III) to produce a new algorithm called Isolated Solution-based Constrained NSGA-III (ISC-NSGA-III). The empirical results have demonstrated that our constraint handling strategy is able to provide better and competitive results when compared against three recently proposed constrained decomposition-based many-objective evolutionary algorithms in addition to a penalty-based version of NSGA-III on the CDTLZ benchmark problems involving up to fifteen objectives. Moreover, the efficacy of ISC-NSGA-III on a real world water management problem is showcased. [ABSTRACT FROM AUTHOR]

Abstract: This paper reviews recent developments in evolutionary algorithms and visualization in the context of multiobjective spatial decision making. A synthetic perspective is employed to bridge these two areas and to create a unified conceptual framework that can be used to address a broad range of multiobjective spatial decision problems. In this framework, evolutionary algorithms are employed to generate optimal, or near-optimal, solutions to a problem being addressed. Alternatives created are then displayed in an interactive visual support system that can be used by decision makers to discover the competing nature of multiple objectives and to gain knowledge about the tradeoffs among alternatives. [Copyright &y& Elsevier]

In practical applications, solving multimodal multiobjective optimization problems (MMOPs), which have multiple Pareto optimal sets (PSs) in the decision space mapping to the same Pareto front (PF) in the objective space, has great significance for decision makers. The issue of how to maintain diversity in both decision space and objective space remains a key problem for existing multimodal multiobjective evolutionary algorithms. To address this issue, a novel grey prediction evolution algorithm for multimodal multiobjective optimization, termed MMGPE, is proposed in this paper. This is the first time that the grey prediction evolution algorithm (GPE), which is a recently proposed competitive optimization algorithm with strong exploration capability, is improved for MMOPs. These improvements are conducted in the following four aspects: (1) an initialization operator based on particle swarm optimization, (2) an adaptive parameter setting strategy depending on the domain of decision variables of MMOPs, (3) an accelerating convergence mechanism inspired by the niche principle, and (4) an environmental selection operator based on a nondominated sorting mechanism and a special crowding distance approach. The performance of MMGPE is compared with two state-of-the-art multiobjective evolutionary algorithms and four multimodal multiobjective evolutionary algorithms on 11 multimodal multiobjective test functions. MMGPE is also applied to solve a practical problem. The results show the MMGPE's effectiveness and superiority in achieving the goal of finding multiple PSs while obtaining a well-distributed PF. [ABSTRACT FROM AUTHOR]