Search

Abstract This paper develops a novel algorithm to solve real-world constrained optimization problems, which hybridizes multiobjective optimization techniques with an ϵ-constrained method. First, a constrained optimization problem at hand is transformed into a bi-objective optimization problem. By the transformation, the advantage of multiobjective optimization techniques can be utilized in the constrained optimization area to balance population diversity and convergence. Meanwhile, the ϵ-constrained method is applied, which keeps the population evolving toward feasible region of the constrained optimization problem. In our proposed algorithm, the differential evolution is employed as a search engine to create offspring at each generation. Further, different combinations of mutation operators have been developed to improve the search ability and the population convergence at different stages. The performance of our approach is evaluated on 64 benchmark test functions from three popular test suits. Experimental results demonstrate that our proposed approach is capable of obtaining high-quality solutions on the majority of benchmark test functions, when compared with some other state-of-the-art constrained optimization algorithms. [ABSTRACT FROM AUTHOR]

“ Fuzzy Theoretic Approach to Signals and Systems ” assumes all system variables and parameters as uncertain (i.e. being characterized by membership functions), develops a mathematical theory for analytically determining the membership functions on system variables and parameters, derives algorithms for estimating the parameters of membership functions, and establishes robustness and convergence properties of the estimation algorithms. The membership functions are analytically determined via solving a variational optimization problem that maximizes the “ over-uncertainties-averaged-log-membership ” of the observed data around an initial guess. This paper develops the analytical fuzzy theory for the particular case of a multi-input single-output static system affected by noises. The theory facilitates designing an adaptive filtering algorithm. The robustness of the adaptive filtering algorithm is proved theoretically via a mathematical analysis. Numerical experiments further demonstrate the robustness of the filtering algorithm. A comparison of the algorithm with the state-of-art methods is made using the practical biomedical applications related to the modeling and analysis of heart rate signals for assessing the physiological state of an individual. [ABSTRACT FROM AUTHOR]

Purpose – To improve the performance of the krill herd (KH) algorithm, in this paper, a series of chaotic particle-swarm krill herd (CPKH) algorithms are proposed for solving optimization tasks within limited time requirements. The paper aims to discuss these issues. Design/methodology/approach – In CPKH, chaos sequence is introduced into the KH algorithm so as to further enhance its global search ability. Findings – This new method can accelerate the global convergence speed while preserving the strong robustness of the basic KH. Originality/value – Here, 32 different benchmarks and a gear train design problem are applied to tune the three main movements of the krill in CPKH method. It has been demonstrated that, in most cases, CPKH with an appropriate chaotic map performs superiorly to, or at least highly competitively with, the standard KH and other population-based optimization methods. [ABSTRACT FROM AUTHOR]

Abstract: Most real world multi-objective problems (MOPs) have a complicated solution space. Facing such problems, a direction vectors based co-evolutionary multi-objective optimization algorithm (DVCMOA) that introduces the decomposition idea from MOEA/D to co-evolutionary algorithms is proposed in this paper. It is novel in the sense that DVCMOA applies the concept of direction vectors to co-evolutionary algorithms. DVCMOA first divides the entire population into several subpopulations on the basis of the initial direction vectors in the objective space. Then, it solves MOPs through the co-evolutionary interaction among the subpopulations in which individuals are classified according to their direction vectors. Finally, it explores the less developed regions to maintain the relatively uniform distribution of the solution space. In this way, DVCMOA has advantages in convergence, diversity and uniform distribution of the non-dominated solution set, which are explained through comparison with other state-of-the-art multi-objective optimization evolutionary algorithms (MOEAs) in this paper. DVCMOA is shown to be effective on 6 multi-objective 0–1 knapsack problems. [Copyright &y& Elsevier]

Abstract: The research on optimal design of infinite-impulse response (IIR) filters based on optimization techniques has gained much attention in recent years. However, due to the limited performance of the applied optimization techniques, the orders of the filters, which can be obtained, are very low in the previous research. Memetic algorithms (MAs) are widely recognized to have better convergence capability than their conventional counterparts. However, the universality of the MAs, e.g. the ability of solving diverse kinds of digital IIR filter designs, is still limited. In this paper, we design a Two-Stage ensemble Memetic Algorithm (TSMA) framework to more appropriately synthesize the strengths of the evolutionary global search and local search techniques. In the first optimization stage, a competition is held among the candidate local search techniques. Its major idea is to choose the best local search technique and to obtain good initial state. Inheriting the good information of the first stage, the second optimization stage is to implement effective adaptive MA to pursue high-quality solution. The experimental studies presented in this paper contain three aspects: (1) the benefits of the TSMA framework are experimentally investigated by comparing TSMA with its sub-optimizers and recent effective evolutionary algorithms (EAs) on 26 test functions; then (2) TSMA is compared with 4 MAs on the CEC05 functions to comprehensively show the advantages of TSMA; and (3) the TSMA and 6 state-of-the-art algorithms are applied to design high-order digital infinite-impulse response (IIR) filters. The experimental results definitely demonstrate the excellent effectiveness, efficiency and reliability of TSMA on both function optimization and digital IIR filter design tasks. [Copyright &y& Elsevier]

Recently, several convergence rate results for Douglas-Rachford splitting and the alternating direction method of multipliers (ADMM) have been presented in the literature. In this paper, we show global linear convergence rate bounds for Douglas-Rachford splitting and ADMM under strong convexity and smoothness assumptions. We further show that the rate bounds are tight for the class of problems under consideration for all feasible algorithm parameters. For problems that satisfy the assumptions, we show how to select step-size and metric for the algorithm that optimize the derived convergence rate bounds. For problems with a similar structure that do not satisfy the assumptions, we present heuristic step-size and metric selection methods. [ABSTRACT FROM PUBLISHER]

Abstract: Motivated by the recent success of diverse approaches based on differential evolution (DE) to solve constrained numerical optimization problems, in this paper, the performance of this novel evolutionary algorithm is evaluated. Three experiments are designed to study the behavior of different DE variants on a set of benchmark problems by using different performance measures proposed in the specialized literature. The first experiment analyzes the behavior of four DE variants in 24 test functions considering dimensionality and the type of constraints of the problem. The second experiment presents a more in-depth analysis on two DE variants by varying two parameters (the scale factor F and the population size NP), which control the convergence of the algorithm. From the results obtained, a simple but competitive combination of two DE variants is proposed and compared against state-of-the-art DE-based algorithms for constrained optimization in the third experiment. The study in this paper shows (1) important information about the behavior of DE in constrained search spaces and (2) the role of this knowledge in the correct combination of variants, based on their capabilities, to generate simple but competitive approaches. [ABSTRACT FROM AUTHOR]

Abstract: This paper presents an analysis of an adaptive random search (ARS) algorithm, a global minimization method. A probability model is introduced to characterize the statistical properties of the number of iterations required to find an acceptable solution. Moreover, based on this probability model, a new stopping criterion is introduced to predict the maximum number of iterations required to find an acceptable solution with a pre-specified level of confidence. Finally, this paper presents a systematic procedure for choosing the user-specified parameters in the ARS algorithm for fastest convergence. The results, which are valid for search spaces of arbitrary dimensions, are illustrated on a simple three-dimensional example. [Copyright &y& Elsevier]

Recently, krill herd algorithm (KHA) is proposed for the solution of global optimization problem. Various chaotic maps are considered in the proposed chaotic KHA (CKHA) of the present work to improve the performance of basic KHA method. It is observed that Logistic map based CKHA offers better results as compared other chaotic maps. The performance of the proposed CKHA is tested on standard 26-bus and IEEE 57-bus test power systems for the solution of optimal power flow of power system with different objectives that reflect minimization of fuel cost or active power loss or sum of total voltage deviation. Results obtained by using CKHA are compared to other evolutionary optimization techniques surfaced in the recent state-of-the-art literature. The results presented in this paper show that the proposed CKHA algorithm outperforms the other techniques in terms of convergence rate and global search ability. [ABSTRACT FROM AUTHOR]

Nonnegative matrix factorization (NMF) has recently become a very popular unsupervised learning method because of its representational properties of factors and simple multiplicative update algorithms for solving the NMF. However, for the common NMF approach of minimizing the Euclidean distance between approximate and true values, the convergence of multiplicative update algorithms has not been well resolved. This paper first discusses the convergence of existing multiplicative update algorithms. We then propose a new multiplicative update algorithm for minimizing the Euclidean distance between approximate and true values. Based on the optimization principle and the auxiliary function method, we prove that our new algorithm not only converges to a stationary point, but also does faster than existing ones. To verify our theoretical results, the experiments on three data sets have been conducted by comparing our proposed algorithm with other existing methods. [ABSTRACT FROM AUTHOR]

Abstract: Recently, Gandomi and Alavi proposed a meta-heuristic optimization algorithm, called Krill Herd (KH). This paper introduces the chaos theory into the KH optimization process with the aim of accelerating its global convergence speed. Various chaotic maps are considered in the proposed chaotic KH (CKH) method to adjust the three main movements of the krill in the optimization process. Several test problems are utilized to evaluate the performance of CKH. The results show that the performance of CKH, with an appropriate chaotic map, is better than or comparable with the KH and other robust optimization approaches. [Copyright &y& Elsevier]

Abstract: This paper presents a new technique for designing IIR filters that have minimum deviation from equiripple response. The algorithm is also able to find transfer functions with unequal numerator and denominator orders, which are suitable for both digital and analog IIR sampled-data realizations. Elliptic filters are produced as a particular case, when equal numerator and denominator orders are specified. Pole-zero mapping is used for scalar update of optimization parameters, thereby reducing the algorithm complexity. Zeros are structurally allocated on the unit circumference for efficient stopband shaping. Moreover, filter stability is easily enforced by restricting the radii of the poles to be lower than 1. A Taylor series expansion is employed to determine the step size of the parameter updates. The proposed approach is based on evaluations of partial cost functions to avoid local minima, and hence increase the robustness and the convergence rate of the optimization process. Design examples are shown to illustrate the efficacy of the proposed design technique, compared to alternative design techniques. [Copyright &y& Elsevier]

Abstract: Load balancers distribute workload across multiple nodes based on a variation of the round robin algorithm, or a more complex algorithm that optimizes a specified objective or allows for horizontal scalability and higher availability. In this paper, we investigate whether robust load balancing can be achieved using a local co-operative mechanism between the resources (nodes). The local aspect of the mechanism implies that each node interacts with a small subset of the nodes that define its neighborhood. The co-operative aspect of the mechanism implies that a node may offload some of load to its neighbor nodes that have lesser load or accept jobs from neighbor nodes that have higher load. Each node is thus only aware of the state of its neighboring nodes and there is no central entity that has the knowledge of the state of all the nodes. We model the overall mechanism of load balancing based on local interactions as a congestion game and show that convergence to the Nash equilibrium is possible using only local interactions. We derive worst case bounds on the number of transfers (time) required to achieve global load balancing under this setup. We also include simulation results to demonstrate emergent global load balancing based only on local interactions and local information. [Copyright &y& Elsevier]

Abstract: In this paper, a ship lock scheduling problem is investigated. Ships arrive randomly over time, and the instantaneous arrival rates are allowed to vary both temporally and stochastically in an arbitrary manner. A data-driven approach is applied to a single ship lock scheduling, which is a typical optimizing and decision-making problem. The objective is to minimize the operation costs and other costs(e.g. water cost, electricity cost, and staff welfare cost) by selecting an appropriate slot number during a planned period. The convergence of data-driven approach is discussed from three aspects: the convergence of ant colony optimization algorithm, the convergence of the proposed algorithm, and the error between the historical ship data and the current arrival ship data. The research findings are beneficial for the convergence analysis of data-driven theory and the management of waterway transportation. [Copyright &y& Elsevier]

Abstract: Motivated by concepts in quantum mechanics and particle swarm optimization (PSO), quantum-behaved particle swarm optimization (QPSO) was proposed as a variant of PSO with better global search ability. Although it has been shown to perform well in finding optimal solutions for many optimization problems, there has so far been little theoretical analysis on its convergence and performance. This paper presents a convergence analysis and performance evaluation of the QPSO algorithm and it also proposes two variants of the QPSO algorithm. First, we investigate in detail the convergence of the QPSO algorithm on a probabilistic metric space and prove that the QPSO algorithm is a form of contraction mapping and can converge to the global optimum. This is the first time that the theory of probabilistic metric spaces has been employed to analyze a stochastic optimization algorithm. We provided a new definition for the convergence rate of a stochastic algorithm as well as definitions for three types of convergence according to the correlations between the convergence rate and the objective function values. With these definitions, the effectiveness of the QPSO is evaluated by computing and analyzing the time complexity and the convergence rate of the algorithm. Then, the QPSO with random mean best position (QPSO-RM) and the QPSO with ranking operator (QPSO-RO) are proposed as two improvements of the QPSO algorithm. Finally, some empirical studies on popular benchmark functions are performed in order to make a full performance evaluation and comparison between QPSO, QPSO-RM, QPSO-RO and other variants of PSO. [Copyright &y& Elsevier]

Abstract: When the Newton–Raphson algorithm or the Fisher scoring algorithm does not work and the EM-type algorithms are not available, the quadratic lower-bound (QLB) algorithm may be a useful optimization tool. However, like all EM-type algorithms, the QLB algorithm may also suffer from slow convergence which can be viewed as the cost for having the ascent property. This paper proposes a novel ‘shrinkage parameter’ approach to accelerate the QLB algorithm while maintaining its simplicity and stability (i.e., monotonic increase in log-likelihood). The strategy is first to construct a class of quadratic surrogate functions that induces a class of QLB algorithms indexed by a ‘shrinkage parameter’ () and then to optimize over under some criterion of convergence. For three commonly used criteria (i.e., the smallest eigenvalue, the trace and the determinant), we derive a uniformly optimal shrinkage parameter and find an optimal QLB algorithm. Some theoretical justifications are also presented. Next, we generalize the optimal QLB algorithm to problems with penalizing function and then investigate the associated properties of convergence. The optimal QLB algorithm is applied to fit a logistic regression model and a Cox proportional hazards model. Two real datasets are analyzed to illustrate the proposed methods. [Copyright &y& Elsevier]

Abstract: In evolutionary multi-objective optimization (EMO), the convergence to the Pareto set of a multi-objective optimization problem (MOP) and the diversity of the final approximation of the Pareto front are two important issues. In the existing definitions and analyses of convergence in multi-objective evolutionary algorithms (MOEAs), convergence with probability is easily obtained because diversity is not considered. However, diversity cannot be guaranteed. By combining the convergence with diversity, this paper presents a new definition for the finite representation of a Pareto set, the B-Pareto set, and a convergence metric for MOEAs. Based on a new archive-updating strategy, the convergence of one such MOEA to the B-Pareto sets of MOPs is proved. Numerical results show that the obtained B-Pareto front is uniformly distributed along the Pareto front when, according to the new definition of convergence, the algorithm is convergent. [Copyright &y& Elsevier]

Abstract: An adaptation of a parametric ant colony optimization (ACO) to multi-objective optimization (MOO) is presented in this paper. In this algorithm (here onwards called MACO) the concept of MOO is achieved using the reference point (or goal vector) optimization strategy by applying scalarization. This method translates the multi-objective optimization problem to a single objective optimization problem. The ranking is done using ϵ-dominance with modified L p metric strategy. The minimization of the maximum distance from the goal vector drives the solution close to the goal vector. A few validation test cases with multi-objectives have been demonstrated. MACO was found to out perform R-NSGA-II for the test cases considered. This algorithm was then integrated with a meshless computational fluid dynamics (CFD) solver to perform aerodynamic shape optimization of an airfoil. The algorithm was successful in reaching the optimum solutions near to the goal vector on one hand. On the other hand the algorithm converged to an optimum outside the boundary specified by the user for the control variables. These make MACO a good contender for multi-objective shape optimization problems. [Copyright &y& Elsevier]

This paper deals with a method for the approximation of a spectral density function among the solutions of a generalized moment problem à la Byrnes/Georgiou/Lindquist. The approximation is pursued with respect to the Kullback–Leibler pseudo-distance, which gives rise to a convex optimization problem. After developing the variational analysis, we discuss the properties of an efficient algorithm for the solution of the corresponding dual problem, based on the iteration of a nonlinear map in a bounded subset of the dual space. Our main result is the proof of local convergence of the latter, established as a consequence of the central manifold theorem. Supported by numerical evidence, we conjecture that, in the mentioned bounded set, the convergence is actually global. [ABSTRACT FROM AUTHOR]

Higher order sliding mode (HOSM) control design is considered for systems with a known permanent relative degree. In this paper, we introduce the Robust Fuller's Problem that is a robust generalization of the Fuller's problem, a standard optimal control problem for a chain of integrators with bounded control. By solving the Robust Fuller's Problem it is possible to obtain feed. back laws that are HOSM algorithms of generic order and, in addition, provide optimal finite-time reaching of the sliding manifold. A common difficulty in the use of existing HOSM algorithms is the tuning of design parameters: our methodology proves useful for the tuning of HOSM controller parameters in order to assure desired performances and prevent instabilities. The convergence and stability properties of the proposed family of controllers are theoretically analyzed. Simulation evidence demonstrates their effectiveness. [ABSTRACT FROM AUTHOR]

Abstract-This paper studies state quantization schemes for feedback stabilization of control systems with limited information. The focus is on designing the least destabilizing quantizer subject to a given information constraint. We explore several ways of mea- suring the destabilizing effect of a quantizer on the closed-loop system, including (but not limited to) the worst-case quantization error. In each case, we show how quantizer design can be naturally reduced to a version of the so-called multicenter problem from locational optimization. Algorithms for obtaining solutions to such problems, all in terms of suitable Voronoi quantizers, are discussed. In particular, an iterative solver is developed for a novel weighted multicenter problem which most accurately represents the least destabilizing quantizer design. A simulation study is also presented. [ABSTRACT FROM AUTHOR]

A hybrid evolutionary programming (EP) method is presented for global optimization of complex circuits. The conventional EP is integrated with a clustering algorithm to improve the robustness of the algorithm for complex multimodal circuit optimization problems. The EP generates populations around the regions of the search space which can potentially contain a minimum but may be overlooked. The clustering algorithm is used to identify these regions dynamically. In order to improve the speed of optimization, the EP is combined with a gradient-based search method in an efficient fashion. The local search is performed from the center of each identified cluster in order to find the minimum in the region very fast. The hybrid algorithm can also reduce the search space by avoiding the search in the areas that were previously investigated. This feature greatly improves the speed of optimization and prevents the premature convergence as well. The algorithm performed very well in several benchmark problems including a test function minimization and global optimization of a complex RF diplexer circuit. [ABSTRACT FROM AUTHOR]