Search

This paper addresses the problem of minimization of a nonsmooth function under general nonsmooth constraints when no derivatives of the objective or constraint functions are available. We introduce the mesh adaptive direct search (MADS) class of algorithms which extends the generalized pattern search (GPS) class by allowing local exploration, called polling, in an asymptotically dense set of directions in the space of optimization variables. This means that under certain hypotheses, including a weak constraint qualification due to Rockafellar, MADS can treat constraints by the extreme barrier approach of setting the objective to infinity for infeasible points and treating the problem as unconstrained. The main GPS convergence result is to identify limit points x0302;, where the Clarke generalized derivatives are nonnegative in a finite set of directions, called refining directions. Although in the unconstrained case, nonnegative combinations of these directions span the whole space, the fact that there can only be finitely many GPS refining directions limits rigorous justification of the barrier approach to finitely many linear constraints for GPS. The main result of this paper is that the general MADS framework is flexible enough to allow the generation of an asymptotically dense set of refining directions along which the Clarke derivatives are nonnegative. We propose an instance of MADS for which the refining directions are dense in the hypertangent cone at x0302; with probability 1 whenever the iterates associated with the refining directions converge to a single x0302;. The instance of MADS is compared to versions of GPS on some test problems. We also illustrate the limitation of our results with examples. [ABSTRACT FROM AUTHOR]

Abstract: A directed searching optimization algorithm (DSO) is proposed to solve constrained optimization problems in this paper. The proposed algorithm includes two important operations — position updating and genetic mutation. Position updating enables the non-best solution vectors to mimic the best one, which is beneficial to the convergence of the DSO; genetic mutation can increase the diversity of individuals, which is beneficial to preventing the premature convergence of the DSO. In addition, we adopt the penalty function method to balance objective and constraint violations. We can obtain satisfactory solutions for constrained optimization problems by combining the DSO and the penalty function method. Experimental results indicate that the proposed algorithm can be an efficient alternative on solving constrained optimization problems. [Copyright &y& Elsevier]

Abstract: A novel modified differential evolution algorithm (NMDE) is proposed to solve constrained optimization problems in this paper. The NMDE algorithm modifies scale factor and crossover rate using an adaptive strategy. For any solution, if it is at a standstill, its own scale factor and crossover rate will be adjusted in terms of the information of all successful solutions. We can obtain satisfactory feasible solutions for constrained optimization problems by combining the NMDE algorithm and a common penalty function method. Experimental results show that the proposed algorithm can yield better solutions than those reported in the literature for most problems, and it can be an efficient alternative to solving constrained optimization problems. [Copyright &y& Elsevier]

This paper proposes an adaptive penalty function for solving constrained optimization problems using genetic algorithms. The proposed method aims to exploit infeasible individuals with low objective value and low constraint violation. The number of feasible individuals in the population is used to guide the search process either toward finding more feasible individuals or searching for the optimum solution. The proposed method is simple to implement and does not need any parameter tuning. The performance of the algorithm is tested on 22 benchmark functions in the literature. The results show that the proposed approach is able to find very good solutions comparable to the chosen state-of-the-art designs. Furthermore, it is able to find feasible solutions in every run for all of the benchmark functions tested. [ABSTRACT FROM AUTHOR]

In this paper we discuss the polynomiality of a feasible version of Mehrotra's predictor-corrector algorithm whose variants have been widely used in several interior point method (IPM)-based optimization packages. A numerical example is given that shows that the adaptive choice of centering parameter and correction terms in this algorithm may lead to small steps being taken in order to keep the iterates in a large neighborhood of the central path, which is important for proving polynomial complexity properties of this method. Motivated by this example, we introduce a safeguard in Mehrotra's algorithm that keeps the iterates in the prescribed neighborhood and allows us to obtain a positive lower bound on the step size. This safeguard strategy is also used when the affine scaling direction performs poorly. We prove that the safeguarded algorithm will terminate after at most O(n2log(x°}T s° /e) iterations. By modestly modifying the corrector direction, we reduce the iteration complexity to O(nlog(x°}T s° /e). To ensure fast asymptotic convergence of the algorithm, we changed Mehrotra's updating scheme of the centering parameter slightly while keeping the safeguard. The new algorithms have the same order of iteration complexity as the safeguarded algorithms but enjoy superlinear convergence as well. Numerical results using the McIPM and LIPSOL software packages are reported. [ABSTRACT FROM AUTHOR]

In this paper, we conduct three case studies to assess the effectiveness of a recently proposed first-order method for robust nonlinear programming [Zhang, Y.: J. Optim. Theory Appl. 132, 111-124 (2007)]. Three robust nonlinear programming problems were chosen from the literature using the criteria that results calculated using other methods must be available and the problems should be realistic, but fairly simple. Our studies show that the first-order method produced reasonable solutions when the level of uncertainty was small to moderate. In addition, we demonstrate a method for leveraging a theoretical result to eliminate constraint violations. Since the first-order method is relatively inexpensive in comparison to other robust optimization techniques, our studies indicate that, under moderate uncertainty, the first-order approach may be more suitable than other methods for large problems. [ABSTRACT FROM AUTHOR]

Abstract: The aim of this paper is to propose and compare different one-dimensional maps as chaotic search patterns in the constraint nonlinear optimization problems. For this purpose, about 10 one-dimensional maps are introduced that can be used as search pattern in chaos optimization algorithms. We apply these maps in specific optimization algorithm (weighted gradient direction based chaos optimization algorithm) and compare them based on numerical simulation results. [Copyright &y& Elsevier]

Abstract: Many practical problems can be formulated as constrained optimization problems. Due to the simple concept and easy implementation, the penalty function method has been one of the most common techniques to handle constraints. However, the performance of this technique greatly relies on the setting of penalty factors, which are usually determined by manual trial and error, and the suitable penalty factors are often problem-dependent and difficult to set. In this paper, a differential evolution approach based on a co-evolution mechanism, named CDE, is proposed to solve the constrained problems. First, a special penalty function is designed to handle the constraints. Second, a co-evolution model is presented and differential evolution (DE) is employed to perform evolutionary search in spaces of both solutions and penalty factors. Thus, the solutions and penalty factors evolve interactively and self-adaptively, and both the satisfactory solutions and suitable penalty factors can be obtained simultaneously. Simulation results based on several benchmark functions and three well-known constrained design problems as well as comparisons with some existed methods demonstrate the effectiveness, efficiency and robustness of the proposed method. [Copyright &y& Elsevier]

Abstract: In this paper, a kind of nonlinear optimization problems with nonlinear inequality constraints are discussed, and a new SQP feasible descent algorithm for solving the problems is presented. At each iteration of the new algorithm, a convex quadratic program (QP) which always has feasible solution is solved and a master direction is obtained, then, an improved (feasible descent) direction is yielded by updating the master direction with an explicit formula, and in order to avoid the Maratos effect, a height-order correction direction is computed by another explicit formula of the master direction and the improved direction. The new algorithm is proved to be globally convergent and superlinearly convergent under mild conditions without the strict complementarity. Furthermore, the quadratic convergence rate of the algorithm is obtained when the twice derivatives of the objective function and constrained functions are adopted. Finally, some numerical tests are reported. [Copyright &y& Elsevier]

In this paper, a class of deformable contour methods using a constrained optimization approach of minimizing a contour energy function satisfying an interior homogeneity constraint is proposed. The class is defined by any positive potential function describing the contour interior characterization. An evolutionary strategy is used to derive the algorithm. A similarity threshold Tv can be used to determine the interior size and shape of the contour. Sensitivity and significance of Tv and σ (a spreadness measure) are also discussed and shown. Experiments on noisy images and the convergence to a minimum energy gap contour are included. The developed method has been applied to a variety of medical images from CT abdominal section, MRI image slices of brain, brain tumor, a pig heart ultrasound image sequence to visual blood cell images. As the results show, the algorithm can be adapted to a broad range of medical images containing objects with vague, complex and/or irregular shape boundary, inhomogeneous and noisy interior, and contour with small gaps. [ABSTRACT FROM AUTHOR]