Search

Abstract: In this paper, we present a new symmetric rank-one (SR1) method for the solution of unconstrained optimization problems. The proposed method involves an algorithm in which the usual SR1 Hessian is updated a number of times in a way to be specified in some iterations, to improve the performance of the Hessian approximation. In particular, we discuss how to consider a criterion for indicating at each iteration whether it is necessary to employ extra updates. However it is well known that there are some theoretical difficulties when applying the SR1 update. Even for a current positive definite Hessian approximation, it is possible that the SR1 update may not be defined or the SR1 update may not preserve positive definiteness at some iterations. We then employ a restarting procedure that guarantees that updated matrices will be well-defined while preserving positive definiteness of updates. Numerical results support these theoretical considerations. They show that the implementation of the SR1 method using extra updating techniques improves the performance of the SR1 method substantially for a number of test problems from the literature. [Copyright &y& Elsevier]

Abstract: Many real problems can be modeled to the problems with a hierarchical structure, and bilevel programming is a useful tool to solve the hierarchical optimization problems. So the bilevel programming is widely applied, and numerous methods have been proposed to solve this programming. In this paper, we propose an approximate programming algorithm to solve bilevel nonlinear programming problem. Finally, the example illustrates the feasibility of the proposed algorithm. [Copyright &y& Elsevier]

Abstract: In this paper, a novel learning strategy for radial basis function networks (RBFN) is proposed. By adjusting the parameters of the hidden layer, including the RBF centers and widths, the weights of the output layer are adapted by local optimization methods. A new local optimization algorithm based on a combination of the gradient and Newton methods is introduced. The efficiency of some local optimization methods to update the weights of RBFN is studied in solving systems of nonlinear integral equations. [Copyright &y& Elsevier]

Abstract: In this paper we consider a conic trust-region method for unconstrained optimization problems and analyze its convergence properties. We propose a convenient curvilinear search method to approximately solve the arising conic trust-region subproblem. Note that this approximate method preserves the strong convergence properties of the exact solution methods and is easy to implement. Both the linear and superlinear convergence of the method are established under commonly used conditions. Numerical experiments are conducted to show the efficiency of the new method. [Copyright &y& Elsevier]

Abstract: In this paper, a numerical research on the sensitivity of nonmonotone trust region algorithms to their parameters is presented. We compare the numerical efficiency of two classes of nonmonotone trust region (NTR) algorithms in the context of unconstrained optimization. We examine the sensitivity of the algorithms to the parameters related to the nonmonotone technique and the initial trust region radius. We show that the numerical efficiency of nonmonotone trust region algorithms can be improved by choosing appropriate parameters. Based on extensive numerical tests, some efficient ranges of these parameters for nonmonotone trust region algorithms are recommended. [Copyright &y& Elsevier]