Search

In this paper, a random derivative-free modified tensor method with curvilinear linesearch technique is considered for solving nonlinear programming problems. The proposed algorithm is designed to build polynomial interpolation models for the objective function and build the tensor model using the information of the interpolation function. At the same time, we give a new curvilinear tensor step which guarantees the monotonic decrease on the tensor model. The modified tensor step also asymptotically approaches the modified Newton direction as the step length shrinks to zero, and the objective function of problem will be descendent. Under general assumptions, we give the global and local superlinear convergence of the algorithm. Numerical results are recorded, and the compare results with a tensor algorithm without curvilinear linesearch technique and Newton algorithm show that our algorithm is more effectiveness. [ABSTRACT FROM AUTHOR]

In this paper, we propose a single timescale stochastic quasi-Newton method for solving the stochastic optimization problems. The objective function of the problem is a composition of two smooth functions and their derivatives are not available. The algorithm sets to approximate sequences to estimate the gradient of the composite objective function and the inner function. The matrix correction parameters are given in BFGS update form for avoiding the assumption that Hessian matrix of objective is positive definite. We show the global convergence of the algorithm. The algorithm achieves the complexity O (ϵ − 1) to find an ϵ − approximate stationary point and ensure that the expectation of the squared norm of the gradient is smaller than the given accuracy tolerance ϵ. The numerical results of nonconvex binary classification problem using the support vector machine and a multicall classification problem using neural networks are reported to show the effectiveness of the algorithm. [ABSTRACT FROM AUTHOR]

Large-scale symmetric and asymmetric matrices have emerged in predicting the relationship between genes and diseases. The emergence of large-scale matrices increases the computational complexity of the problem. Therefore, using low-rank matrices instead of original symmetric and asymmetric matrices can greatly reduce computational complexity. In this paper, we propose an approximation conjugate gradient method for solving the low-rank matrix recovery problem, i.e., the low-rank matrix is obtained to replace the original symmetric and asymmetric matrices such that the approximation error is the smallest. The conjugate gradient search direction is given through matrix addition and matrix multiplication. The new conjugate gradient update parameter is given by the F-norm of matrix and the trace inner product of matrices. The conjugate gradient generated by the algorithm avoids SVD decomposition. The backtracking linear search is used so that the approximation conjugate gradient direction is computed only once, which ensures that the objective function decreases monotonically. The global convergence and local superlinear convergence of the algorithm are given. The numerical results are reported and show the effectiveness of the algorithm. [ABSTRACT FROM AUTHOR]

In this paper, a derivative-free trust region methods based on probabilistic models with new nonmonotone line search technique is considered for nonlinear programming with linear inequality constraints. The proposed algorithm is designed to build probabilistic polynomial interpolation models for the objective function. We build the affine scaling trust region methods which use probabilistic or random models within a classical trust region framework. The new backtracking linear search technique guarantee the descent of the objective function, and new iterative points are in the feasible region. In order to overcome the strict complementarity hypothesis, under some reasonable conditions which are weaker than strong second order sufficient condition, we give the new and more simple identification function to structure the affine matrix. The global and local fast convergence of the algorithm are shown and the results of numerical experiments are reported to show the effectiveness of the proposed algorithm. [ABSTRACT FROM AUTHOR]

This paper proposes an affine scaling interior trust-region method in association with nonmonotone line search filter technique for solving nonlinear optimization problems subject to linear inequality constraints. Based on a Newton step which is derived from the complementarity conditions of linear inequality constrained optimization, a trust-region subproblem subject only to an ellipsoidal constraint is defined by minimizing a quadratic model with an appropriate quadratic function and scaling matrix. The nonmonotone schemes combining with trust-region strategy and line search filter technique can bring about speeding up the convergence progress in the case of high nonlinear. A new backtracking relevance condition is given which assures global convergence without using the switching condition used in the traditional line search filter technique. The fast local convergence rate of the proposed algorithm is achieved which is not depending on any external restoration procedure. The preliminary numerical experiments are reported to show effectiveness of the proposed algorithm. [ABSTRACT FROM AUTHOR]

Traditional inexact SQP algorithm can only solve equality constrained optimization (Byrd et al. Math. Program. 122, 273-299 2010). In this paper, we propose a new inexact SQP algorithm with affine scaling technique for nonlinear systems of mixed equalities and inequalities, which arise in complementarity and variational inequalities. The nonlinear systems are transformed into a special nonlinear optimization with equality and bound constraints, and then we give a new inexact SQP algorithm for solving it. The new algorithm equipped with affine scaling technique does not require a quadratic programming subproblem with inequality constraints. The search direction is computed by solving one linear system approximately using iterative linear algebra techniques. Under mild assumptions, we discuss the global convergence. The preliminary numerical results show the effectiveness of the proposed algorithm. [ABSTRACT FROM AUTHOR]

This paper proposes and analyzes an affine scaling trust-region method with line search filter technique for solving nonlinear optimization problems subject to bounds on variables. At the current iteration, the trial step is generated by the general trust-region subproblem which is defined by minimizing a quadratic function subject only to an affine scaling ellipsoidal constraint. Both trust-region strategy and line search filter technique will switch to trail backtracking step which is strictly feasible. Meanwhile, the proposed method does not depend on any external restoration procedure used in line search filter technique. A new backtracking relevance condition is given which is weaker than the switching condition to obtain the global convergence of the algorithm. The global convergence and fast local convergence rate of this algorithm are established under reasonable assumptions. Preliminary numerical results are reported indicating the practical viability and show the effectiveness of the proposed algorithm. [ABSTRACT FROM AUTHOR]

In this paper, we introduce an affine scaling cubic regularization algorithm for solving optimization problem without available derivatives subject to bound constraints employing a polynomial interpolation approach to handle the unavailable derivatives of the original objective function. We first define an affine scaling cubic model of the approximate objective function which is obtained by the polynomial interpolation approach with an affine scaling method. At each iteration a candidate search direction is determined by solving the affine scaling cubic regularization subproblem and the new iteration is strictly feasible by way of an interior backtracking technique. The global convergence and local superlinear convergence of the proposed algorithm are established under some mild conditions. Preliminary numerical results are reported to show the effectiveness of the proposed algorithm. [ABSTRACT FROM AUTHOR]

In this paper, we propose a filter sequential adaptive regularization algorithm using cubics (ARC) for solving nonlinear equality constrained optimization. Similar to sequential quadratic programming methods, an ARC subproblem with linearized constraints is considered to obtain a trial step in each iteration. Composite step methods and reduced Hessian methods are employed to tackle the linearized constraints. As a result, a trial step is decomposed into the sum of a normal step and a tangential step which is computed by a standard ARC subproblem. Then, the new iteration is determined by filter methods and ARC framework. The global convergence of the algorithm is proved under some reasonable assumptions. Preliminary numerical experiments and comparison results are reported. [ABSTRACT FROM AUTHOR]

In this paper, we propose a derivative-free restrictively preconditioned conjugate gradient path method without line search technique for solving linear equality constrained optimization. This method originates from the classical conjugate gradient method and its restrictively preconditioned variant. The preconditioned conjugate gradient path is obtained by solving extended system of the preconditioned equation with restrictively preconditioned conjugate gradient method which is a more robust and effective technique to solve large sparse linear system. The global convergence and local superlinear convergence rate of the proposed method are established under some reasonable conditions. Finally, the numerical results are reported to show the effectiveness of the proposed method. [ABSTRACT FROM AUTHOR]

In this article, we propose the Gauss-Newton methods via conjugate gradient path for solving nonlinear systems. By constructing and solving a linearized model of the nonlinear systems, we obtain the iterative direction by employing the conjugate gradient path. In successive iterations, the approximate Jacobian of the nonlinear systems is updated by a Broyden formula to construct the conjugate path. The global convergence and local superlinear convergence rate of the proposed algorithms are established under some reasonable conditions. Finally, the numerical results are reported to show the effectiveness of the proposed algorithms. [ABSTRACT FROM AUTHOR]

In this paper, we propose an inexact-Newton via GMRES (generalized minimal residual) subspace method without line search technique for solving symmetric nonlinear equations. The iterative direction is obtained by solving the Newton equation of the system of nonlinear equations with the GMRES algorithm. The global convergence and local superlinear convergence rate of the proposed algorithm are established under some reasonable conditions. Finally, the numerical results are reported to show the effectiveness of the proposed algorithm. [ABSTRACT FROM AUTHOR]

In this paper, we propose conjugate gradient path method for solving derivative-free unconstrained optimization. The iterative direction is obtained by constructing and solving quadratic interpolation model of the objective function with conjugate gradient methods. The global convergence and local superlinear convergence rate of the proposed algorithm are established under some reasonable conditions. Finally, the numerical results are reported to show the effectiveness of the proposed algorithm. [ABSTRACT FROM AUTHOR]

In this paper, a derivative-free affine scaling inexact Levenberg–Marquardt method with interior backtracking line search technique is considered for solving linear inequality constrained nonlinear systems. The proposed algorithm is designed to take advantage of the problem structure by building polynomial interpolation models for each function of nonlinear systems subject to the linear inequality constraints on variables. Each iterate switches to backtracking step generated by affine scaling inexact Levenberg–Marquardt method and satisfies strict interior point feasibility by line search backtracking technique. Under local error bounded assumption, the method is superlinear and quadratic convergent on F ( x ). The results of numerical experiments are reported to show the effectiveness of the proposed algorithm. [ABSTRACT FROM AUTHOR]

In this article, we propose a three-dimensional dwindling filter algorithm for general nonlinear programming. The envelope of the three-dimensional dwindling filter becomes thinner and thinner as the step size approaches zero so that the new filter has more flexibility for the acceptance of the trial step size. Moreover, we show that the feasibility restoration phase, which is always used in traditional filter method, is not needed. The modified limited memory Broyden-Fletcher-Goldfarb-Shanno method is employed in the algorithm, and the update matrices are positive definite when the Lagrangian function is a general convex function. Under mild conditions, the global convergence of the new algorithm is analyzed. The primary numerical experiments are reported to show effectiveness of the proposed algorithm. [ABSTRACT FROM PUBLISHER]

A trust-region algorithm in association with line search filter technique for solving nonlinear equality constrained programming is proposed in this paper. In the current iteration, the trial step providing sufficient descent is generated by solving a corresponding trust-region subproblem. Then, the step size is decided by backtracking line search together with filter technique to obtain the next iteration point. The advantage of this method is that resolving trust-region subproblem many times to determine a new iteration point in traditional trust-region method can be avoided and hence the expensive computation can be lessened. And the difficult decisions in regard to the choice of penalty parameters in the merit functions can be avoided by using filter technique. Second order correction steps are introduced in the proposed algorithm to overcome Maratos effect. Convergence analysis shows that fast local convergence can be achieved under some mild assumptions. The preliminary numerical results are reported. [ABSTRACT FROM AUTHOR]

In this paper, an affine-scaling derivative-free trust-region method with interior backtracking line search technique is considered for solving nonlinear systems subject to linear inequality constraints. The proposed algorithm is designed to take advantage of the problem structured by building polynomial interpolation models for each function in the nonlinear system functionF. The proposed approach is developed by forming a quadratic model with an appropriate quadratic function and scaling matrix: there is no need to handle the constraints explicitly. By using both trust-region strategy and interior backing line search technique, each iteration switches to backtracking step generated by the trust-region subproblem and satisfies strict interior point feasibility by line search backtracking technique. Under reasonable conditions, the global convergence and fast local convergence rate of the proposed algorithm are established. The results of numerical experiments are reported to show the effectiveness of the proposed algorithms. [ABSTRACT FROM AUTHOR]

In this article, an affine scaling interior trust-region algorithm which employs backtracking line search with filter technique is presented for solving nonlinear equality constrained programming with nonnegative constraints on variables. At current iteration, the general full affine scaling trust-region subproblem is decomposed into a pair of trust-region subproblems in vertical and horizontal subspaces, respectively. The trial step is given by the solutions of the pair of trust-region subproblems. Then, the step size is decided by backtracking line search together with filter technique. This is different from traditional trust-region methods and has the advantage of decreasing the number of times that a trust-region subproblem must be resolved in order to determine a new iteration point. Meanwhile, using filter technique instead of merit function to determine a new iteration point can avoid the difficult decisions regarding the choice of penalty parameters. Under some reasonable assumptions, the new method possesses the property of global convergence to the first-order critical point. Preliminary numerical results show the effectiveness of the proposed algorithm. [ABSTRACT FROM AUTHOR]

This paper presents a trust-region algorithm which employs line search filter technique with Lagrange merit function for solving nonlinear equality constrained programming. At the current iteration, the general full trust-region subproblem is decomposed into a pair of trust-region subproblems in normal and tangential subspaces. The trial step is given by solving these two trust-region subproblems. Then, different from traditional trust-region method in which the next iterate is determined by the ratio of the actual reduction to the predicted reduction, the step size is decided by interior backtracking line search together with filter method. Consequently, the expensive computation raised by resolving trust-region subproblem many times to determine a new iteration point in traditional trust-region method can be reduced. And the difficult decisions in regard to the choice of penalty parameters in the merit functions can be avoided by using filter technique. The new method retains the global convergence to the first-order critical points under some reasonable assumptions without using a merit function. Meanwhile, by using Lagrange function in the filter, the method can overcome Maratos effect without using second order correction step and hence the superlinear local convergence is achieved. The preliminary numerical results are reported to show effectiveness of the proposed algorithm. [ABSTRACT FROM AUTHOR]

Abstract: In this paper, we develop dwindling filter idea and trust region strategy for solving nonlinear optimization. Compared with traditional filter trust region algorithm, the new filter algorithm has more flexibility for the acceptance of the trial step and the feasibility restoration phase is not needed. Under mild conditions, the global convergence of the new algorithm is analyzed. Preliminary numerical results are reported. [Copyright &y& Elsevier]

In this paper, we propose a trust-region algorithm in association with line search filter technique for solving nonlinear equality constrained programming. At current iteration, a trial step is formed as the sum of a normal step and a tangential step which is generated by trust-region subproblem and the step size is decided by interior backtracking line search together with filter methods. Then, the next iteration is determined. This is different from general trust-region methods in which the next iteration is determined by the ratio of the actual reduction to the predicted reduction. The global convergence analysis for this algorithm is presented under some reasonable assumptions and the preliminary numerical results are reported. [ABSTRACT FROM PUBLISHER]

Abstract: We present a new projected affine-scaling interior-point Newton’s method with a line search filter algorithm for nonlinear optimization problems with box constraints. The global convergence of the proposed algorithm is established under some reasonable conditions. Furthermore, the method is shown to be locally quadratically convergent under the strong second order sufficiency condition without assuming strict complementarity of the solution. Numerical experiments are presented that confirm the robustness and efficiency of the approach. [Copyright &y& Elsevier]

The authors propose a dwindling filter algorithm with Zhou's modified subproblem for nonlinear inequality constrained optimization. The feasibility restoration phase, which is always used in the traditional filter method, is not needed. Under mild conditions, global convergence and local superlinear convergence rates are obtained. Numerical results demonstrate that the new algorithm is effective. [ABSTRACT FROM AUTHOR]

Abstract: In this paper, an inexact secant algorithm in association with nonmonotone technique and filter is proposed for solving the large scale nonlinear systems of equalities and inequalities. The systems are transformed into a continuous constrained optimization solved by inexact secant algorithm. Global convergence of the proposed algorithm is established under the reasonable conditions. Numerical results validate the effectiveness of our approach. [Copyright &y& Elsevier]

Abstract: In this paper, we propose a filter algorithm for nonlinear systems of equalities and inequalities. In the algorithm, the systems of nonlinear equalities and inequalities are transformed into a nonlinear programming problem. The new algorithm uses the non-monotone technique in conjunction with filter idea and a global line search strategy that ensures convergence from any starting point. Under mild conditions, global convergence and local superlinear convergence rate are obtained. Numerical results demonstrate that the new algorithm is effective. [Copyright &y& Elsevier]

Abstract: This paper proposes a line search filter reduced Hessian method for nonlinear equality constrained optimization. The feature of the presented algorithm is that the reduced Hessian method is used to produce a search direction, a backtracking line search procedure to generate step size, some filtered rules to determine step acceptance, second order correction technique to reduce infeasibility and overcome the Maratos effects. It is shown that this algorithm does not suffer from the Maratos effects by using second order correction step, and under mild assumptions fast convergence to second order sufficient local solutions is achieved. The numerical experiment is reported to show the effectiveness of the proposed algorithm. [Copyright &y& Elsevier]

In this paper, we propose a non-monotone line search multidimensional filter-SQP method for general nonlinear programming based on the Wächter-Biegler methods for nonlinear equality constrained programming. Under mild conditions, the global convergence of the new method is proved. Furthermore, with the non-monotone technique and second order correction step, it is shown that the proposed method does not suffer from the Maratos effect, so that fast local convergence to second order sufficient local solutions is achieved. Numerical results show that the new approach is efficient. [ABSTRACT FROM AUTHOR]

Abstract: Filter methods were initially designed for nonlinear programming problems by Fletcher and Leyffer. In this paper we propose a secant algorithm with line search filter method for nonlinear equality constrained optimization. The algorithm yields the global convergence under some reasonable conditions. By using the Lagrangian function value in the filter we establish that the proposed algorithm can overcome the Maratos effect without using second order correction step, so that fast local superlinear convergence to second order sufficient local solution is achieved. The primary numerical results are presented to confirm the robustness and efficiency of our approach. [ABSTRACT FROM AUTHOR]

In this paper, we propose a nonmonotone sequential quadratic programming-filter method for solving nonlinear equality constrained optimization. This new method has more flexibility for the acceptance of the trial step and requires less computational costs compared with the monotone methods. Under reasonable conditions, we give the global convergence properties. Further, the second-order correction step and nonmonotone reduction conditions are used to overcome Maratos effect so that quadratic local convergence is achieved. The numerical experiments are reported to show the effectiveness of the proposed algorithm. [ABSTRACT FROM AUTHOR]

We propose and analyze a new affine scaling interior point method in association with line-search filter technique for solving the linear inequality constrained optimization. We extend an existing filter of Wachter and Biegler [9] for nonlinear equality constrained problems to linear inequality constraint problems. The two main ingredients of the method are a filter-line-search algorithm which is used to determine step size and an affine-scaling interior point Newton method which is used to generate a search direction. The global convergence of the proposed algorithm is established under some reasonable conditions. Further, the method is shown to be locally Q-superlinearly convergent under the strong second order sufficiency condition. Numerical tests are presented that confirm the robustness and efficiency of the approach. [ABSTRACT FROM AUTHOR]

Abstract: This paper presents an affine scaling optimal path approach in association with nonmonotonic interior backtracking line search technique for nonlinear optimization subject to linear constraints. We shall employ the eigensystem decomposition and affine scaling mapping to form affine scaling optimal curvilinear path very easily. By using interior backtracking line search technique, each iterate switches to trial step of strict interior feasibility. The nonmonotone criterion is used to speed up the convergence progress in the contours of objective function with large curvature. Theoretical analysis is given which prove that the proposed algorithm is globally convergent and has a local superlinear convergence rate under some reasonable conditions. The results of numerical experiments are reported to show the effectiveness of the proposed algorithm. [Copyright &y& Elsevier]

Abstract: We develop and analyze a new affine scaling Levenberg–Marquardt method with nonmonotonic interior backtracking line search technique for solving bound-constrained semismooth equations under local error bound conditions. The affine scaling Levenberg–Marquardt equation is based on a minimization of the squared Euclidean norm of linear model adding a quadratic affine scaling matrix to find a solution that belongs to the bounded constraints on variable. The global convergence results are developed in a very general setting of computing trial directions by a semismooth Levenberg–Marquardt method where a backtracking line search technique projects trial steps onto the feasible interior set. We establish that close to the solution set the affine scaling interior Levenberg–Marquardt algorithm is shown to converge locally Q-superlinearly depending on the quality of the semismooth and Levenberg–Marquardt parameter under an error bound assumption that is much weaker than the standard nonsingularity condition, that is, BD-regular condition under nonsmooth case. A nonmonotonic criterion should bring about speed up the convergence progress in the contours of objective function with large curvature. [Copyright &y& Elsevier]

Based on a differentiable merit function proposed by Taji et al. in “Math. Prog. Stud., 58, 1993, 369–383”, the authors propose an affine scaling interior trust region strategy via optimal path to modify Newton method for the strictly monotone variational inequality problem subject to linear equality and inequality constraints. By using the eigensystem decomposition and affine scaling mapping, the authors from an affine scaling optimal curvilinear path very easily in order to approximately solve the trust region subproblem. Theoretical analysis is given which shows that the proposed algorithm is globally convergent and has a local quadratic convergence rate under some reasonable conditions. [ABSTRACT FROM AUTHOR]

Abstract: In this paper we propose an affine scaling interior algorithm via Lanczos path for solving nonlinear equality systems subject to bounds on variables. Employing the affine scaling Lanczos path search strategy, we obtain an iterative direction by solving the linearize model. By using the line search backtracking technique, we will find an acceptable trial step length along this direction which is strictly feasible and makes the objective function nonmonotonically decreasing. The global convergence and fast local convergence rate of the proposed algorithm are established under some reasonable conditions. Furthermore, the numerical results of the proposed algorithm indicate to be effective. [Copyright &y& Elsevier]

Abstract: This paper presents an affine scaling reduced preconditional conjugate gradient path approach in association with nonmonotonic interior backtracking line search technique for the linear constrained optimization. Employing the affine scaling preconditional conjugate gradient to form the curvilinear path and using interior backtracking line search technique, each iterate switches to trial step of strict interior feasibility. The nonmonotone criterion is used to speed up the convergence progress in the contours of objective function with large curvature. Theoretical analysis are given which prove that the proposed algorithm is globally convergent and has a local superlinear convergence rate under some reasonable conditions. [Copyright &y& Elsevier]

In this paper, we propose a new trust-region-projected Hessian algorithm with nonmonotonic backtracking interior point technique for linear constrained optimization. By performing the QR decomposition of an affine scaling equality constraint matrix, the conducted subproblem in the algorithm is changed into the general trust-region subproblem defined by minimizing a quadratic function subject only to an ellipsoidal constraint. By using both the trust-region strategy and the line-search technique, each iteration switches to a backtracking interior point step generated by the trustregion subproblem. The global convergence and fast local convergence rates for the proposed algorithm are established under some reasonable assumptions. A nonmonotonic criterion is used to speed up the convergence in some ill-conditioned cases. [ABSTRACT FROM AUTHOR]

Abstract: We develop and analyze an affine scaling inexact generalized Newton algorithm in association with nonmonotone interior backtracking line technique for solving systems of semismooth equations subject to bounds on variables. By combining inexact affine scaling generalized Newton with interior backtracking line search technique, each iterate switches to inexact generalized Newton backtracking step to strict interior point feasibility. The global convergence results are developed in a very general setting of computing trial steps by the affine scaling generalized Newton-like method that is augmented by an interior backtracking line search technique projection onto the feasible set. Under some reasonable conditions we establish that close to a regular solution the inexact generalized Newton method is shown to converge locally p-order q-superlinearly. We characterize the order of local convergence based on convergence behavior of the quality of the approximate subdifferentials and indicate how to choose an inexact forcing sequence which preserves the rapid convergence of the proposed algorithm. A nonmonotonic criterion should bring about speeding up the convergence progress in some ill-conditioned cases. [Copyright &y& Elsevier]

Abstract: In this literature, we extend the classical affine scaling interior trust-region algorithm for smooth bounded-constrained nonlinear programming to the nonsmooth case where the objective function is only locally Lipschitzian. We propose and analyze a new affine scaling trust-region method in association with nonmonotonic interior backtracking line search technique for solving the linear equality constrained LC1 optimization subject to bounds on variables. At each iteration, the trust-region subproblem is defined by minimizing a quadratic function which is required both first- and second-order information of the objective function and a quadratic affine scaling matrix model subject only to an ellipsoidal constraint in a null space of the affine scaling linear equality constraints. The second-order derivative of the objective function is explicitly required to be Lipschitzian. Each iterate switches to a very general setting of computing trial backtracking steps generated by the general trust-region subproblem and then the line search technique projects the trial backtracking steps onto the strictly feasible set of the bounded constraints on variables. The global convergence and fast local convergence rate of the proposed algorithm are established under some reasonable conditions where twice smoothness of the objective function is not required. A nonmonotonic criterion should bring about speeding up the convergence progress in some ill-conditioned cases. Applications of the algorithm to various nonsmooth optimization problems are discussed. [Copyright &y& Elsevier]

Abstract: In this paper, we propose a new affine scaling trust-region algorithm in association with nonmonotonic interior backtracking line search technique for solving nonlinear equality systems subject to bounds on variables. The trust-region subproblem is defined by minimizing a squared Euclidean norm of linear model adding the augmented quadratic affine scaling term subject only to an ellipsoidal constraint. By using both trust-region strategy and interior backtracking line search technique, each iterate switches to backtracking step generated by the general trust-region subproblem and satisfies strict interior point feasibility by line search backtracking technique. The global convergence and fast local convergence rate of the proposed algorithm are established under some reasonable conditions. A nonmonotonic criterion should bring about speeding up the convergence progress in some ill-conditioned cases. The results of numerical experiments are reported to show the effectiveness of the proposed algorithm. [Copyright &y& Elsevier]

Abstract: In this paper we propose a nonmonotonic interior point backtracking strategy to modify the reduced projective affine scaling trust region algorithm for solving minimum optimization subject to both nonlinear equality and linear inequality constraints. The general full trust region subproblem for solving the minimum optimization is decomposed to a pair of trust region subproblems in horizontal and vertical subspaces of linearize equality constraints and extended affine scaling equality constraints by QR decomposition of an affine scaling matrix and an orthonormal basis on the null subspace. The horizontal subproblem in the proposed algorithm is defined by minimizing a quadratic projective reduced Hessian function subject only to an ellipsoidal trust region constraint, while the vertical subproblem is also defined by the least squares subproblem subject only to an ellipsoidal trust region constraint. Combining trust region strategy with line search technique will switch to strictly feasible interior point step generated by a component direction of the two trust region subproblems. By adopting the l 1 penalty function as the merit function, the global convergence and fast local convergence rate of the proposed algorithm are established under some reasonable conditions. The second-order correction step and a nonmonotonic criterion are used to overcome Maratos effect and speed up the convergence progress in some ill-conditioned cases, respectively. [Copyright &y& Elsevier]

A family of inexact quasi-Newton algorithms in association with nonmonotone backtracking line search technique is proposed for solving smooth nonlinear equations. Global convergence of the proposed algorithms are established under the reasonable conditions. We characterize the order of local convergence based on convergence behaviour of the approximate matrix of the Jacobian and indicate how to choose an inexact forcing sequence which preserves the rapid convergence of the proposed algorithms. [Copyright &y& Elsevier]

In this paper, we propose a new nonmonotonic interior point backtracking strategy to modify the reduced projective affine scaling trust region algorithm for solving optimization subject to nonlinear equality and linear inequality constraints. The general full trust region subproblem for solving the nonlinear equality and linear inequality constrained optimization is decomposed to a pair of trust region subproblems in horizontal and vertical subspaces of linearize equality constraints and extended affine scaling equality constraints. The horizontal subproblem in the proposed algorithm is defined by minimizing a quadratic projective reduced Hessian function subject only to an ellipsoidal trust region constraint in a null subspace of the tangential space, while the vertical subproblem is also defined by the least squares subproblem subject only to an ellipsoidal trust region constraint. By introducing the Fletcher''s penalty function as the merit function, trust region strategy with interior point backtracking technique will switch to strictly feasible interior point step generated by a component direction of the two trust region subproblems. The global convergence of the proposed algorithm while maintaining fast local convergence rate of the proposed algorithm are established under some reasonable conditions. A nonmonotonic criterion should bring about speeding up the convergence progress in some high nonlinear function conditioned cases. [Copyright &y& Elsevier]

In this paper we propose a two-piece update of projected Hessian algorithm with trust region method for solving nonlinear equality constrained optimization problems. In order to deal with large scale problems, a two-piece update of two side reduced Hessian is used to replace full Hessian matrix. By adopting the l1 penalty function as the merit function, a nonmonotonic trust region strategy is suggested which does not require the merit function to reduce its value in every iteration. The calculation of a correction step, which is necessary from theoretical point to overcome Maratos effect but sometime brings in negative results in practice, is avoided in most cases by setting a criterion to judge its necessity. The proposed algorithm which switches to nonmonotonic trust region strategy possess global convergence while maintaining one-step Q-superlinear local convergence rates if at least one of the update formula is updated at each iteration. The numerical experiment is reported to show the effectiveness of the proposed algorithms. [Copyright &y& Elsevier]

In this paper we propose a new interior affine scaling region algorithm with nonmonotonic interior point backtracking technique for nonlinear optimization subject to linear equality and inequality constraints. The trust region subproblem in the proposed algorithm is defined by minimizing a quadratic function subject only to an affine scaling ellipsoidal constraint in a null subspace of the extended equality constraints. Using both trust region strategy and line search technique, the affine scaling trust region subproblem at each iteration generates backtracking interior step to obtain a new accepted step. The global convergence and fast local convergence rate of the proposed algorithm are established under some reasonable conditions. A nonmonotonic criterion should bring about speeding up the convergence progress in some ill-conditioned cases. [Copyright &y& Elsevier]

In this paper, we modify the trust region interior point algorithm proposed by Bonnans and Pola in (SIAM J. Optim. 7(3) (1997) 717) for linear constrained optimization. A mixed strategy using both trust region and line-search techniques is adopted which switches to back-tracking steps when a trial step produced by the trust region subproblem may be unacceptable. The global convergence and local convergence rate of the improved algorithm are established under some reasonable conditions. A nonmonotonic criterion is used to speed up the convergence progress in some ill-conditioned cases. The results of numerical experiments are reported to show the effectiveness of the proposed algorithm. [Copyright &y& Elsevier]

In this paper, a derivative-free affine scaling linear programming algorithm based on probabilistic models is considered for solving linear inequality constrainted optimization problems. The proposed algorithm is designed to build probabilistic linear polynomial interpolation models using only n + 1 interpolation points for the objective function and reduce the computation cost for building interpolation function. We build the affine scaling linear programming methods which use probabilistic or random models and affine matrix within a classical linear programming framework. The backtracking line search technique can guarantee monotone descent of the objective function, and by using this technique, the new iterative points are located within the feasible region. Under some reasonable conditions, the global and local fast convergence of the algorithm is shown, and the results of numerical experiments are reported to show the effectiveness of the proposed algorithm. [ABSTRACT FROM AUTHOR]

An adaptive projected affine scaling algorithm of cubic regularization method using a filter technique for solving box constrained optimization without derivatives is put forward in the passage. The affine scaling interior-point cubic model is based on the quadratic probabilistic interpolation approach on the objective function. The new iterations are obtained by the solutions of the projected adaptive cubic regularization algorithm with filter technique. We prove the convergence of the proposed algorithm under some assumptions. Finally, experiments results showed that the presented algorithm is effective in detail. [ABSTRACT FROM AUTHOR]

We present inexact secant methods in association with line search filter technique for solving nonlinear equality constrained optimization. For large-scale applications, it is expensive to get an exact search direction, and hence we use an inexact method that finds an approximate solution satisfying some appropriate conditions. The global convergence of the proposed algorithm is established by using line search filter technique. The second-order correction step is used to overcome the Maratos effect, while the line search filter inexact secant methods have superlinear local convergence rate. Finally, the results of numerical experiments indicate that the proposed methods are efficient for the given test problems. [ABSTRACT FROM AUTHOR]