1. ANALYSIS OF THE BFGS METHOD WITH ERRORS.
- Author
-
YUCHEN XIE, BYRD, RICHARD H., and NOCEDAL, JORGE
- Subjects
- *
QUASI-Newton methods , *CONVEX functions , *ALGORITHMS - Abstract
The classical convergence analysis of quasi-Newton methods assumes that function and gradient evaluations are exact. In this paper, we consider the case when there are (bounded) errors in both computations and establish conditions under which a slight modification of the BFGS algorithm with an Armijo–Wolfe line search converges to a neighborhood of the solution that is determined by the size of the errors. One of our results is an extension of the analysis presented in [R. H. Byrd and J. Nocedal, SIAM J. Numer. Anal., 26 (1989), pp. 727–739], which establishes that, for strongly convex functions, a fraction of the BFGS iterates are good iterates. We present numerical results illustrating the performance of the new BFGS method in the presence of noise. [ABSTRACT FROM AUTHOR]
- Published
- 2020
- Full Text
- View/download PDF