Search

Given a closed convex set A in a Banach space X, motivated by the continuity and Fréchet differentiability of A introduced, respectively, in [D. Gale and V. Klee, Math. Scand., 7 (1959), pp. 379-391] and [X. Y. Zheng, SIAM J. Optim., 30 (2020), pp. 490-512], this paper considers the Cp-differentiability, subdifferentiability, and G\^ateaux differentiability of A. Using the technique of variational analysis, it is proved that A is Cp-differentiable (resp., subdifferentiable or G\^ateaux differentiable) if and only if for every continuous convex function f : X → R with infx∈A f(x) > infx∈X f(x) the corresponding constrained optimization problem PA(f) is 2/p-order-well-posed solvable (resp., generalized well-posed solvable or weak well-posed solvable). It is also proved that if the conjugate function f* of a continuous convex function f on X is Cp-differentiable on dom(f*), then for every closed convex set A in X with infx∈A f(x) > -∞ the corresponding optimization problem PA(f) is 2/p-order-well-posed solvable. As a byproduct, every constrained convex optimization problem with a strongly convex quadratic objective function is proved to be globally second-order-well-posed solvable. Our main results are new even in the case of finite dimensional spaces. [ABSTRACT FROM AUTHOR]

In [V. Guigues, SIAM J. Optim., 30 (2020), pp. 407-438], an inexact variant of stochastic dual dynamic programming (SDDP) called ISDDP was introduced which uses approximate (instead of exact with SDDP) primal dual solutions of the problems solved in the forward and backward passes of the method. That variant of SDDP was studied in [V. Guigues, SIAM J. Optim., 30 (2020), pp. 407-438] for linear and for differentiable nonlinear multistage stochastic programs (MSPs). In this paper, we extend ISDDP to nondifferentiable MSPs. We first provide formulas for inexact cuts for value functions of convex nondifferentiable optimization problems. We then combine these cuts with SDDP to describe ISDDP for nondifferentiable MSPs and analyze the convergence of the method. More precisely, for a problem with T stages, we show that for errors bounded from ab ove by\varepsilon, the limit superior and limit inferior of sequences of upper and lower bounds on the optimal value of the problem are at most at distance 3\varepsilonT to the optimal value and that for asymptotically vanishing errors ISDDP converges to an optimal policy. Finally, we present the results of encouraging numerical experiments on a multistage nondifferentiable stochastic convex program solved using exact SDDP and the proposed ISDDP. [ABSTRACT FROM AUTHOR]

The classical convergence analysis of quasi-Newton methods assumes that function and gradient evaluations are exact. In this paper, we consider the case when there are (bounded) errors in both computations and establish conditions under which a slight modification of the BFGS algorithm with an Armijo–Wolfe line search converges to a neighborhood of the solution that is determined by the size of the errors. One of our results is an extension of the analysis presented in [R. H. Byrd and J. Nocedal, SIAM J. Numer. Anal., 26 (1989), pp. 727–739], which establishes that, for strongly convex functions, a fraction of the BFGS iterates are good iterates. We present numerical results illustrating the performance of the new BFGS method in the presence of noise. [ABSTRACT FROM AUTHOR]

We consider a variable metric and inexact version of the fast iterative soft-thresholding algorithm (FISTA) type algorithm considered in [L. Calatroni and A. Chambolle, SIAM J. Optim., 29 (2019), pp. 1772-1798; A. Chambolle and T. Pock, Acta Numer., 25 (2016), pp. 161-319] for the minimization of the sum of two (possibly strongly) convex functions. The proposed algorithm is combined with an adaptive (nonmonotone) backtracking strategy, which allows for the adjustment of the algorithmic step-size along the iterations in order to improve the convergence speed. We prove a linear convergence result for the function values, which depends on both the strong convexity moduli of the two functions and the upper and lower bounds on the spectrum of the variable metric operators. We validate the proposed algorithm, named Scaled Adaptive GEneralized FISTA (SAGE-FISTA), on exemplar image denoising and deblurring problems where edge-preserving total variation (TV) regularization is combined with Kullback-Leibler-type fidelity terms, as is common in applications where signal-dependent Poisson noise is assumed in the data. [ABSTRACT FROM AUTHOR]

For an inequality system defined by an infinite family of proper lower semicontinuous convex functions in normed linear space, we consider the Farkas--Minkowski (FM for short) type qualification and the basic constraint qualification (BCQ for short). By employing a new approach based on some new results established here on the SECQ (sum of epigraphs constraint qualification) for families of closed convex sets, some sufficient conditions involving further relaxing Slater type conditions for ensuring the FM qualification are provided. As applications, new sufficient conditions for ensuring the BCQ are given. These results significantly improve the corresponding ones in [C. Li and K. F. Ng, SIAM J. Optim., 15 (2005), pp. 488-512] and [C. Li, X. P. Zhao, and Y. H. Hu, SIAM J. Optim., 23 (2013), pp. 2208-2230], and they are obtained without the key continuity assumption on the sup-function of the inequality system which the previous works depend heavily on. Some examples are also presented to illustrate the applicability of our results. [ABSTRACT FROM AUTHOR]