Back to Search
Start Over
CONDITIONAL GRADIENT METHODS FOR CONVEX OPTIMIZATION WITH GENERAL AFFINE AND NONLINEAR CONSTRAINTS.
- Source :
-
SIAM Journal on Optimization . 2021, Vol. 31 Issue 3, p2307-2339. 33p. - Publication Year :
- 2021
-
Abstract
- Conditional gradient methods have attracted much attention in both machine learning and optimization communities recently. These simple methods can guarantee the generation of sparse solutions. In addition, without the computation of full gradients, they can handle huge-scale problems sometimes even with an exponentially increasing number of decision variables. This paper aims to significantly expand the application areas of these methods by presenting new conditional gradient methods for solving convex optimization problems with general affine and nonlinear constraints. More specifically, we first present a new constraint extrapolated condition gradient (Co-exCG) method that can achieve an O(l/e2) iteration complexity for both smooth and structured nonsmooth function constrained convex optimization. We further develop novel variants of CoexCG, namely constraint extrapolated and dual regularized conditional gradient (CoexDurCG) methods, that can achieve similar iteration complexity to CoexCG but allow adaptive selection for algorithmic parameters. We illustrate the effectiveness of these methods for solving an important class of radiation therapy treatment planning problems arising from the healthcare industry. To the best of our knowledge, all the algorithmic schemes and their complexity results are new in the area of projection-free methods. [ABSTRACT FROM AUTHOR]
- Subjects :
- *NONSMOOTH optimization
*RADIOTHERAPY treatment planning
*CONVEX functions
Subjects
Details
- Language :
- English
- ISSN :
- 10526234
- Volume :
- 31
- Issue :
- 3
- Database :
- Academic Search Index
- Journal :
- SIAM Journal on Optimization
- Publication Type :
- Academic Journal
- Accession number :
- 153117972
- Full Text :
- https://doi.org/10.1137/20M1352788