1. Error bound of critical points and KL property of exponent 1/2 for squared F-norm regularized factorization
- Author
-
Ting Tao, Shujun Bi, and Shaohua Pan
- Subjects
FOS: Computer and information sciences ,Hessian matrix ,Computer Science - Machine Learning ,Control and Optimization ,Rank (linear algebra) ,Applied Mathematics ,Machine Learning (stat.ML) ,Function (mathematics) ,Management Science and Operations Research ,Least squares ,Machine Learning (cs.LG) ,Computer Science Applications ,symbols.namesake ,Matrix (mathematics) ,Factorization ,Optimization and Control (math.OC) ,Statistics - Machine Learning ,Norm (mathematics) ,FOS: Mathematics ,symbols ,Applied mathematics ,Mathematics - Optimization and Control ,Condition number ,Mathematics - Abstract
This paper is concerned with the squared F(robenius)-norm regularized factorization form for noisy low-rank matrix recovery problems. Under a suitable assumption on the restricted condition number of the Hessian matrix of the loss function, we establish an error bound to the true matrix for the non-strict critical points with rank not more than that of the true matrix. Then, for the squared F-norm regularized factorized least squares loss function, we establish its KL property of exponent 1/2 on the global optimal solution set under the noisy and full sample setting, and achieve this property at its certain class of critical points under the noisy and partial sample setting. These theoretical findings are also confirmed by solving the squared F-norm regularized factorization problem with an accelerated alternating minimization method.
- Published
- 2021
- Full Text
- View/download PDF