1. Flexible Adaptive Graph Embedding for Semi-supervised Dimension Reduction.
- Author
-
Nie, Hebing, Wu, Qun, Zhao, Haifeng, Ding, Weiping, and Deveci, Muhammet
- Subjects
- *
CONSTRAINED optimization , *FEATURE extraction , *MACHINE learning , *PROBLEM solving - Abstract
Graph-based semi-supervised dimension reduction can use the inherent graph structure of samples to propagate label information, and has become a hot research field in machine learning. However, most current methods have strict linear constraints and cannot handle data sampled from nonlinear manifolds; and rely on predefined graphs, which cannot capture the local structure information of data and cannot handle complex non-Gaussian data. To address these issues, this paper proposes a new locality-preserved flexible dimension reduction framework, called Semi-supervised Flexible Adaptive Graph Embedding (SFAG), which learns the embedding space that can preserve the local neighborhood structure by constructing a k 1 -nearest neighbor graph over labeled samples. Then, another k 2 -nearest neighbor graph is constructed on all samples to adaptively construct the optimal graph, clustering labeled and unlabeled embedding sample points with neighborhood relations into the same sub-manifold sharing the same label information. Last but not least, the hard linear projection constraint is relaxed by adding residual terms to obtain not only the nonlinear embedding of the training samples, but also the linear projection matrix applied directly to the out-of-sample. In addition, two different semi-supervised dimension reduction methods for adaptive construction of optimal graphs are proposed based on the SFAG framework. Several evaluation experiments validate the effectiveness of our method in exploring manifold structures and classification tasks. • A novel semi-supervised adaptive flexible dimension reduction method is proposed. • The local and global structure of the data is explored by constructing kNN graphs. • The hard linear constraints on the projection are relaxed by adding a residual term. • An algorithm is designed to solve the norm-constrained problem of feature extraction. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF