1. Semisupervised Feature Selection via Generalized Uncorrelated Constraint and Manifold Embedding
- Author
-
Yunxing Zhang, Rui Zhang, and Xuelong Li
- Subjects
Computer Science::Machine Learning ,Computer Networks and Communications ,Computer science ,Supervised learning ,Feature selection ,Ridge (differential geometry) ,Scale factor ,Computer Science Applications ,Constraint (information theory) ,Statistics::Machine Learning ,ComputingMethodologies_PATTERNRECOGNITION ,Artificial Intelligence ,Embedding ,Gradient descent ,Algorithm ,Software ,Subspace topology - Abstract
Ridge regression is frequently utilized by both supervised learning and semisupervised learning. However, the results cannot obtain the closed-form solution and perform manifold structure when ridge regression is directly applied to semisupervised learning. To address this issue, we propose a novel semisupervised feature selection method under generalized uncorrelated constraint, namely SFS. The generalized uncorrelated constraint equips the framework with the elegant closed-form solution and is introduced to the ridge regression with embedding the manifold structure. The manifold structure and closed-form solution can better save data's topology information compared to the deep network with gradient descent. Furthermore, the full rank constraint of the projection matrix also avoids the occurrence of excessive row sparsity. The scale factor of the constraint that can be adaptively obtained also provides the subspace constraint more flexibility. Experimental results on data sets validate the superiority of our method to the state-of-the-art semisupervised feature selection methods.
- Published
- 2022