Back to Search Start Over

A Negative Sample-Free Graph Contrastive Learning Algorithm

Authors :
Dongming Chen
Mingshuo Nie
Zhen Wang
Huilin Chen
Dongqi Wang
Source :
Mathematics, Vol 12, Iss 10, p 1581 (2024)
Publication Year :
2024
Publisher :
MDPI AG, 2024.

Abstract

Self-supervised learning is a new machine learning method that does not rely on manually labeled data, and learns from rich unlabeled data itself by designing agent tasks using the input data as supervision to obtain a more generalized representation for application in downstream tasks. However, the current self-supervised learning suffers from the problem of relying on the selection and number of negative samples and the problem of sample bias phenomenon after graph data augmentation. In this paper, we investigate the above problems and propose a corresponding solution, proposing a graph contrastive learning algorithm without negative samples. The model uses matrix sketching in the implicit space for feature augmentation to reduce sample bias and iteratively trains the mutual correlation matrix of two viewpoints by drawing closer to the distance of the constant matrix as the objective function. This method does not require techniques such as negative samples, gradient stopping, and momentum updating to prevent self-supervised model collapse. This method is compared with 10 graph representation learning algorithms on four datasets for node classification tasks, and the experimental results show that the algorithm proposed in this paper achieves good results.

Details

Language :
English
ISSN :
22277390
Volume :
12
Issue :
10
Database :
Directory of Open Access Journals
Journal :
Mathematics
Publication Type :
Academic Journal
Accession number :
edsdoj.0829dc2a75d4f7eb99b1354ba063ff8
Document Type :
article
Full Text :
https://doi.org/10.3390/math12101581