Back to Search Start Over

Adaptive Multi-layer Contrastive Graph Neural Networks.

Authors :
Shi, Shuhao
Xie, Pengfei
Luo, Xu
Qiao, Kai
Wang, Linyuan
Chen, Jian
Yan, Bin
Source :
Neural Processing Letters; Aug2023, Vol. 55 Issue 4, p4757-4776, 20p
Publication Year :
2023

Abstract

Inspired by recent success of graph contrastive learning methods, we propose a self-supervised learning framework for Graph Neural Networks (GNNs) named Adaptive Multi-layer Contrastive Graph Neural Networks (AMC-GNN). Specifically, AMC-GNN generates different graph views through data augmentation and compares the output embeddings at different layers of graph neural network encoders to obtain feature representations for downstream tasks. Meanwhile, AMC-GNN learns the importance weights of embeddings at different layers adaptively through the attention mechanism, and an auxiliary encoder is adopted to train graph contrastive encoders better. The accuracy is improved by maximizing the representation's consistency of positive pairs in the intermediate layers and the final embedding space. Experiments on node classification and link prediction demonstrate that the AMC-GNN framework outperforms state-of-the-art contrastive learning methods and even sometimes outperforms supervised methods. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
13704621
Volume :
55
Issue :
4
Database :
Complementary Index
Journal :
Neural Processing Letters
Publication Type :
Academic Journal
Accession number :
169327826
Full Text :
https://doi.org/10.1007/s11063-022-11064-5