Back to Search Start Over

Attention-enabled adaptive Markov graph convolution.

Authors :
Wang, Tianfeng
Pan, Zhisong
Hu, Guyu
Hu, Yahao
Source :
Neural Computing & Applications. Mar2024, Vol. 36 Issue 9, p4979-4993. 15p.
Publication Year :
2024

Abstract

GNNs (Graph Neural Networks) have attracted increasing attention for their strong power on dealing with the graph structures. However, it remains a challenge to design an ideal GNN suitable for various downstream tasks. By revisiting the framework of MPNN (Message Passing Neural Network), we argue that an ideal GNN should satisfy following two conditions. First, the node embedding can absorb the knowledge from a wide range of neighbors while maintaining locality. Second, the first-order information aggregation can adapt to unknown graphs. In this paper, we first extend S 2 GC to GMGC (Generalized Markov Graph Convolution), which can maintain the node locality regardless the type of the embedded diffusion kernel. Next, we embed the improved self-gating mechanism into the GMGC framework and propose a novel model named AMGC (Attention-enabled Adaptive Markov Graph Convolution), which well satisfies the above conditions. Moreover, the advantages of AMGC can be explained in the frequency domain. First, the frequency of the first-order diffusion kernel is adaptive and no longer limited to low-pass as S 2 GC . Second, the multi-order diffusion kernel can retain more components around the core frequency compared with FAGCN. To verify the ability of AMGC, extensive experiments are conducted, including graph regression, graph classification and semi-supervised node classification. The results show that AMGC can achieve comparable performance in all graph tasks. [ABSTRACT FROM AUTHOR]

Subjects

Subjects :
*CLASSIFICATION
*ATTENTION

Details

Language :
English
ISSN :
09410643
Volume :
36
Issue :
9
Database :
Academic Search Index
Journal :
Neural Computing & Applications
Publication Type :
Academic Journal
Accession number :
175529911
Full Text :
https://doi.org/10.1007/s00521-023-09338-7