Back to Search Start Over

Quantum probability-inspired graph neural network for document representation and classification.

Authors :
Yan, Peng
Li, Linjing
Jin, Miaotianzi
Zeng, Daniel
Source :
Neurocomputing. Jul2021, Vol. 445, p276-286. 11p.
Publication Year :
2021

Abstract

Recent studies have found that text can be represented in Hilbert space through a neural network driven by quantum probability, which provides a unified representation of texts with different granularities without losing the performance of downstream tasks. However, these quantum probability-inspired methods only focus on intra-document semantics and lack modeling global structural information. In this paper, we explore the potential of combining quantum probability with graph neural network, and propose a quantum probability-inspired graph neural network model to capture global structural information of interaction between documents for document representation and classification. We build a document interaction graph for a given corpus based on document word relation and frequency information, then learn a graph neural network driven by quantum probability on the defined graph. First, the proposed model represents each document node in the graph as a superposition state in a Hilbert space. Then the proposed model further computes density matrix representations for nodes to encode document interaction as mixed states. Finally, the model computes classification probability by performing quantum measurement on the mixed states. Experiments on four document classification benchmarks show that the proposed model outperforms a variety of classical neural network models and the previous quantum probability-inspired model with much smaller parameter size. Extended analyses also demonstrate the robustness of the proposed model with limited training data and its ability to learn semantically distinguishable document representation. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
09252312
Volume :
445
Database :
Academic Search Index
Journal :
Neurocomputing
Publication Type :
Academic Journal
Accession number :
150256865
Full Text :
https://doi.org/10.1016/j.neucom.2021.02.060