Back to Search Start Over

Transductive semantic knowledge graph propagation for zero-shot learning.

Authors :
Zhang, Hai-gang
Que, Hao-yi
Ren, Jin
Wu, Zheng-guang
Source :
Journal of the Franklin Institute. Nov2023, Vol. 360 Issue 17, p13108-13125. 18p.
Publication Year :
2023

Abstract

The domain shift is a very common phenomenon in Zero-shot Learning (ZSL), because the data distribution between the source and target domain might not match well in real scenarios. This paper focuses on dealing with the domain drift problem in ZSL based on the semantic knowledge graph propagation. Our method consists of visual feature extraction (VFE) module, semantic feature extraction module (SFE) and feature mapping module (FM). In VFE module, the high-level visual features are extracted under Convolutional Neural Network (CNN) framework, where unseen samples participate in model training and stay away from seen ones under the premise of distinguishability. SFE module relies on the Graph Convolutional Network (GCN) framework and focuses on the transmission of semantic embeddings. A modified message aggregation and transformation strategy is proposed to effectively relieve the information smoothing phenomenon caused by the increase of GCN layers. In the recognition stage, AutoEncoder framework achieves a two-way visual and semantic interaction to further minimize the domain drift phenomenon. Simulation results on ImageNet dataset have demonstrated the performance of the proposed method. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
00160032
Volume :
360
Issue :
17
Database :
Academic Search Index
Journal :
Journal of the Franklin Institute
Publication Type :
Periodical
Accession number :
173563606
Full Text :
https://doi.org/10.1016/j.jfranklin.2023.07.009