Back to Search Start Over

MSFA: Multi‐stage feature aggregation network for multi‐label image recognition.

Authors :
Chen, Jiale
Xu, Feng
Zeng, Tao
Li, Xin
Chen, Shangjing
Yu, Jie
Source :
IET Image Processing (Wiley-Blackwell). May2024, Vol. 18 Issue 7, p1862-1877. 16p.
Publication Year :
2024

Abstract

Multi‐label image recognition (MLR) is a significant branch of image classification that aims to assign multiple categorical labels to each input. Previous research has focused on enhancing the learning of category‐related regional features. However, the potential impact of multi‐scale distributions in intra‐ and inter‐category targets on MLR tends to be neglected. Besides, semantic consistency for categories is restricted to be considered on single‐scale features, resulting in suboptimal feature extraction. To address the limitations of above, a Multi‐stage Feature Aggregation (MSFA) network is proposed. In MSFA, a novel local feature extraction method is suggested to progressively extract category‐related high‐resolution local features in both spatial and channel dimensions. Subsequently, local and global features are fused without additional up‐ and down‐sampling to enrich the scale diversity of the features while incorporating refined class‐specific information. Furthermore, a hierarchical prediction scheme for MLR is proposed, which generates classification confidence corresponding to different scales under hierarchical loss supervision. Consequently, the final output of the network comes from the joint prediction by the classifiers on multi‐scale features, ensuring a stronger feature extraction capability. The extensive experiments have been carried on VOC and MS‐COCO datasets, and the superiority of MSFA over existing mainstream methods has been verified. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
17519659
Volume :
18
Issue :
7
Database :
Academic Search Index
Journal :
IET Image Processing (Wiley-Blackwell)
Publication Type :
Academic Journal
Accession number :
177190340
Full Text :
https://doi.org/10.1049/ipr2.13068