Semantic Supplementary Network With Prior Information for Multi-Label Image Classification.

The multi-label image classification problem is one of the most important problems in the field of computer vision, which needs to predict and output all the labels in an image. Multiple labels to be classified in an image increases the difficulty of image classification, and multi-label image classification usually requires additional attention to the positions of the object with different scales and poses. Hence, how to use the dependency relationship between labels to improve the recognition accuracy is an important problem when the object is difficult to directly identify. In this paper, we propose a designed network called the Semantic Supplementary Network with Prior Information (SSNP) to address this problem. The proposed SSNP first generates prior information by using a prior information network with different convolutional layers. Then the semantic supplementary module generates semantic information of the potential labels that is highly relevant to the current information based on the prior information, thereby effectively using the dependency relationship between the labels to improve the classification accuracy. Different from existing methods which pay more attention to the image feature extraction process, we focus on the impact of high-level semantic information generated after feature extraction on the results and tap the potential of high-level semantic information through a semantic supplementary module to strengthen the potential dependence between labels. Experimental results on public benchmark datasets demonstrate that the proposed architecture achieves the state-of-the-art performance, especially when predicting some semantically dependent labels. [ABSTRACT FROM AUTHOR]