1. Advanced Multi-Label Fire Scene Image Classification via BiFormer, Domain-Adversarial Network and GCN.
- Author
-
Bai, Yu, Wang, Dan, Li, Qingliang, Liu, Taihui, and Ji, Yuheng
- Subjects
IMAGE recognition (Computer vision) ,FEATURE extraction ,DATA augmentation ,FLAME ,WILDFIRES - Abstract
Detecting wildfires presents significant challenges due to the presence of various potential targets in fire imagery, such as smoke, vehicles, and people. To address these challenges, we propose a novel multi-label classification model based on BiFormer's feature extraction method, which constructs sparse region-indexing relations and performs feature extraction only in key regions, thereby facilitating more effective capture of flame characteristics. Additionally, we introduce a feature screening method based on a domain-adversarial neural network (DANN) to minimize misclassification by accurately determining feature domains. Furthermore, a feature discrimination method utilizing a Graph Convolutional Network (GCN) is proposed, enabling the model to capture label correlations more effectively and improve performance by constructing a label correlation matrix. This model enhances cross-domain generalization capability and improves recognition performance in fire scenarios. In the experimental phase, we developed a comprehensive dataset by integrating multiple fire-related public datasets, and conducted detailed comparison and ablation experiments. Results from the tenfold cross-validation demonstrate that the proposed model significantly improves recognition of multi-labeled images in fire scenarios. Compared with the baseline model, the mAP increased by 4.426%, CP by 4.14% and CF1 by 7.04%. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF