Back to Search Start Over

SATCount: A scale-aware transformer-based class-agnostic counting framework.

Authors :
Wang, Yutian
Yang, Bin
Wang, Xi
Liang, Chao
Chen, Jun
Source :
Neural Networks. Apr2024, Vol. 172, pN.PAG-N.PAG. 1p.
Publication Year :
2024

Abstract

This paper studies the class-agnostic counting problem, which aims to count objects regardless of their class, and relies only on a limited number of exemplar objects. Existing methods usually extract visual features from query and exemplar images, compute similarity between them using convolution operations, and finally use this information to estimate object counts. However, these approaches often overlook the scale information of the exemplar objects, leading to lower counting accuracy for objects with multi-scale characteristics. Additionally, convolution operations are local linear matching processes that may result in a loss of semantic information, which can limit the performance of the counting algorithm. To address these issues, we devise a new scale-aware transformer-based feature fusion module that integrates visual and scale information of exemplar objects and models similarity between samples and queries using cross-attention. Finally, we propose an object counting algorithm based on a feature extraction backbone, a feature fusion module and a density map regression head, called SATCount. Our experiments on the FSC-147 and the CARPK demonstrate that our model outperforms the state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Subjects

Subjects :
*COUNTING
*FEATURE extraction

Details

Language :
English
ISSN :
08936080
Volume :
172
Database :
Academic Search Index
Journal :
Neural Networks
Publication Type :
Academic Journal
Accession number :
175643431
Full Text :
https://doi.org/10.1016/j.neunet.2024.106126