1. Active learning for image retrieval via visual similarity metrics and semantic features.
- Author
-
Casado-Coscolla, Alvaro, Sanchez-Belenguer, Carlos, Wolfart, Erik, Angorrilla-Bustamante, Carlos, and Sequeira, Vitor
- Subjects
- *
CONTENT-based image retrieval , *IMAGE retrieval , *VIDEO surveillance , *CLASSIFICATION , *CAMERAS - Abstract
We introduce an active learning framework for content-based image retrieval for video surveillance that can be trained ad-hoc for a single camera in a matter of minutes. This technique allows searching for both, known and unknown objects, given a region of interest. The process does not require prior labelled data and treats image retrieval as a binary classification task, in which frames can be similar or different from a query image. The technique is compatible with any pre-trained deep feature extractor. In addition, we propose a novel label propagation algorithm that benefits from (1) visual similarity of image pairs and (2) the semantic representation of the feature vectors from a pre-trained deep feature extractor. This approach allows to reduce the amount of labels needed, while avoiding the propagation of errors. Our experiments with three use-cases from a nuclear facility show the validity of the proposed method, which achieves high precision and recall while requiring minimal amounts of labelled data. [Display omitted] • Present a relevant video frame retrieval pipeline that can be trained interactively. • Propose an active learning algorithm that leverages visual and semantic similarity. • Visual similarity makes label propagation less prone to introducing errors. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF