1. Probabilistic embeddings revisited.
- Author
-
Karpukhin, Ivan, Dereka, Stanislav, and Kolesnikov, Sergey
- Subjects
- *
DEEP learning , *ERROR probability , *IMAGE retrieval , *SCIENTIFIC community , *DATA quality , *PRIOR learning - Abstract
In recent years, deep metric learning and its probabilistic extensions claimed state-of-the-art results in the face verification task. Despite improvements in face verification, probabilistic methods received little attention in the research community and practical applications. Previous metric learning benchmarks avoided comparison with probabilistic methods, and it is still unclear whether they generalize well to image retrieval tasks beyond faces. In this paper, we, for the first time, perform an in-depth analysis and unified comparison of known probabilistic methods in verification and retrieval tasks. We study different design choices and argue that many of them have limited impact, while only a few probabilistic methods surpass modern metric learning approaches. Combining the best ideas of earlier works, we propose a simple modification of the top-performing method, achieving new state-of-the-art results among probabilistic methods. Finally, we study confidence prediction and show that it correlates with data quality, but contains little information about prediction error probability. We thus provide a new confidence evaluation benchmark and establish a baseline for future confidence prediction research. PyTorch implementation is publicly released. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF