Back to Search Start Over

ICC++: Explainable feature learning for art history using image compositions.

Authors :
Madhu, Prathmesh
Marquart, Tilman
Kosti, Ronak
Suckow, Dirk
Bell, Peter
Maier, Andreas
Christlein, Vincent
Source :
Pattern Recognition. Apr2023, Vol. 136, pN.PAG-N.PAG. 1p.
Publication Year :
2023

Abstract

• ICC++ is explainable and content-based image retrieval method. • ICC++ is based on compositional patterns for semantic understanding of art historical images. • Introducing Web Gallery of Art 500 (WGA500) dataset - to encourage further research in this domain. • Rigorous evaluations against traditional methods, deep features & SOTA methods. • Our method outperforms SOTA, while has an advantage over deep features in terms of explainability. Image compositions are helpful in the study of image structures and assist in discovering the semantics of the underlying scene portrayed across art forms and styles. With the digitization of artworks in recent years, thousands of images of a particular scene or narrative could potentially be linked together. However, manually linking this data with consistent objectiveness can be a highly challenging and time-consuming task. In this work, we present a novel approach called Image Composition Canvas (ICC + +) to compare and retrieve images having similar compositional elements. ICC + + is an improvement over ICC, specializing in generating low and high-level features (compositional elements) motivated by Max Imdahl's work. To this end, we present a rigorous quantitative and qualitative comparison of our approach with traditional and state-of-the-art (SOTA) methods showing that our proposed method outperforms all of them. In combination with deep features, our method outperforms the best deep learning-based method, opening the research direction for explainable machine learning for digital humanities. We will release the code and the data post-publication. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
00313203
Volume :
136
Database :
Academic Search Index
Journal :
Pattern Recognition
Publication Type :
Academic Journal
Accession number :
161280436
Full Text :
https://doi.org/10.1016/j.patcog.2022.109153