Back to Search
Start Over
Where to Look and How to Describe: Fashion Image Retrieval with an Attentional Heterogeneous Bilinear Network
- Publication Year :
- 2020
- Publisher :
- arXiv, 2020.
-
Abstract
- Fashion products typically feature in compositions of a variety of styles at different clothing parts. In order to distinguish images of different fashion products, we need to extract both appearance (i.e., "how to describe") and localization (i.e.,"where to look") information, and their interactions. To this end, we propose a biologically inspired framework for image-based fashion product retrieval, which mimics the hypothesized twostream visual processing system of human brain. The proposed attentional heterogeneous bilinear network (AHBN) consists of two branches: a deep CNN branch to extract fine-grained appearance attributes and a fully convolutional branch to extract landmark localization information. A joint channel-wise attention mechanism is further applied to the extracted heterogeneous features to focus on important channels, followed by a compact bilinear pooling layer to model the interaction of the two streams. Our proposed framework achieves satisfactory performance on three image-based fashion product retrieval benchmarks.<br />Comment: 11 pages, 8 figures
- Subjects :
- FOS: Computer and information sciences
Landmark
Computer science
business.industry
Computer Vision and Pattern Recognition (cs.CV)
Feature extraction
Computer Science - Computer Vision and Pattern Recognition
Bilinear interpolation
Pattern recognition
02 engineering and technology
Visualization
Visual processing
Feature (computer vision)
0202 electrical engineering, electronic engineering, information engineering
Media Technology
020201 artificial intelligence & image processing
Artificial intelligence
Electrical and Electronic Engineering
Focus (optics)
business
Image retrieval
Subjects
Details
- Database :
- OpenAIRE
- Accession number :
- edsair.doi.dedup.....8500ad2d67a790eab751344f819b40a4
- Full Text :
- https://doi.org/10.48550/arxiv.2010.13357