Back to Search Start Over

HybridPrompt: Domain-Aware Prompting for Cross-Domain Few-Shot Learning.

Authors :
Wu, Jiamin
Zhang, Tianzhu
Zhang, Yongdong
Source :
International Journal of Computer Vision. Jun2024, p1-17.
Publication Year :
2024

Abstract

Cross-Domain Few-Shot Learning (CD-FSL) aims at recognizing unseen classes from target domains that vastly differ from training classes from source domains, utilizing only a few labeled samples. However, the substantial domain disparities between target and source domains pose huge challenges to few-shot generalization. To resolve domain disparities, we propose HybridPrompt, a novel architecture for <italic>Domain-Aware Prompting</italic> that integrates a variety of cross-domain learned prompts as knowledge experts for CD-FSL. The proposed method enjoys several merits. First, to encode knowledge from diverse source domains, several <italic>Domain Prompts</italic> are introduced to capture domain-specific knowledge. Subsequently, to facilitate the cross-domain transfer of valuable knowledge, a <italic>Transferred Prompt</italic> is specifically tailored for each target task by retrieving highly relevant Domain Prompts based on domain properties. Finally, to complement insufficient transferred information, an <italic>Adaptive Prompt</italic> is learned to incorporate additional target characteristics for model adaptation. Consequently, the collaboration of these three types of prompts contributes to a hybridly prompted model that achieves domain-aware encoding, transfer, and adaptation, thereby enhancing adaptability on unseen domains. Extensive experimental results on the Meta-Dataset benchmark demonstrate that our method achieves superior performance against state-of-the-art methods. The source code is available at https://github.com/Jamine-W/HybridPrompt. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
09205691
Database :
Academic Search Index
Journal :
International Journal of Computer Vision
Publication Type :
Academic Journal
Accession number :
178042395
Full Text :
https://doi.org/10.1007/s11263-024-02086-8