Search

• We focus on the challenging Incremental Few-Shot Object Detection (iFSD) problem and propose a feature transfer module to transfer the learned information from base features to the novel ones. • We propose a dual-stream network to transfer the knowledge learned from the base class to the novel class from the two levels of weight and network structure. • Extensive experiments are conducted on the challenging PASCAL VOC and MS COCO dataset under iFSD setting, demonstrating the effectiveness of our method. • The proposed method outperforms the existing methods. As a challenging problem in machine learning, incremental few-shot object detection (iFSD) [1] aims to incrementally detect novel classes with few examples, while keeping the previous knowledge without revisiting base classes. Here, we propose two models based on the observation that when new memories come, new connections will be created between memory cells in the brain [2]. The first one, which is called the multi-class head (MCH) model, simulates how humans add new memory-connections that every time novel classes come, a classification branch is added to predict novel classification. And the second model, called the bi-path multi-class head (BPMCH) model, adds a new backbone, which is initialized with the weight of the base class backbone, to transfer more knowledge of the base class to the novel class. Considering accuracy and speed, we choose the Fully Convolutional One-Stage Object Detection (FCOS) [3] + Adaptive Training Sample Selection (ATSS) [4] detector as our baseline. Our models are first trained on the base classes with abundant examples and then finetuned on novel classes with few examples, which not only maintain the knowledge learned from the base class but also transfer the knowledge to the novel class. Extensive experiments show that our models outperform the state-of-the-art model ONCE [1] on the COCO [5] and PASCAL VOC [6] by a large margin. [ABSTRACT FROM AUTHOR]