Search

In this paper, we present a novel dimensionality reduction term (i.e. TripletPCA and ContrastivePCA) designed to enhance the robustness of pair-based loss functions in metric learning against image corruptions. Notably, our approach achieves this without the need for any data preprocessing steps. Our method can be seamlessly integrated into existing models, such as a block with Plug & Play framework. To the best of our knowledge, our TripletPCA and ContrastivePCA represent the first attempts to incorporate dimensionality reduction directly into pair-based metric learning losses for end-to-end metric learning. By projecting image features into low-dimensional vectors, our proposed loss functions effectively retain the essential components of images while mitigating the impact of corrupted features. Consequently, our metric learning loss function accurately computes feature distances through the projection. Experimental results demonstrate that our dimensionality reduction term can be easily incorporated into various types of existing deep neural networks. This integration leads to a substantial improvement in performance on standard benchmark datasets for corrupted image classification tasks. On several corruption datasets, we achieve an average performance improvement of 10.55% compared to existing baseline methods. Our code is available at https://github.com/Juryun/TDRL. [ABSTRACT FROM AUTHOR]

Spiking neural networks (SNNs) have garnered significant attention due to their ultra-high-speed and ultra-low-power operation, rendering them suitable for a range of energy-efficient applications. However, their performance in image generation is relatively mediocre, resulting in a lack of an effective generative replay mechanism to handle sequential probabilistic representations of multiple datasets. Consequently, this limitation often leads to catastrophic forgetting. This paper introduces a novel SNN lifelong learning framework namely Dynamic Lifelong learning with Spiking Generative Networks (DL-SGN), aimed at providing better generation ability while mitigating the problem of catastrophic forgetting in a continual learning scenario. DL-SGN comprises three key components: dynamic experts, a student, and an assistant. The dynamic expert is implemented as a dynamically expanding mixture model, with a proposed network expansion mechanism Dynamic Knowledge Adversarial Fusion (DKAF) facilitating the automatic handling of an increasing number of tasks. the student module adopts an SNN-based Variational Autoencoder (VAE) and classifier, leveraging accumulated knowledge from each expert. To enhance the student's ability to generalize to images, we introduce a discriminator as an assistant module trained using adversarial training. We validate the effectiveness of the proposed by conducting experiments on image generation and classification in a lifelong learning environment, and the results substantiate the effectiveness of DL-SGN. • The DL-SGN framework is proposed to addresses catastrophic forgetting in SNNs. • Our model is based on multiple dynamic experts and adversarial training. • Develop a dynamic knowledge adversarial fusion to expand expert module's capacity. • Employ an assistant module to enhance the student module's generalization ability. [ABSTRACT FROM AUTHOR]

Domain adaptation provides the possibility of utilizing the knowledge gained from an auxiliary domain to accomplish the task in another related domain. In this paper, a common feature representation of these domains is learned through a new proposed idea to reduce inter-domain differences more precisely which results in higher accuracy for unsupervised domain adaptation. To decrease these divergences, the proposed method finds a subspace that reduces data distribution discrepancy between domains. To achieve this goal, minimization of the divergence of the class conditional probability distributions is considered. By considering class conditional distributions, more discriminative information of data is preserved compared to applying marginal distributions. Also, an explicit parametric distribution of the source and target domains is considered to reduce the discrepancy between the two domains data which results in higher accuracy compared to the other relevant domain adaptation methods. Experimental studies on benchmark image classification tasks confirmed our assumptions and indicated the significant improvement given by the proposed method compared to the other state-of-the-art methods. • Aligning the feature distribution of the source and target domains explicitly. • Introducing a new loss function to impose the common distribution on the features. • Reducing the class conditional probability distribution distance between the domains. [ABSTRACT FROM AUTHOR]