1. Jacobian norm with Selective Input Gradient Regularization for interpretable adversarial defense.
- Author
-
Liu, Deyin, Wu, Lin Yuanbo, Li, Bo, Boussaid, Farid, Bennamoun, Mohammed, Xie, Xianghua, and Liang, Chengwu
- Subjects
- *
ARTIFICIAL neural networks , *DEEP learning , *DATA scrubbing - Abstract
Deep neural networks (DNNs) can be easily deceived by imperceptible alterations known as adversarial examples. These examples can lead to misclassification, posing a significant threat to the reliability of deep learning systems in real-world applications. Adversarial training (AT) is a popular technique used to enhance robustness by training models on a combination of corrupted and clean data. However, existing AT-based methods often struggle to handle transferred adversarial examples that can fool multiple defense models, thereby falling short of meeting the generalization requirements for real-world scenarios. Furthermore, AT typically fails to provide interpretable predictions, which are crucial for domain experts seeking to understand the behavior of DNNs. To overcome these challenges, we present a novel approach called Jacobian norm and Selective Input Gradient Regularization (J-SIGR). Our method leverages Jacobian normalization to improve robustness and introduces regularization of perturbation-based saliency maps, enabling interpretable predictions. By adopting J-SIGR, we achieve enhanced defense capabilities and promote high interpretability of DNNs. We evaluate the effectiveness of J-SIGR across various architectures by subjecting it to powerful adversarial attacks. Our experimental evaluations provide compelling evidence of the efficacy of J-SIGR against transferred adversarial attacks, while preserving interpretability. The project code can be found at https://github.com/Lywu-github/jJ-SIGR.git. • An approach based on Jacobian norm and selective input gradient regularization. • The proposed approach can improve robustness and interpretability of DNNs. • Insights to reveal the relationship between Jacobian norm and linear robustness. • Experiments are conducted on a variety of attacks to prove the effectiveness. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF