Back to Search
Start Over
Anti-Bandit for Neural Architecture Search.
- Source :
-
International Journal of Computer Vision . Oct2023, Vol. 131 Issue 10, p2682-2698. 17p. - Publication Year :
- 2023
-
Abstract
- Neural Architecture Search (NAS) is a highly challenging task that requires consideration of search space, search efficiency, and adversarial robustness of the network. In this paper, to accelerate the training speed, we reformulate NAS as a multi-armed bandit problem and present Anti-Bandit NAS (ABanditNAS) method, which exploits Upper Confidence Bounds (UCB) to abandon arms for search efficiency and Lower Confidence Bounds (LCB) for fair competition between arms. Based on the presented ABanditNAS, the adversarially robust optimization and architecture search can be solved in a unified framework. Specifically, our proposed framework defends against adversarial attacks based on a comprehensive search of denoising blocks, weight-free operations, Gabor filters, and convolutions. The theoretical analysis on the rationality of the two confidence bounds in ABanditNAS are provided and extensive experiments on three benchmarks are conducted. The results demonstrate that the presented ABanditNAS achieves competitive accuracy at a reduced search cost compared to prior methods. [ABSTRACT FROM AUTHOR]
- Subjects :
- *GABOR filters
*ROBUST optimization
Subjects
Details
- Language :
- English
- ISSN :
- 09205691
- Volume :
- 131
- Issue :
- 10
- Database :
- Academic Search Index
- Journal :
- International Journal of Computer Vision
- Publication Type :
- Academic Journal
- Accession number :
- 170028640
- Full Text :
- https://doi.org/10.1007/s11263-023-01826-6