Back to Search
Start Over
A comprehensive survey of neural architecture search: Challenges and solutions
- Publication Year :
- 2021
- Publisher :
- ASSOC COMPUTING MACHINERY, 2021.
-
Abstract
- Deep learning has made breakthroughs and substantial in many fields due to its powerful automatic representation capabilities. It has been proven that neural architecture design is crucial to the feature representation of data and the final performance. However, the design of the neural architecture heavily relies on the researchers' prior knowledge and experience. And due to the limitations of human' inherent knowledge, it is difficult for people to jump out of their original thinking paradigm and design an optimal model. Therefore, an intuitive idea would be to reduce human intervention as much as possible and let the algorithm automatically design the neural architecture. Neural Architecture Search (NAS) is just such a revolutionary algorithm, and the related research work is complicated and rich. Therefore, a comprehensive and systematic survey on the NAS is essential. Previously related surveys have begun to classify existing work mainly based on the key components of NAS: search space, search strategy, and evaluation strategy. While this classification method is more intuitive, it is difficult for readers to grasp the challenges and the landmark work involved. Therefore, in this survey, we provide a new perspective: beginning with an overview of the characteristics of the earliest NAS algorithms, summarizing the problems in these early NAS algorithms, and then providing solutions for subsequent related research work. Besides, we conduct a detailed and comprehensive analysis, comparison, and summary of these works. Finally, we provide some possible future research directions.<br />Comment: Accepted by ACM Computing Surveys 2021
- Subjects :
- FOS: Computer and information sciences
Computer Science - Machine Learning
Evaluation strategy
General Computer Science
Computer science
Machine Learning (stat.ML)
02 engineering and technology
010501 environmental sciences
01 natural sciences
Theoretical Computer Science
Machine Learning (cs.LG)
Statistics - Machine Learning
0202 electrical engineering, electronic engineering, information engineering
Feature (machine learning)
Architecture
Representation (mathematics)
0105 earth and related environmental sciences
Landmark
business.industry
Deep learning
GRASP
Data science
Key (cryptography)
020201 artificial intelligence & image processing
Artificial intelligence
08 Information and Computing Sciences
business
Information Systems
Subjects
Details
- Language :
- English
- Database :
- OpenAIRE
- Accession number :
- edsair.doi.dedup.....82412613700d256a561f5b8618eb17f3