1. A Collective Intelligence Based Differential Evolution Algorithm for Optimizing the Structure and Parameters of a Neural Network
- Author
-
Jinhong Feng, Yuanyuan Tang, Jundong Zhang, Ruizheng Jiang, and Chuan Wang
- Subjects
education.field_of_study ,differential evolution (DE) ,Optimization problem ,Evolutionary artificial neural network ,General Computer Science ,Artificial neural network ,business.industry ,Computer science ,global optimization ,Population ,General Engineering ,Collective intelligence ,collective intelligence (CI) ,Differential evolution ,Feedforward neural network ,Unsupervised learning ,General Materials Science ,Artificial intelligence ,lcsh:Electrical engineering. Electronics. Nuclear engineering ,business ,education ,lcsh:TK1-9971 - Abstract
In this paper, a Self-learning Collective Intelligence Differential Evolution (SLCIDE) algorithm was proposed to optimize both the architecture and parameters of a Feedforward Neural Network (FNN). In order to improve the exploration-exploitation capability, a new Collective Intelligence (CI) based mutation operator was proposed by mixing some promising donor vectors in the current population. Besides, a self-learning mechanism which was designed to adaptively select m top ranked donor vectors was developed by using a widely used unsupervised learning method, k-means. As a result, the proposed approach can be more adaptive and statistically powerful on versatile problems. Then, we evaluated the performances of the proposed SLCIDE approach by studying some numerical optimization problems of CEC 2013 with D = 30 and D = 50. Further, the proposed SLCIDE method was applied to train a FNN on four most popular datasets, resulting in very competitive performances. The comprehensive experimental results have demonstrated that the presented SLCIDE method obtain better results compared with other state-of-the-art algorithms.
- Published
- 2020