Back to Search
Start Over
Multiobjective Hybrid Optimization and Training of Recurrent Neural Networks.
- Source :
-
IEEE Transactions on Systems, Man & Cybernetics: Part B . Apr2008, Vol. 38 Issue 2, p381-403. 23p. 3 Black and White Photographs, 4 Diagrams, 3 Charts, 67 Graphs. - Publication Year :
- 2008
-
Abstract
- The application of neural networks to solve a problem involves tasks with a high computational cost until a suitable network is found, and these tasks mainly involve the selection of the network topology and the training step. We usually select the network structure by means of a trial-and-error procedure, and we then train the network. In the case of recurrent neural networks (RNNs), the lack of suitable training algorithms sometimes hampers these procedures due to vanishing gradient problems. This paper addresses the simultaneous training and topology optimization of RNNs using multiobjective hybrid procedures. The proposal is based on the SPEA2 and NSGA2 algorithms for making hybrid methods using the Baldwinian hybridization strategy. We also study the effects of the selection of the objectives, crossover, and mutation in the diversity during evolution. The proposals are tested in the experimental section to train and optimize the networks in the competition on artificial time-series (CATS) benchmark. [ABSTRACT FROM AUTHOR]
Details
- Language :
- English
- ISSN :
- 10834419
- Volume :
- 38
- Issue :
- 2
- Database :
- Academic Search Index
- Journal :
- IEEE Transactions on Systems, Man & Cybernetics: Part B
- Publication Type :
- Academic Journal
- Accession number :
- 31420861
- Full Text :
- https://doi.org/10.1109/TSMCB.2007.912937