Search

Your search keyword '"Wang, Yingxu"' showing total 14 results
Start Over Author "Wang, Yingxu" Publisher elsevier bv
14 results on '"Wang, Yingxu"'

5. A self-organizing deep belief network based on information relevance strategy

Author

Wang Yingxu, Junfei Qiao, Honggui Han, and Guo Min

Subjects
Structure (mathematical logic), 0209 industrial biotechnology, Computer science, Process (engineering), business.industry, Cognitive Neuroscience, 02 engineering and technology, Mutual information, Machine learning, computer.software_genre, Measure (mathematics), Computer Science Applications, Deep belief network, 020901 industrial engineering & automation, Artificial Intelligence, 0202 electrical engineering, electronic engineering, information engineering, Benchmark (computing), 020201 artificial intelligence & image processing, Relevance (information retrieval), Artificial intelligence, business, computer, Maximal information coefficient
Abstract

One of the major obstacles in using deep belief network (DBN) is the structure design. Numerous studies, both empirically and theoretically, show that choosing suitable structure can improve the performance of DBN. In this paper, a self-organizing DBN (S-DBN), based on the information relevance strategy (IRS), was proposed to design the structure of DBN. For this IRS, the maximal information coefficient was designed to measure the input and output information relevance of hidden neurons. Meanwhile, the mutual information was introduced to measure the information relevance among the hidden layers. Then, a novel self-organizing strategy was developed to grow and prune both the hidden neurons and layers during the training process. Moreover, a contrastive divergence algorithm was used to adjust the parameters of S-DBN. Finally, several benchmark problems were used to illustrate the effectiveness of S-DBN. The experimental results demonstrate that the proposed S-DBN owns better performance for classification problems and modeling nonlinear systems than some existing methods.

Published
2020

Catalog

Books, media, physical & digital resources
See catalog results