Back to Search Start Over

Configuration optimization method of Hadoop system performance based on genetic simulated annealing algorithm.

Authors :
Luo, Xiaoling
Fu, Xueliang
Source :
Cluster Computing. Jul2019 Supplement 4, Vol. 22, p8965-8973. 9p.
Publication Year :
2019

Abstract

The configuration optimization method of Hadoop system performance based on genetic simulated annealing algorithm is studied. In view of the performance of Hadoop on open source cloud computing platform, an optimization method is proposed. Based on the genetic simulated annealing algorithm, each configuration scheme is used as a chromosome for multiple selection, crossover and mutation. Combined with the principle of simulated annealing, the survival of the new chromosome and the number of iterations of the whole algorithm are controlled, and the optimal scheme of the system configuration is found. The experimental results show that the method can effectively improve the operation efficiency of the operation. In addition, the overall effect of the group is very good at the end of the iteration. When the job types in the system are similar, according to the characteristics that the whole simulated annealing algorithm is approaching the optimal solution, a real-time optimization configuration model is proposed on the basic of genetic simulated annealing algorithm. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
13867857
Volume :
22
Database :
Academic Search Index
Journal :
Cluster Computing
Publication Type :
Academic Journal
Accession number :
140033867
Full Text :
https://doi.org/10.1007/s10586-018-2029-y