1. An Optimal Tree-Structured Repair Scheme of Multiple Failure Nodes for Distributed Storage Systems
- Author
-
Laigan Luo, Benshun Yi, Yusheng Liu, and Anan Zhou
- Subjects
Mathematical optimization ,021103 operations research ,General Computer Science ,Computer science ,0211 other engineering and technologies ,General Engineering ,020206 networking & telecommunications ,Prim's algorithm ,02 engineering and technology ,Network topology ,Centralized communication model ,Tabu search ,delay repair ,network topology ,TK1-9971 ,tree-structured model ,Distributed data store ,Fountain code ,fountain codes ,0202 electrical engineering, electronic engineering, information engineering ,General Materials Science ,Firefly algorithm ,optimization algorithms ,Electrical engineering. Electronics. Nuclear engineering ,Erasure code - Abstract
To reduce recovery cost of repairing multiple failed nodes, many repair schemes have been proposed for erasure codes based distributed storage systems. However, most of the existing researches ignore the network topology of storage devices. Motivated by such considerations, we combine delay repair schemes with network topology and propose a tree-structured model based on fountain codes with large value of $\left ({n,k,r }\right)$ to improve the repair efficiency. More precisely, with the consideration of network topology, a new target named data recovery cost is defined to measure the efficiency of coded fragment download and source file reconstruction, and then the optimal recovery threshold is derived to minimize the average data recovery cost of general tree-structured model. Moreover, we analyze and compare the average data recovery cost of general tree-structure with different systematic parameters. To further improve the data transmission efficiency, an optimal tree-structured scheme based on improved tabu search algorithm (ITSA-ORT) is proposed. Compared with other algorithms, the ITSA-ORT scheme uses Prim algorithm to generate the initial solution and then uses special method to obtain the corresponding neighborhood structure. The experimental results show that the proposed scheme can find a globally optimal solution and obtain lower cost of data recovery. In addition, the ITSA-ORT scheme has lower computational complexity than the optimal tree-structured scheme based on particle swarm optimization algorithm (PSO-ORT) and the optimal tree-structured scheme based on firefly algorithm (FA-ORT).
- Published
- 2021