On the Effectiveness of Recoding-based Repair in Network Coded Distributed Storage

Authors

  • Márton Sipos
    Affiliation
    Budapest University of Technology and Economics, Department of Automation and Applied Informatics
  • Patrik János Braun
    Affiliation
    Budapest University of Technology and Economics, Department of Automation and Applied Informatics
  • Daniel Enrique Lucani
    Affiliation
    Aalborg University, Faculty of Engineering and Science, Department of Electronic Systems
  • Frank H. P. Fitzek
    Affiliation
    Dresden University of Technology Faculty of Electrical Engineering and Information Technology
  • Hassan Charaf
    Affiliation
    Budapest University of Technology and Economics, Department of Automation and Applied Informatics
https://doi.org/10.3311/PPee.9377

Abstract

High capacity storage systems distribute files across several storage devices (nodes) and apply an erasure code to meet availability and reliability requirements. Since devices can lose network connectivity or fail permanently, a dynamic repair mechanism must be put in place. In such cases a new recovery node gets connected to a given subset of the operating nodes and receives a part of the stored data.
The objective of this paper is to investigate data survival for Random Linear Network Coding (RLNC) as a function of topology and communication overhead, defined by the number of connections and the number of transmitted packets to the recovery node, respectively. The paper includes two main contributions. First, a sufficient set of conditions for quasi-infinite longevity of the stored data is derived. Second, a comparison using experimental results shows that RLNC can be up to 50% more effective than traditional erasure codes like Reed-Solomon.

Keywords:

distributed storage, erasure coding, network coding

Citation data from Crossref and Scopus

Published Online

2016-12-23

How to Cite

Sipos, M., Braun, P. J., Lucani, D. E., Fitzek, F. H. P., Charaf, H. “On the Effectiveness of Recoding-based Repair in Network Coded Distributed Storage”, Periodica Polytechnica Electrical Engineering and Computer Science, 61(1), pp. 12–21, 2017. https://doi.org/10.3311/PPee.9377

Issue

Section

Articles