Options
Practical Erasure Codes for Storage Systems : The Study of Entanglement Codes, an Approach that Propagates Redundancy to Increase Reliability and Performance
Editeur(s)
Maison d'édition
Neuchâtel : Université de Neuchâtel
Date de parution
2017
Nombre de page
163 p.
Mots-clés
Résumé
This dissertation deals with the design of practical erasure codes for storage systems. Hardware and logical disk failures are a common source of system failures that may lead to data loss. Nevertheless, it is predicted that spinning disks would remain the standard storage mediumin large datacenters. Cloud storage needs efficient codes to become reliable despite its low-cost components. As systems scale in size and complexity, their properties and requirements may change. When data ages, it is usuallymoved to dedicated archives. Yet the boundaries between storage systems and archives are getting diffuse as we move into applications that require low latency access such as mining data from large scientific archives. Moreover, the centralized approach of cloud backup services brings privacy and economics concerns. Some studies suggest that cooperative peer-to-peer networks aremore sustainable for the long term. But peer-to-peer nodes and spinning disks share an undesirable property: both are unreliable. The motivation for this study is to design flexible and practical codes that can provide high fault-tolerance to improve data durability and availability even in catastrophic scenarios. Survivability comes through the strength built with redundancy. It is difficult to devise a solution based on classic codes that considers all aspects of dependability: availability, reliability, safety, integrity and maintainability. Compromises are generally found through the complex combination ofmany techniques. This thesis argues that codes that are based exclusively on the use of parallel networks (such as replication) or mainly on the use of serial networks (as it is seen in the split and expand operations behind classic erasure codes) do not leverage all the resources available in a system. Entanglement codes create redundancy by tangling new data blocks with old ones, building entangled data chains that are woven into a growing mesh of interdependent content. We propose: 1) open and close entanglements as more reliable alternatives
than mirroring, 2) alpha entanglements to achieve extremely high fault-tolerance with low storage overhead and low repair costs, and 3) spigot codes to reduce the space footprint from entangled data without significant loss of the entanglement’s properties. These codes can leverage storage and bandwidth resources efficiently by exploiting the combinatorial power of network reliability. Furthermore, their flexible design based on virtual chains of entangled
data yields a scalable and suitable solution to accommodate future requirements. Finally, due to the combinatorial power of entangled data, all in all, dependability is boosted.
than mirroring, 2) alpha entanglements to achieve extremely high fault-tolerance with low storage overhead and low repair costs, and 3) spigot codes to reduce the space footprint from entangled data without significant loss of the entanglement’s properties. These codes can leverage storage and bandwidth resources efficiently by exploiting the combinatorial power of network reliability. Furthermore, their flexible design based on virtual chains of entangled
data yields a scalable and suitable solution to accommodate future requirements. Finally, due to the combinatorial power of entangled data, all in all, dependability is boosted.
Notes
Thèse soutenue le 19 mai 2017 à la Faculté des Sciences chaire de Systèmes Complexes, programme doctoral Université de Neuchâtel pour l’obtention du grade de Docteur ès Sciences
Jury:
Professeur Peter Kropf, président du jury, Université de Neuchâtel, Suisse
Professeur Pascal Felber, directeur de thèse, Université de Neuchâtel, Suisse
Professeur Patrick T. Eugster, rapporteur, TU Darmstadt, Allemagne
Professeur Ethan L. Miller, rapporteur, Université de California à Santa Cruz, États-Unis
Jury:
Professeur Peter Kropf, président du jury, Université de Neuchâtel, Suisse
Professeur Pascal Felber, directeur de thèse, Université de Neuchâtel, Suisse
Professeur Patrick T. Eugster, rapporteur, TU Darmstadt, Allemagne
Professeur Ethan L. Miller, rapporteur, Université de California à Santa Cruz, États-Unis
Identifiants
Type de publication
doctoral thesis
Dossier(s) à télécharger
