Matrix-based error correction and erasure code methods and system and applications thereof

    公开(公告)号:US10536167B2

    公开(公告)日:2020-01-14

    申请号:US15362360

    申请日:2016-11-28

    摘要: A distributed data storage system breaks data into n slices and k checksums using at least one matrix-based erasure code based on matrices with invertible submatrices, stores the slices and checksums on a plurality of storage elements, retrieves the slices from the storage elements, and, when slices have been lost or corrupted, retrieves the checksums from the storage elements and restores the data using the at least one matrix-based erasure code and the checksums. In a method for ensuring restoration and integrity of data in computer-related applications, data is broken into n pieces, k checksums are calculated using at least one matrix-based erasure code based on matrices with invertible submatrices, and the n data pieces and k checksums are stored on n+k storage elements or transmitted over a network. If, upon retrieving the n pieces from the storage elements or network, pieces have been lost or corrupted, the checksums are retrieved and the data is restored using the matrix-based erasure code and the checksums.

    Matrix-Based Error Correction and Erasure Code Methods and System and Applications Thereof
    3.
    发明申请
    Matrix-Based Error Correction and Erasure Code Methods and System and Applications Thereof 审中-公开
    基于矩阵的纠错和擦除代码方法及其系统和应用

    公开(公告)号:US20170077950A1

    公开(公告)日:2017-03-16

    申请号:US15362360

    申请日:2016-11-28

    IPC分类号: H03M13/05 H03M13/00 G06F3/06

    摘要: A distributed data storage system breaks data into n slices and k checksums using at least one matrix-based erasure code based on matrices with invertible submatrices, stores the slices and checksums on a plurality of storage elements, retrieves the slices from the storage elements, and, when slices have been lost or corrupted, retrieves the checksums from the storage elements and restores the data using the at least one matrix-based erasure code and the checksums. In a method for ensuring restoration and integrity of data in computer-related applications, data is broken into n pieces, k checksums are calculated using at least one matrix-based erasure code based on matrices with invertible submatrices, and the n data pieces and k checksums are stored on n+k storage elements or transmitted over a network. If, upon retrieving the n pieces from the storage elements or network, pieces have been lost or corrupted, the checksums are retrieved and the data is restored using the matrix-based erasure code and the checksums.

    摘要翻译: 分布式数据存储系统使用至少一个基于矩阵的擦除码将数据分解为n个片和k个校验和,该擦除码基于具有可逆子矩阵的矩阵,将片和校验和存储在多个存储元件上,从存储元件中检索片,以及 当切片已经丢失或损坏时,从存储元件检索校验和并使用至少一个基于矩阵的擦除代码和校验和来恢复数据。 在确保计算机相关应用中的数据恢复和完整性的方法中,数据被分成n个部分,使用至少一个基于矩阵的擦除码来计算k个校验和,该矩阵基于具有可逆子矩阵的矩阵,并且n个数据片段和k个 校验和存储在n + k个存储元件上或通过网络传输。 如果在从存储元件或网络检索n个片段时,片段已经丢失或损坏,则校验和被检索,并且使用基于矩阵的擦除代码和校验和来恢复数据。

    Methods and Apparatus for Distributed Data Storage
    4.
    发明申请
    Methods and Apparatus for Distributed Data Storage 有权
    分布式数据存储的方法和装置

    公开(公告)号:US20150347435A1

    公开(公告)日:2015-12-03

    申请号:US14816039

    申请日:2015-08-02

    IPC分类号: G06F17/30 G06F11/10

    摘要: A distributed heterogeneous or homogeneous file storage system divides logical responsibility for data from actual control of the data by using separate file and storage managers. Each file manager provides access to stored files and stores metadata associated with each of the files for which it is responsible. A file manager control component allocates responsibilities among file managers, assigns management responsibilities for individual files, and maintains a record of which files are assigned to each manager. Each storage manager is responsible for managing storage of files on data storage devices and maintains a record of the location of each stored file. A storage manager control component allocates responsibilities among storage managers, assigns responsibilities for individual files, and maintains a record of which files and storage devices are assigned to each manager. A client provides user access, initiates actions within the system, and implements a redundant data recovery and reconstruction scheme.

    摘要翻译: 分布式异构或同类文件存储系统通过使用单独的文件和存储管理器将数据的逻辑责任与数据的实际控制分开。 每个文件管理器提供对存储的文件的访问,并存储与其负责的每个文件相关联的元数据。 文件管理器控制组件在文件管理器之间分配责任,分配单个文件的管理责任,并维护哪些文件分配给每个管理器的记录。 每个存储管理器负责管理数据存储设备上的文件的存储,并维护每个存储的文件的位置的记录。 存储管理器控制组件在存储管理器之间分配责任,分配单个文件的职责,并维护哪些文件和存储设备分配给每个管理器的记录。 客户端提供用户访问,在系统内启动操作,并实现冗余数据恢复和重建方案。