Layered error correction encoding for large scale distributed object storage system

    公开(公告)号:US10545826B2

    公开(公告)日:2020-01-28

    申请号:US15605906

    申请日:2017-05-25

    Applicant: Scality S.A.

    Abstract: A method is described. The method includes fragmenting data of an object for storage into an object storage system into multiple data fragments and performing a first error correction encoding process on the data to generate one or more parity fragments for the object. The method also includes sending the multiple data fragments and the one or more parity fragments over a network to different storage servers of the object storage system. The method also includes performing the following at each of the different storage servers: i) incorporating the received one of the multiple data fragments and one or more parity fragments into an extent comprising multiple fragments of other objects; ii) performing a second error correction encoding process on multiple extents including the extent to generate parity information for the multiple extents; and, iii) storing the multiple extents and the parity information.

    Object storage system capable of performing snapshots, branches and locking

    公开(公告)号:US10248682B2

    公开(公告)日:2019-04-02

    申请号:US14627954

    申请日:2015-02-20

    Applicant: Scality, S.A.

    Abstract: An apparatus is described including a large scale distributed storage system. The large scale distributed storage system includes an object store. The large scale distributed storage system includes a plurality of connector nodes coupled to the object store. The connector nodes are to provide access to the object store for respective users that are respectively coupled to the connector nodes. The connector nodes are to provide the following services for the respective users: a snapshot of a storage system implemented within said object store; branching from a snapshot taken of said storage system implemented within said object store; locking of information kept within said storage system implemented within said object store.

    Erasure coding implementation with reduced parity calculation overhead

    公开(公告)号:US12141447B2

    公开(公告)日:2024-11-12

    申请号:US17960124

    申请日:2022-10-04

    Applicant: SCALITY, S.A.

    Abstract: A method is described. The method includes storing data extent replicas for each of a plurality of data extents, wherein, data extent replicas for a same one of the data extents are stored in different physical storage devices, and wherein, a same physical storage device is permitted to store respective data extent replicas of different ones of the data extents. The method includes writing to the respective data extent replicas for at least one of the data extents multiple times without calculating one or more parity extents for the plurality of data extents. The method includes upon a writing activity criteria having been met, calculating one or more parity extents for the data extents and storing the parity extents, and, preserving at least one of the data extent replicas for each of the plurality of data extents.

    Fast and efficient storage system implemented with multiple cloud services

    公开(公告)号:US12124417B2

    公开(公告)日:2024-10-22

    申请号:US17156261

    申请日:2021-01-22

    Applicant: SCALITY, S.A.

    CPC classification number: G06F16/1824 G06F16/128 G06F16/164 G06F16/1873

    Abstract: A method for implementing a storage system is described. The method includes accepting a filepath from a user that specifies a file. The method includes forming a primary key for a representation of the file. The method includes applying the primary key to a database cloud service to obtain a representation of the file. The representation of the file includes an inode for the file's meta data. The method includes using the inode for the file's meta data to obtain the file's meta data from a high performance object cloud storage service. The file's meta data points to information within the high performance object cloud storage service for accessing the file's stripes. The method includes accessing the information within the high performance object cloud storage service to obtain an object ID for a stripe within the file. The method includes using the object ID to access the stripe from a low performance object cloud storage service.

    Snapshots and forks of storage systems using distributed consistent databases implemented within an object store

    公开(公告)号:US11061928B2

    公开(公告)日:2021-07-13

    申请号:US16386142

    申请日:2019-04-16

    Applicant: SCALITY, S.A.

    Abstract: A method is described that includes providing a snapshot counter for a storage system implemented with multiple distributed consistent database instances. The method further includes recognizing the taking of a snapshot of the storage system by incrementing the snapshot counter from a first snapshot counter value to a second snapshot counter value. The method further includes, in response to a first change for one of the distributed consistent databases subsequent to the taking of the snapshot, performing the following: saving state information of the distributed consistent database as the state information existed prior to the change and associating the first snapshot counter value to the state information. Associating the second snapshot counter's value with the distributed consistent database having the first change. Another method for the taking of a snapshot of a distributed consistent database is also described.

    SNAPSHOTS AND FORKS OF STORAGE SYSTEMS USING DISTRIBUTED CONSISTENT DATABASES IMPLEMENTED WITHIN AN OBJECT STORE

    公开(公告)号:US20190310994A1

    公开(公告)日:2019-10-10

    申请号:US16386142

    申请日:2019-04-16

    Applicant: SCALITY, S.A.

    Abstract: A method is described that includes providing a snapshot counter for a storage system implemented with multiple distributed consistent database instances. The method further includes recognizing the taking of a snapshot of the storage system by incrementing the snapshot counter from a first snapshot counter value to a second snapshot counter value. The method further includes, in response to a first change for one of the distributed consistent databases subsequent to the taking of the snapshot, performing the following: saving state information of the distributed consistent database as the state information existed prior to the change and associating the first snapshot counter value to the state information. Associating the second snapshot counter's value with the distributed consistent database having the first change. Another method for the taking of a snapshot of a distributed consistent database is also described.

    LAYERED ERROR CORRECTION ENCODING FOR LARGE SCALE DISTRIBUTED OBJECT STORAGE SYSTEM

    公开(公告)号:US20200319973A1

    公开(公告)日:2020-10-08

    申请号:US16734594

    申请日:2020-01-06

    Applicant: SCALITY, S.A.

    Abstract: A method is described. The method includes fragmenting data of an object for storage into an object storage system into multiple data fragments and performing a first error correction encoding process on the data to generate one or more parity fragments for the object. The method also includes sending the multiple data fragments and the one or more parity fragments over a network to different storage servers of the object storage system. The method also includes performing the following at each of the different storage servers: i) incorporating the received one of the multiple data fragments and one or more parity fragments into an extent comprising multiple fragments of other objects; ii) performing a second error correction encoding process on multiple extents including the extent to generate parity information for the multiple extents; and, iii) storing the multiple extents and the parity information.

Patent Agency Ranking