-
公开(公告)号:US20190361775A1
公开(公告)日:2019-11-28
申请号:US15989589
申请日:2018-05-25
Applicant: Microsoft Technology Licensing, LLC
Inventor: Jacob Rubin LORCH , Cheng HUANG , Peng HUANG , Aaron W. OGUS
Abstract: A system includes determination of a plurality of meta-copysets of a plurality of storage devices, each of the meta-copysets including a first number of storage devices, determination of a first copyset of a second number of storage devices from a first one of the meta-copysets, where the second number is less than the first number, storage of first data in a fault-tolerant format using the first copyset, determination to migrate the first data from a first storage device of the first copyset, and, in response to the determination to migrate the first data, determine a second copyset of the second number of storage devices including a storage device from the first meta-copyset which is not in the first copyset, and the storage devices of the first copyset except for the first storage device of the first copyset and storage of the first data in a fault-tolerant format using the second copyset.
-
公开(公告)号:US20190250989A1
公开(公告)日:2019-08-15
申请号:US16392487
申请日:2019-04-23
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Cheng HUANG , Jin LI , Aaron William OGUS , Douglas W. PHILLIPS , Yu Lin CHEN , Shuai MU , Jinyang LI
CPC classification number: G06F11/1084 , G06F3/06 , G06F11/1658 , G06F11/1662 , G06F11/1666 , G06F11/2097 , G06F12/0253 , G06F2201/805 , G06F2212/1044 , H03M13/1515 , H03M13/154 , H03M13/373 , H03M13/3761
Abstract: In various embodiments, methods and systems for implementing distributed data object management are provided. The distributed data object management system includes a distributed storage system having a local metadata-consensus information store in and one or more remote metadata-consensus information stores. A metadata-consensus information store is configured to store metadata-consensus information. The metadata-consensus information corresponds to erasure coded fragments of a data object and instruct on how to manage the erasure coded fragments. The distributed storage system further includes a local data store and one or more remote data stores for the erasure coded fragments. The distributed data object management system includes a distributed data object manager for operations including, interface operations, configuration operations, write operations, read operations, delete operations, garbage collection operations and failure recovery operations. The distributed data object management system is operates based on metadata paths and data paths, operating in parallel, for write operations and read operations.
-
公开(公告)号:US20180365106A1
公开(公告)日:2018-12-20
申请号:US15626070
申请日:2017-06-16
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Cheng HUANG , Jin LI , Aaron William OGUS , Douglas W. PHILLIPS , Yu Lin CHEN , Shuai MU , Jinyang LI
CPC classification number: G06F11/1084 , G06F11/1662 , G06F11/1666 , G06F12/0253 , G06F2201/805 , G06F2212/1044 , H03M13/154
Abstract: In various embodiments, methods and systems for implementing distributed data object management are provided. The distributed data object management system includes a distributed storage system having a local metadata-consensus information store in and one or more remote metadata-consensus information stores. A metadata-consensus information store is configured to store metadata-consensus information. The metadata-consensus information corresponds to erasure coded fragments of a data object and instruct on how to manage the erasure coded fragments. The distributed storage system further includes a local data store and one or more remote data stores for the erasure coded fragments. The distributed data object management system includes a distributed data object manager for operations including, interface operations, configuration operations, write operations, read operations, delete operations, garbage collection operations and failure recovery operations. The distributed data object management system is operates based on metadata paths and data paths, operating in parallel, for write operations and read operations.
-
公开(公告)号:US20210208782A1
公开(公告)日:2021-07-08
申请号:US17059873
申请日:2018-06-01
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Jianfeng ZHU , Yiheng TAO , Cheng HUANG , Aaron William OGUS , Yilong ZHAO , Terry CHEN , Zhenshan YU , Tejas SHAH , Sridhar SRINIVASAN
Abstract: Various embodiments, methods, and systems for erasure coding with overlapped local reconstruction codes, are provided. An erasure coding scheme can be defined based on Overlapped Local Reconstruction Codes (OLRC) that achieve high storage efficiency by providing fault tolerance properties that optimize reconstruction for common cases of failures while maintaining the reconstruction costs for uncommon case of failures. In operation, a data chunk is divided into data fragments. The data fragments correspond to zones. A plurality of parity fragments is computed using the data fragments. A parity fragment is computed using a subset of the data fragments. The plurality of parity fragments are assigned to the zones comprising the data fragments, where the data fragments and the plurality of parity fragments define overlapped local construction codes having a plurality of local groups. An unavailable data fragment is recoverable from at least two local groups from the plurality of local groups.
-
公开(公告)号:US20180365104A1
公开(公告)日:2018-12-20
申请号:US15626073
申请日:2017-06-16
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Cheng HUANG , Jin LI , Aaron William OGUS , Douglas W. PHILLIPS , Yu Lin CHEN , Shuai MU , Jinyang LI
Abstract: In various embodiments, methods and systems for implementing distributed data object management are provided. The distributed data object management system includes a local metadata-consensus information store and one or more remote metadata-consensus information stores for metadata-consensus information and a local data store and one or more remote data stores for erasure coded fragments. For a write operation, corresponding metadata writes and data writes are performed in parallel using a metadata write path and a data write path, respectively, when writing to the local metadata-consensus information store and the one or more remote metadata-consensus information stores and the local data store and the one or more remote data stores. And, for a read operation, corresponding metadata reads and data reads are performed in parallel using a metadata read path and a data read path, respectively, when reading from the metadata-consensus information stores and the data stores.
-
-
-
-