-
公开(公告)号:US20190213179A1
公开(公告)日:2019-07-11
申请号:US16355557
申请日:2019-03-15
Applicant: Amazon Technologies, Inc.
CPC classification number: G06F16/2255 , G06F16/1873
Abstract: A distributed storage system may store data object instances in persistent storage and may store keymap information for those data object instances in a distributed hash table on multiple computing nodes. Each data object instance may include a composite key containing a user key. The keymap information for each data object instance may map the user key to a locator and the locator to the data object instance. A request to store or retrieve keymap information for a data object instance may be routed to a particular computing node based on a consistent hashing scheme in which a hash function is applied to a portion of the composite key of the data object instance. Thus, related entries may be clustered on the same computing nodes. The portion of the key to which the hash function is applied may include a pre-determined number of bits or be identified using a delimiter.
-
公开(公告)号:US11899595B2
公开(公告)日:2024-02-13
申请号:US17929650
申请日:2022-09-02
Applicant: Amazon Technologies, Inc.
CPC classification number: G06F12/1466 , G06F3/067 , G06F3/0608 , G06F3/0619 , G06F3/0622 , G06F3/0652 , G06F3/0671 , G06F3/0673 , G06F11/1435 , G06F11/1453 , G06F16/162 , G06F16/1873 , G06F16/2329 , G06F2201/80 , G06F2201/84 , G06F2212/1052
Abstract: Systems and methods for providing object versioning in a storage system may support the logical deletion of stored objects. In response to a delete operation specifying both a user key and a version identifier, the storage system may permanently delete the specified version of an object having the specified key. In response to a delete operation specifying a user key, but not a version identifier, the storage system may create a delete marker object that does not contain object data, and may generate a new version identifier for the delete marker. The delete marker may be stored as the latest object version of the user key, and may be addressable in the storage system using a composite key comprising the user key and the new version identifier. Subsequent attempts to retrieve the user key without specifying a version identifier may return an error, although the object was not actually deleted.
-
公开(公告)号:US11604781B2
公开(公告)日:2023-03-14
申请号:US17478671
申请日:2021-09-17
Applicant: Amazon Technologies, Inc.
Abstract: A distributed storage system may store data object instances in persistent storage and may store keymap information for those data object instances in a distributed hash table on multiple computing nodes. Each data object instance may include a composite key containing a user key. The keymap information for each data object instance may map the user key to a locator and the locator to the data object instance. A request to store or retrieve keymap information for a data object instance may be routed to a particular computing node based on a consistent hashing scheme in which a hash function is applied to a portion of the composite key of the data object instance. Thus, related entries may be clustered on the same computing nodes. The portion of the key to which the hash function is applied may include a pre-determined number of bits or be identified using a delimiter.
-
公开(公告)号:US10534726B2
公开(公告)日:2020-01-14
申请号:US15979327
申请日:2018-05-14
Applicant: Amazon Technologies, Inc.
Abstract: Systems and methods for providing object versioning in a storage system may support the logical deletion of stored objects. In response to a delete operation specifying both a user key and a version identifier, the storage system may permanently delete the specified version of an object having the specified key. In response to a delete operation specifying a user key, but not a version identifier, the storage system may create a delete marker object that does not contain object data, and may generate a new version identifier for the delete marker. The delete marker may be stored as the latest object version of the user key, and may be addressable in the storage system using a composite key comprising the user key and the new version identifier. Subsequent attempts to retrieve the user key without specifying a version identifier may return an error, although the object was not actually deleted.
-
公开(公告)号:US09235476B2
公开(公告)日:2016-01-12
申请号:US14673808
申请日:2015-03-30
Applicant: Amazon Technologies, Inc.
CPC classification number: G06F12/1466 , G06F3/0608 , G06F3/0619 , G06F3/0622 , G06F3/0652 , G06F3/067 , G06F3/0671 , G06F3/0673 , G06F11/1435 , G06F11/1453 , G06F17/30117 , G06F17/3023 , G06F17/30356 , G06F2201/80 , G06F2201/84 , G06F2212/1052
Abstract: Systems and methods for providing object versioning in a storage system may support the logical deletion of stored objects. In response to a delete operation specifying both a user key and a version identifier, the storage system may permanently delete the specified version of an object having the specified key. In response to a delete operation specifying a user key, but not a version identifier, the storage system may create a delete marker object that does not contain object data, and may generate a new version identifier for the delete marker. The delete marker may be stored as the latest object version of the user key, and may be addressable in the storage system using a composite key comprising the user key and the new version identifier. Subsequent attempts to retrieve the user key without specifying a version identifier may return an error, although the object was not actually deleted.
-
公开(公告)号:US11947510B2
公开(公告)日:2024-04-02
申请号:US18182294
申请日:2023-03-10
Applicant: Amazon Technologies, Inc.
CPC classification number: G06F16/2255 , G06F16/1873
Abstract: A distributed storage system may store data object instances in persistent storage and may store keymap information for those data object instances in a distributed hash table on multiple computing nodes. Each data object instance may include a composite key containing a user key. The keymap information for each data object instance may map the user key to a locator and the locator to the data object instance. A request to store or retrieve keymap information for a data object instance may be routed to a particular computing node based on a consistent hashing scheme in which a hash function is applied to a portion of the composite key of the data object instance. Thus, related entries may be clustered on the same computing nodes. The portion of the key to which the hash function is applied may include a pre-determined number of bits or be identified using a delimiter.
-
公开(公告)号:US20230281181A1
公开(公告)日:2023-09-07
申请号:US18182294
申请日:2023-03-10
Applicant: Amazon Technologies, Inc.
CPC classification number: G06F16/2255 , G06F16/1873
Abstract: A distributed storage system may store data object instances in persistent storage and may store keymap information for those data object instances in a distributed hash table on multiple computing nodes. Each data object instance may include a composite key containing a user key. The keymap information for each data object instance may map the user key to a locator and the locator to the data object instance. A request to store or retrieve keymap information for a data object instance may be routed to a particular computing node based on a consistent hashing scheme in which a hash function is applied to a portion of the composite key of the data object instance. Thus, related entries may be clustered on the same computing nodes. The portion of the key to which the hash function is applied may include a pre-determined number of bits or be identified using a delimiter.
-
公开(公告)号:US20220075767A1
公开(公告)日:2022-03-10
申请号:US17478671
申请日:2021-09-17
Applicant: Amazon Technologies, Inc.
Abstract: A distributed storage system may store data object instances in persistent storage and may store keymap information for those data object instances in a distributed hash table on multiple computing nodes. Each data object instance may include a composite key containing a user key. The keymap information for each data object instance may map the user key to a locator and the locator to the data object instance. A request to store or retrieve keymap information for a data object instance may be routed to a particular computing node based on a consistent hashing scheme in which a hash function is applied to a portion of the composite key of the data object instance. Thus, related entries may be clustered on the same computing nodes. The portion of the key to which the hash function is applied may include a pre-determined number of bits or be identified using a delimiter.
-
公开(公告)号:US11126605B2
公开(公告)日:2021-09-21
申请号:US16355557
申请日:2019-03-15
Applicant: Amazon Technologies, Inc.
Abstract: A distributed storage system may store data object instances in persistent storage and may store keymap information for those data object instances in a distributed hash table on multiple computing nodes. Each data object instance may include a composite key containing a user key. The keymap information for each data object instance may map the user key to a locator and the locator to the data object instance. A request to store or retrieve keymap information for a data object instance may be routed to a particular computing node based on a consistent hashing scheme in which a hash function is applied to a portion of the composite key of the data object instance. Thus, related entries may be clustered on the same computing nodes. The portion of the key to which the hash function is applied may include a pre-determined number of bits or be identified using a delimiter.
-
公开(公告)号:US10528537B2
公开(公告)日:2020-01-07
申请号:US15877126
申请日:2018-01-22
Applicant: Amazon Technologies, Inc.
IPC: G06F16/21 , G06F16/172 , G06F16/182 , G06F16/18 , G06F12/12
Abstract: A distributed storage system may store data object instances in persistent storage and may cache keymap information for those data object instances. The system may cache a latest symbolic key entry for some user keys of the data object instances. When a request is made for the latest version of stored data object instances having a specified user key, the latest version may be determined dependent on whether a latest symbolic key entry exists for the specified user key, and keymap information for the latest version may be returned. When storing keymap information, a flag may be set to indicate that a corresponding latest symbolic key entry should be updated. The system may delete a latest symbolic key entry for a particular user key from the cache in response to determining that no other requests involving the keymap information for data object instances having the particular user key are pending.
-
-
-
-
-
-
-
-
-