-
公开(公告)号：US20200151114A1
公开(公告)日：2020-05-14
申请号：US16739763
申请日：2020-01-10
Applicant: Amazon Technologies, Inc.
Abstract: Systems and methods for providing object versioning in a storage system may support the logical deletion of stored objects. In response to a delete operation specifying both a user key and a version identifier, the storage system may permanently delete the specified version of an object having the specified key. In response to a delete operation specifying a user key, but not a version identifier, the storage system may create a delete marker object that does not contain object data, and may generate a new version identifier for the delete marker. The delete marker may be stored as the latest object version of the user key, and may be addressable in the storage system using a composite key comprising the user key and the new version identifier. Subsequent attempts to retrieve the user key without specifying a version identifier may return an error, although the object was not actually deleted.
-
公开(公告)号：US10235405B2
公开(公告)日：2019-03-19
申请号：US14500404
申请日：2014-09-29
Applicant: Amazon Technologies, Inc.
IPC: G06F17/30
Abstract: A distributed storage system may store data object instances in persistent storage and may store keymap information for those data object instances in a distributed hash table on multiple computing nodes. Each data object instance may include a composite key containing a user key. The keymap information for each data object instance may map the user key to a locator and the locator to the data object instance. A request to store or retrieve keymap information for a data object instance may be routed to a particular computing node based on a consistent hashing scheme in which a hash function is applied to a portion of the composite key of the data object instance. Thus, related entries may be clustered on the same computing nodes. The portion of the key to which the hash function is applied may include a pre-determined number of bits or be identified using a delimiter.
-
公开(公告)号：US20180189336A1
公开(公告)日：2018-07-05
申请号：US15877126
申请日：2018-01-22
Applicant: Amazon Technologies, Inc.
CPC classification number: G06F16/219 , G06F12/12 , G06F16/172 , G06F16/182 , G06F16/1873
Abstract: A distributed storage system may store data object instances in persistent storage and may cache keymap information for those data object instances. The system may cache a latest symbolic key entry for some user keys of the data object instances. When a request is made for the latest version of stored data object instances having a specified user key, the latest version may be determined dependent on whether a latest symbolic key entry exists for the specified user key, and keymap information for the latest version may be returned. When storing keymap information, a flag may be set to indicate that a corresponding latest symbolic key entry should be updated. The system may delete a latest symbolic key entry for a particular user key from the cache in response to determining that no other requests involving the keymap information for data object instances having the particular user key are pending.
-
公开(公告)号：US09928247B2
公开(公告)日：2018-03-27
申请号：US14727651
申请日：2015-06-01
Applicant: Amazon Technologies, Inc.
CPC classification number: G06F17/3015 , G06F11/1448 , G06F17/30117 , G06F17/3023
Abstract: Systems and methods for providing object versioning in a storage system may support the logical deletion of stored objects through the use of delete marker objects. In response to a delete operation specifying a key, but not a version identifier, the storage system may create a delete marker object that is stored as the latest object version of the key. In response to performing a subsequent mutating operation, or at pre-determined time intervals, the storage system may perform a local and/or a global analysis of the delete marker objects stored in the system (and/or metadata associated with those delete marker objects) to determine whether any of them are no longer needed to ensure correct operation of the system. The analysis may apply one or more reap conditions to delete marker objects and/or metadata to identify extraneous delete marker objects, removing those that meet one or more reap conditions from storage.
-
公开(公告)号：US09875262B2
公开(公告)日：2018-01-23
申请号：US14733897
申请日：2015-06-08
Applicant: Amazon Technologies, Inc.
CPC classification number: G06F17/30309 , G06F12/12 , G06F17/30132 , G06F17/30194 , G06F17/3023
Abstract: A distributed storage system may store data object instances in persistent storage and may cache keymap information for those data object instances. The system may cache a latest symbolic key entry for some user keys of the data object instances. When a request is made for the latest version of stored data object instances having a specified user key, the latest version may be determined dependent on whether a latest symbolic key entry exists for the specified user key, and keymap information for the latest version may be returned. When storing keymap information, a flag may be set to indicate that a corresponding latest symbolic key entry should be updated. The system may delete a latest symbolic key entry for a particular user key from the cache in response to determining that no other requests involving the keymap information for data object instances having the particular user key are pending.
-
Patent Agency Ranking
公开(公告)号：US20170337154A1
公开(公告)日：2017-11-23
申请号：US15671099
申请日：2017-08-07
Applicant: Amazon Technologies, Inc.
Inventor： Jeffrey Michael Barber , Derek Ernest Denny-Brown, II , Carl Yates Perry , Christopher Henning Elving , Praveen Kumar Gattu
IPC: G06F15/167
CPC classification number: G06F9/5016 , G06F3/0649 , G06F9/4843 , Y02D10/22
Abstract: Methods and apparatus for a pipelined architecture for storage lifecycles are disclosed. A method includes identifying, during a transition candidate discovery iteration, storage objects of a multi-tenant service for which respective lifecycle transitions are to be scheduled, including a particular storage object identified as being a candidate for a particular lifecycle transition. The method includes generating transition job objects, each job comprising respective indications of one or more of the storage objects identified during the discovery iteration. The method includes assigning, during a transition execution iteration, resources to initiate storage operations for the particular lifecycle transition, and initiating, using the assigned resources, storage operations for the particular lifecycle transition.
-
公开(公告)号：US20170255589A1
公开(公告)日：2017-09-07
申请号：US15602017
申请日：2017-05-22
Applicant: Amazon Technologies, Inc.
Inventor： Jeffrey Michael Barber , Praveen Kumar Gattu , Derek Ernest Denny-Brown, II , Christopher Henning Elving , Carl Yates Perry
IPC: G06F15/167
CPC classification number: G06F15/167 , G06F16/219 , G06F16/2474
Abstract: Methods and apparatus for lifecycle support for storage objects are disclosed. A storage medium stores program instructions that when executed on a processor implement a storage lifecycle manager of a multi-tenant storage service. The lifecycle manager determines a lifecycle policy to be implemented for a storage object. The policy indicates lifecycle transitions of the object, including a transition from a first service level to a second service level. The first service level and the second service level may each specify a maximum number of versions of the storage object. The lifecycle manager initiates modification operations corresponding to the storage object's data in accordance with the lifecycle policy, and verifies that the modification operations succeeded. The lifecycle manager provides, in response to a query, an indication of a current service level of the storage object.
-
公开(公告)号：US09417917B1
公开(公告)日：2016-08-16
申请号：US13715898
申请日：2012-12-14
Applicant: Amazon Technologies, Inc.
Inventor： Jeffrey Michael Barber , Carl Yates Perry , Praveen Kumar Gattu , Derek Ernest Denny-Brown, II , Christopher Henning Elving
CPC classification number: G06F9/5005 , G06F9/5022 , G06F9/5027 , G06F2209/5018
Abstract: Methods and apparatus for equitable resource allocation for storage object deletions are disclosed. A storage medium stores program instructions that when executed on a processor implement a deletion task dispatcher of a multi-tenant storage service. The dispatcher identifies one or more deletion job objects that each comprise an indication of a respective set of storage objects that are candidates for scheduled deletion from the storage service. The dispatcher determines a set of resources to be used for deletion operations corresponding to a particular deletion job object, based at least in part on the number of distinct clients whose storage objects are indicated in the job object, and assigned the set of resource to initiate the deletion operations corresponding to the particular job object.
Abstract translation: 公开了用于存储对象删除的公平资源分配的方法和装置。 存储介质存储当在处理器上执行时执行多租户存储服务的删除任务调度器的程序指令。 调度员识别一个或多个删除作业对象，每个删除作业对象包括作为从存储服务调度删除的候选的相应存储对象集合的指示。 所述调度器至少部分地基于在所述作业对象中指示了其存储对象的不同客户端的数量来确定要用于与特定删除作业对象相对应的删除操作的一组资源，并且分配所述一组资源以启动 与特定作业对象相对应的删除操作。
-
公开(公告)号：US20160124870A1
公开(公告)日：2016-05-05
申请号：US14992915
申请日：2016-01-11
Applicant: Amazon Technologies, Inc.
IPC: G06F12/14
CPC classification number: G06F12/1466 , G06F3/0608 , G06F3/0619 , G06F3/0622 , G06F3/0652 , G06F3/067 , G06F3/0671 , G06F3/0673 , G06F11/1435 , G06F11/1453 , G06F17/30117 , G06F17/3023 , G06F17/30356 , G06F2201/80 , G06F2201/84 , G06F2212/1052
Abstract: Systems and methods for providing object versioning in a storage system may support the logical deletion of stored objects. In response to a delete operation specifying both a user key and a version identifier, the storage system may permanently delete the specified version of an object having the specified key. In response to a delete operation specifying a user key, but not a version identifier, the storage system may create a delete marker object that does not contain object data, and may generate a new version identifier for the delete marker. The delete marker may be stored as the latest object version of the user key, and may be addressable in the storage system using a composite key comprising the user key and the new version identifier. Subsequent attempts to retrieve the user key without specifying a version identifier may return an error, although the object was not actually deleted.
-
公开(公告)号：US09002805B1
公开(公告)日：2015-04-07
申请号：US13715867
申请日：2012-12-14
Applicant: Amazon Technologies, Inc.
Inventor： Jeffrey Michael Barber , Praveen Kumar Gattu , Christopher Henning Elving , Derek Ernest Denny-Brown, II , Carl Yates Perry
CPC classification number: G06F17/30303
Abstract: Methods and apparatus for conditional deletes of storage objects are disclosed. A storage medium comprises program instructions that when executed, implement a metadata node of a storage service in which a protocol based on sequence numbers is used to resolve update conflicts. The instructions store, as part of a conditional deletion record associated with a key of a particular storage object identified as a deletion candidate, a deletion sequence number derived from a particular modification sequence number of the object. In accordance with the protocol, the instructions determine whether an additional modification sequence number larger than the deletion sequence number has been generated in response to an operation associated with the key. If such an additional sequence number has been generated, the deletion of the storage object is canceled.
Abstract translation: 公开了用于存储对象的有条件删除的方法和装置。 存储介质包括程序指令，当执行时，实现存储服务的元数据节点，其中使用基于序列号的协议来解决更新冲突。 作为与标识为删除候选的特定存储对象的密钥相关联的条件删除记录的一部分，指令存储从对象的特定修改序列号导出的删除序列号。 根据协议，指令确定响应于与该密钥相关联的操作是否已经生成大于删除序列号的附加修改序列号。 如果已经生成了这样的附加序列号，则取消存储对象的删除。
-
-
-
-
-
-
-
-
-
Search Results
40
records
(took 0.062 seconds)
