公开(公告)号：US11467878B2

公开(公告)日：2022-10-11

申请号：US16147468

申请日：2018-09-28

Applicant: Amazon Technologies, Inc.

Inventor： Marvin Michael Theimer ,  Julien Jacques Ellie ,  Colin Watson ,  Ullas Sankhla ,  Swapandeep Singh ,  Kerry Hart ,  Paul Anderson ,  Brian Dahmen ,  Suchi Nandini ,  Yunhan Chen ,  Shu Liu ,  Arjun Raman ,  Yuxin Xie ,  Fengjia Xiong

IPC: G06F9/50 ,  G06F8/70 ,  G06F16/182 ,  G06F9/48

Abstract: Methods, systems, and computer-readable media for orchestration of computations using a remote repository are disclosed. A representation of one or more inputs to a computation is stored in a repository. The computation is assigned to one or more hosts of a plurality of hosts. A representation of program code executable to perform the computation is stored in the repository. A local copy of the one or more inputs is stored on the one or more hosts. The computation is initiated on the one or more hosts using the program code and the local copy of the one or more inputs. The computation is initiated for a plurality of keys. The computation succeeds for one or more keys after the computation has failed for one or more other keys. A representation of one or more outputs of the computation is stored in the repository.

公开(公告)号：US10545950B2

公开(公告)日：2020-01-28

申请号：US15276714

申请日：2016-09-26

Applicant: Amazon Technologies, Inc.

Inventor： Brian Collins ,  Zachary Mohamed Shalla ,  Marvin Michael Theimer ,  John Petry ,  Michael Hart ,  Serge Hairanian ,  Anders Samuelsson ,  Salvador Salazar Sepulveda ,  Ji Luo

IPC: G06F16/23 ,  G06F16/21 ,  G06F16/28

Abstract: Multiple edits to a hierarchical data structure may be atomically applied. A request to perform modifications with respect to a portion or the entire hierarchical data structure may be received. A copy of the requested portion of the hierarchical data structure may be created separate from the hierarchical data structure. The portion of the hierarchical data structure may remain available for read access. Modifications may be applied to the copy of the portion of the hierarchical data structure. In response to a request to commit the modifications to the portion of the hierarchical data structure, the copy of the portion of the hierarchical data structure may atomically replace the portion of the hierarchical data structure.

公开(公告)号：US09940474B1

公开(公告)日：2018-04-10

申请号：US14869887

申请日：2015-09-29

Applicant: Amazon Technologies, Inc.

Inventor： Paul David Franklin ,  Marvin Michael Theimer

IPC: G06F21/62 ,  G06F21/60

CPC classification number: G06F21/6227

Abstract: A computer system, such as a data storage system, implements techniques for segregating and controlling access to data stored in multiple regions. In some embodiments, redundancy coded shards generated from the data and stored in durable storage of a data storage system is allocated across multiple regions, but in a fashion that prevents actors with access to regions outside that of a “home” region from recovering a sufficient number of unique shards to regenerate the data represented thereby. In some embodiments, encryption is used to segregate the data by encrypting the generated shards, then storing the cryptographic information on or otherwise controlling access on hosts or other devices of only the home region.

公开(公告)号：US09858322B2

公开(公告)日：2018-01-02

申请号：US14077162

申请日：2013-11-11

Applicant: Amazon Technologies, Inc.

Inventor： Marvin Michael Theimer ,  Gaurav D. Ghare ,  John David Dunagan ,  Greg Burgess ,  Ying Xiong

IPC: G06F17/30 ,  G06F15/173 ,  G06F17/00

CPC classification number: G06F17/30563 ,  G06F17/30073

Abstract: A programmatic interface is implemented, enabling a client of a stream management service to select a data ingestion policy for a data stream. A client request selecting an at-least-once ingestion policy is received. In accordance with the at-least-once policy, a client may transmit an indication of a data record one or more times to the service until a positive acknowledgement is received. In response to receiving a plurality of transmissions indicating a particular data record, respective positive acknowledgements are sent to the client. Based on a persistence policy selected for the stream, copies of the data record are stored at one or more storage locations in response to one particular transmission of the plurality of transmissions.

公开(公告)号：US12174854B2

公开(公告)日：2024-12-24

申请号：US17508831

申请日：2021-10-22

Applicant: Amazon Technologies, Inc.

Inventor： Srikanth Mandadi ,  Matthew Berry ,  Slavka Praus ,  Chris Baker ,  Marvin Michael Theimer ,  Anders Samuelsson ,  Khaled Salah Sedky

IPC: G06F16/27 ,  G06F16/18 ,  G06F16/23 ,  G06F16/28 ,  G06F16/901

Abstract: A distributed data store may maintain versioned hierarchical data structures. Different versions of a hierarchical data structure may be maintained consistent with a transaction log for the hierarchical data structure. When access requests directed to the hierarchical data structure are received, a version of the hierarchical data structure may be identified for processing an access request. For access requests with snapshot isolation, the identified version alone may be sufficient to consistently process the access request. For access requests with higher isolation requirements, such as serializable isolation, transactions based on the access request may be submitted to the transaction log so that access requests resulting in committed transactions may be allowed, whereas access requests resulting in conflicting transactions may be denied.

公开(公告)号：US20240419501A1

公开(公告)日：2024-12-19

申请号：US18813648

申请日：2024-08-23

Applicant: Amazon Technologies, Inc.

Inventor： Marvin Michael Theimer ,  Julien Jacques Ellie ,  Colin Watson ,  Ullas Sankhla ,  Swapandeep Singh ,  Kerry Hart ,  Paul Anderson ,  Brian Dahmen ,  Suchi Nandini ,  Yunhan Chen ,  Shu Liu ,  Arjun Raman ,  Yuxin Xie ,  Fengjia Xiong

IPC: G06F9/50 ,  G06F8/70 ,  G06F9/48 ,  G06F16/182

Abstract: Methods, systems, and computer-readable media for orchestration of computations using a remote repository are disclosed. A representation of one or more inputs to a computation is stored in a repository. The computation is assigned to one or more hosts of a plurality of hosts. A representation of program code executable to perform the computation is stored in the repository. A local copy of the one or more inputs is stored on the one or more hosts. The computation is initiated on the one or more hosts using the program code and the local copy of the one or more inputs. The computation is initiated for a plurality of keys. The computation succeeds for one or more keys after the computation has failed for one or more other keys. A representation of one or more outputs of the computation is stored in the repository.

公开(公告)号：US20230115754A1

公开(公告)日：2023-04-13

申请号：US18045045

申请日：2022-10-07

Applicant: Amazon Technologies, Inc.

Inventor： Marvin Michael Theimer ,  Julien Jacques Ellie ,  Colin Watson ,  Ullas Sankhla ,  Swapandeep Singh ,  Kerry Hart ,  Paul Anderson ,  Brian Dahmen ,  Suchi Nandini ,  Yunhan Chen ,  Shu Liu ,  Arjun Raman ,  Yuxin Xie ,  Fengjia Xiong

IPC: G06F9/50 ,  G06F8/70 ,  G06F16/182 ,  G06F9/48

Abstract: Methods, systems, and computer-readable media for orchestration of computations using a remote repository are disclosed. A representation of one or more inputs to a computation is stored in a repository. The computation is assigned to one or more hosts of a plurality of hosts. A representation of program code executable to perform the computation is stored in the repository. A local copy of the one or more inputs is stored on the one or more hosts. The computation is initiated on the one or more hosts using the program code and the local copy of the one or more inputs. The computation is initiated for a plurality of keys. The computation succeeds for one or more keys after the computation has failed for one or more other keys. A representation of one or more outputs of the computation is stored in the repository.

公开(公告)号：US10986013B1

公开(公告)日：2021-04-20

申请号：US16584848

申请日：2019-09-26

Applicant: Amazon Technologies, Inc.

Inventor： Marvin Michael Theimer ,  Joshua M. Burgin ,  Rebecca Claire Weiss ,  Brad Eugene Marshall ,  Allan Henry Vermeulen ,  Peter Sven Vosshall

IPC: G06F11/26 ,  H04L12/26 ,  G06F11/36 ,  H04L12/24

Abstract: A collection of fault categories, including faults associated with internal resources at a provider network, is presented via an interface of a fault injection service. A fault injection mode, selected from a set which comprises a non-randomized mode, to be used to inject faults into a target environment is determined. Fault injection agents introduce faults into the target environment in accordance with the fault injection mode.

公开(公告)号：US10691716B2

公开(公告)日：2020-06-23

申请号：US15665103

申请日：2017-07-31

Applicant: Amazon Technologies, Inc.

Inventor： Marvin Michael Theimer ,  Gaurav D. Ghare ,  John David Dunagan ,  Gregory M. Burgess ,  Ying Xiong

IPC: G06F16/25 ,  G06F16/00

Abstract: A partitioning policy, comprising an indication of an initial mapping of data records of a stream to a plurality of partitions, is selected to distribute data records of a data stream among a plurality of nodes of a stream management service. Data ingestion nodes and storage nodes are configured according to the initial mapping. In response to a determination that a triggering criterion for dynamically repartitioning the data stream has been met, a modified mapping is generated, and a different set of ingestion and storage nodes are configured. For at least some time during which arriving data records are stored in accordance with the modified mapping, data records stored at the first set of storage nodes in accordance with the initial mapping are retained.

公开(公告)号：US20200097489A1

公开(公告)日：2020-03-26

申请号：US16692073

申请日：2019-11-22

Applicant: Amazon Technologies, Inc.

Inventor： Brian Collins ,  Zachary Mohamed Shalla ,  Marvin Michael Theimer ,  John Petry ,  Michael Hart ,  Serge Hairanian ,  Anders Samuelsson ,  Salvador Salazar Sepulveda ,  Ji Luo

IPC: G06F16/28 ,  G06F9/50 ,  G06F16/23

Abstract: Resource data objects describing resources in a system may be maintained in multiple different hierarchies for applying policies to manage the resources. Lookup requests may access the different hierarchies to determine which policies are applicable to a given resource based on the policies identified in each of the hierarchies. Modifications to hierarchies may be performed in isolation so that the application of policies in other hierarchies is unchanged by modifications to a different hierarchy. Access restrictions may be enforced with respect to hierarchies so that different users may be permitted access to different hierarchies for system resource management.