公开(公告)号：US11119809B1

公开(公告)日：2021-09-14

申请号：US16447797

申请日：2019-06-20

Applicant: Amazon Technologies, Inc.

Inventor： Marc John Brooker ,  Mikhail Danilov

IPC: G06F9/46 ,  H04L29/08

Abstract: Systems and methods are described for providing virtualized transaction retries in an on-demand network code execution system. A user may generate a task on the system by submitting code. The task may include a transaction that can succeed or fail depending on external factors, such as accessing a resource that other processes are also trying to access. The system may obtain success criteria for evaluating whether the transaction was successful, and may configure a virtual machine instance to execute the submitted code. The system may generate a “snapshot” or otherwise capture information regarding the state of the virtual machine instance prior to executing the code, and may then execute the code or a portion of it to attempt the transaction. The system may then apply the success criteria to determine whether the transaction was successful, and if not may retry the transaction by restoring the snapshot and re-executing the code.

公开(公告)号：US11115404B2

公开(公告)日：2021-09-07

申请号：US16457537

申请日：2019-06-28

Applicant: Amazon Technologies, Inc.

Inventor： Adam Charles Siefker ,  Sean Oczkowski ,  David Richardson ,  Samvid H. Dwarakanath ,  Marc John Brooker ,  Orr Weinstein

IPC: H04L29/06 ,  H04L29/08 ,  G06F9/455

Abstract: Systems and methods are described for facilitating service connections by user-defined code executing on an on-demand code execution system. Rather than hard code state information used by network services into the code, the code can be provided with an interface that augments requests for network services with state information. When the user-defined code is executed by the on-demand code execution system, additional code can also be executed that provides the interface. The user-defined code may access the target network service through the interface, as if the target network service existed locally to an environment of the code. The interface can then augment requests to the target network service with state information. Because state information is maintained outside the user-defined code, portability of the user-defined code can be increased.

公开(公告)号：US10921991B1

公开(公告)日：2021-02-16

申请号：US15385815

申请日：2016-12-20

Applicant: Amazon Technologies, Inc.

Inventor： Marc Stephen Olson ,  Christopher Magee Greenwood ,  Anthony Nicholas Liguori ,  James Michael Thompson ,  Surya Prakash Dhoolam ,  Marc John Brooker ,  Danny Wei

IPC: G06F3/06

Abstract: Notice of migration of a portion of a data volume from a first location to a second location is received by a first computer system from a second computer system, where the data volume is separated over a network from the first computer system. A third computer system, separated over a network from the first computer system, is caused to invalidate a mapping between the portion and the first location. An indication that the third computer system seeks access to the portion is identified. A third computer system is enabled, by providing a mapping between the portion and the second location, to access portion at the second location.

公开(公告)号：US10915486B1

公开(公告)日：2021-02-09

申请号：US15809622

申请日：2017-11-10

Applicant: Amazon Technologies, Inc.

Inventor： Asif Khan ,  Thomas A. Volpe ,  Marc John Brooker ,  Marc Stephen Olson ,  Norbert Paul Kusters ,  Mark Bradley Davis ,  Robert Michael Johnson

IPC: G06F13/42 ,  G11C15/00 ,  G06F11/10

Abstract: Server computers often include one or more input/output (I/O) devices for communicating with a network or directly attached storage device. The data transfer latency for request can be reduced by utilizing ingress data placement logic to bypass the processor of the I/O device. For example, host memory descriptors can be stored in a memory of the I/O device to facilitate placement of the requested data.

公开(公告)号：US10884787B1

公开(公告)日：2021-01-05

申请号：US15275181

申请日：2016-09-23

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Allen Wagner ,  Marc John Brooker ,  Jonathan Paul Thompson ,  Ajay Nair

IPC: G06F9/48 ,  G06F11/36

Abstract: Systems and methods are described for implementing execution guarantees in an on-demand code execution system or other distributed code execution environment, such that the on-demand code execution system attempts to execute code only a desired number of times. The on-demand code execution system can utilize execution identifiers to distinguish between new and duplicative requests, and can decline to allocate computing resources for duplicative requests. The on-demand code execution system can further detect errors during execution, and rollback the execution to undo the execution's effects. The on-demand code execution system can then restart execution until the code has been execute the desired number of times.

公开(公告)号：US10824484B2

公开(公告)日：2020-11-03

申请号：US15595774

申请日：2017-05-15

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Timothy Allen Wagner ,  Ajay Nair ,  Marc John Brooker ,  Scott Daniel Wisniewski

IPC: G06F9/54 ,  G06F9/455 ,  G06F9/50 ,  G06F11/30 ,  H04L12/24

Abstract: A service manages a plurality of virtual machine instances for low latency execution of user codes. The service can provide the capability to execute user code in response to events triggered on various event sources and initiate execution of other control functions to improve the code execution environment in response to detecting errors or unexpected execution results. The service may maintain or communicate with a separate storage area for storing code execution requests that were not successfully processed by the service. Requests stored in such a storage area may subsequently be re-processed by the service.

公开(公告)号：US10721181B1

公开(公告)日：2020-07-21

申请号：US14643906

申请日：2015-03-10

Applicant: Amazon Technologies, Inc.

Inventor： Christopher Magee Greenwood ,  Surya Prakash Dhoolam ,  Marc John Brooker ,  Mitchell Gannon Flaherty

IPC: H04L12/911 ,  H04L12/26

Abstract: A distributed system may implement network locality-based throttling for automatic resource migration. Utilization of a distributed system that includes multiple resources at multiple resource hosts may be monitored. New migration operations to migrate a resource in the distributed system may be evaluated with respect a migration operation limit for one or more network localities of the distributed system. If the migration operation limit for the one or more network localities is exceeded, then the new migration operations may be throttled. Different network localities may have different migration operation limits.

公开(公告)号：US10713080B1

公开(公告)日：2020-07-14

申请号：US16045584

申请日：2018-07-25

Applicant: Amazon Technologies, Inc.

Inventor： Marc John Brooker ,  Mikhail Danilov ,  Anthony Nicholas Liguori

IPC: G06F9/455 ,  H04L29/08

Abstract: Systems and methods are described for selectively transitioning execution environments in an on-demand code execution system based on a timing of a next request to execute code within such environments. The system can predict, from a history of requests to the system, when a next call to execute code in an environment, such as a virtual machine instance, will occur. The system can then calculate and compare the relative costs of maintaining the environment in an executing state or of halting the environment and moving the environment to a lower tier of memory, each of which can be based on the predicted next call to execute code within the environment. If the relative cost of maintaining the environment in an executing state exceeds that of halting the environment and moving the environment to a lower tier of memory, the virtual machine is halted and transitioned to secondary memory.

公开(公告)号：US10565227B1

公开(公告)日：2020-02-18

申请号：US15253677

申请日：2016-08-31

Applicant: Amazon Technologies, Inc.

Inventor： Tao Chen ,  Marc John Brooker ,  Divya Ashok Kumar Jain ,  Norbert Paul Kusters ,  Fan Ping ,  Lakshmi N. Pallikila

IPC: G06F17/30 ,  G06F16/27

Abstract: Data replication groups may be used to store data in a distributed computing environment. A data replication group may include a set of nodes executing a consensus protocol to maintain data durably. In order to increase efficiency and performance of the data replication, a particular node of the data replication group may be assigned the role of master node. The role of master node may be lease in accordance with a consensus protocol. If the lease is not renewed within an interval of time election/selection of a new master node may be commenced.

公开(公告)号：US10564946B1

公开(公告)日：2020-02-18

申请号：US15841143

申请日：2017-12-13

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Allen Wagner ,  Bryan Nicholas Moffatt ,  Marc John Brooker ,  Robison Rodrigues dos Santos ,  Niranjan Jayakar

IPC: G06F9/44 ,  G06F8/41

Abstract: Systems and methods are described for managing dependencies among code in an on-demand code execution system in a manner that enables efficient execution of the code. A user may generate a task on the system by submitting code, which may reference additional code on the system. The system can determine a dependency graph for the submitted code, and generate packages for the task based at least partly on the dependency graph. On receiving a request to execute the task, the system can provision an execution environment with the packages, and execute the code of the task. The packages may be selected based on analysis of the dependency graph, such that execution of the task on the on-demand code execution system is expected to satisfy a desired execution metric, which may include a maximum time to begin executing code of a task subsequent to receiving a request to execute the task.