公开(公告)号：US20240220305A1

公开(公告)日：2024-07-04

申请号：US18412105

申请日：2024-01-12

Applicant: Amazon Technologies, Inc.

Inventor： Niall Mullen ,  Philip Piwonka ,  Timothy Allen Wagner ,  Marc Brooker

IPC: G06F9/455 ,  G06F9/48 ,  G06F9/50

CPC classification number: G06F9/45558 ,  G06F9/455 ,  G06F9/45533 ,  G06F9/48 ,  G06F9/4806 ,  G06F9/4881 ,  G06F9/50 ,  G06F9/5005 ,  G06F9/5027 ,  G06F9/5038 ,  G06F2009/45562 ,  G06F2009/4557 ,  G06F2009/45575 ,  G06F2009/45591 ,  G06F2009/45595

Abstract: Systems and methods are described for providing auxiliary functions in an on-demand code execution system in a manner that enables efficient execution of code. A user may generate a task on the system by submitting code. The system may determine the auxiliary functions that the submitted code may require when executed on the system, and may provide these auxiliary functions by provisioning or configuring sidecar virtualized execution environments that work in conjunction with the main virtualized execution environment executing the submitted code. Sidecar virtualized execution environments may be identified and obtained from a library of preconfigured sidecar virtualized execution environments, or a sidecar agent that provides the auxiliary function may be identified from a library, and then a virtualized execution environment may be provisioned with the agent and/or configured to work in conjunction with the main virtualized execution environment.

公开(公告)号：US11561811B2

公开(公告)日：2023-01-24

申请号：US17181465

申请日：2021-02-22

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Allen Wagner

IPC: G06F9/445 ,  G06F9/455 ,  G06F12/02 ,  G06F9/50

Abstract: A service manages a plurality of virtual machine instances for low latency execution of user codes. The plurality of virtual machine instances can be configured based on a predetermined set of configurations. One or more containers may be created within the virtual machine instances. In response to a request to execute user code, the service identifies a pre-configured virtual machine instance suitable for executing the user code. The service can allocate the identified virtual machine instance to the user, create a new container within an instance already allocated to the user, or re-use a container already created for execution of the user code. When the user code has not been activated for a time-out period, the service can invalidate allocation of the virtual machine instance destroy the container. The time from receiving the request to beginning code execution is less than a predetermined duration, for example, 100 ms.

公开(公告)号：US20220391238A1

公开(公告)日：2022-12-08

申请号：US17578342

申请日：2022-01-18

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Allen Wagner ,  Dylan Chandler Thomas ,  Sean Philip Reque

IPC: G06F9/455 ,  G06F9/445 ,  G06F9/50

Abstract: A system for providing low latency computational capacity is provided. The system may be configured to maintain a pool of virtual machine instances, which may be assigned to users to service the requests associated with the users. The system may further be configured to receive a request to acquire compute capacity for executing a program code associated with a particular user, determine whether the pool of virtual machine instances includes a container that may be used to execute the program code therein, and cause the program code of the particular user to be executed in the container.

公开(公告)号：US11360793B2

公开(公告)日：2022-06-14

申请号：US16950694

申请日：2020-11-17

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Allen Wagner ,  Sean Philip Reque

IPC: G06F9/455 ,  G06F9/48 ,  G06F11/36 ,  H04L29/08 ,  H04L67/10

Abstract: A system for providing a stateful virtual compute system is provided. The system may be configured to maintain a plurality of virtual machine instances. The system may be further configured to receive a request to execute a program code and select a virtual machine instance to execute the program code on the selected virtual machine instance. The system may further associate the selected virtual machine instance with shared resources and allow program codes executed in the selected virtual machine instance to access the shared resources.

公开(公告)号：US11243819B1

公开(公告)日：2022-02-08

申请号：US16906553

申请日：2020-06-19

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Allen Wagner

IPC: G06F9/50 ,  G06F9/455

Abstract: A system for providing low-latency computational capacity from a virtual compute fleet is provided. The system may be configured to maintain a plurality of virtual machine instances on one or more physical computing devices, wherein the plurality of virtual machine instances comprises a first pool comprising a first sub-pool of virtual machine instances and a second sub-pool of virtual machine instances, and a second pool comprising virtual machine instances used for executing one or more program codes thereon. The first sub-pool and/or the second sub-pool may be associated with one or more users of the system. The system may be further configured to process code execution requests and execute program codes on the virtual machine instances of the first or second sub-pool.

公开(公告)号：US11010188B1

公开(公告)日：2021-05-18

申请号：US16268353

申请日：2019-02-05

Applicant: Amazon Technologies, Inc.

Inventor： Marc Brooker ,  Timothy Allen Wagner ,  Mikhail Danilov ,  Niall Mullen ,  Holly Mesrobian ,  Philip Daniel Piwonka

IPC: G06F9/455 ,  H04L29/08 ,  G06F3/06 ,  G06F11/34

Abstract: Systems and methods are described for simulated data object storage on a data storage system. The system may allow clients to store computed data objects, which are generated from a source data object based on a user-defined transformation. For example, computed data objects may be thumbnail images generated based on a full resolution image. When a request to store a computed data object is received, the system can predict a timing of a next request for the data object. If expected resource consumption associated with storing the data object until a next request exceeds expected resource consumption associated with generating the data object in response to the next request, the system can acknowledge the request to store the data object, but not actually store the data object. Instead, the system may generate the data object in response to the next request.

公开(公告)号：US10884802B2

公开(公告)日：2021-01-05

申请号：US16101144

申请日：2018-08-10

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Allen Wagner ,  Derek Steven Manwaring ,  Sean Philip Reque ,  Dylan Chandler Thomas

IPC: G06F9/455 ,  G06F9/50 ,  H04L29/08 ,  H04L29/06

Abstract: A system for routing requests to execute user code based on how frequently the user code is executed is provided. The system may be configured to receive a request to execute user code on a virtual compute system, where the virtual compute system comprises multiple fleets of virtual machine instances. The system may be further configured to determine whether the user code associated with the request satisfies one or more usage criteria, and based on the determination, route the request to the appropriate fleet of virtual machine instances.

公开(公告)号：US10884787B1

公开(公告)日：2021-01-05

申请号：US15275181

申请日：2016-09-23

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Allen Wagner ,  Marc John Brooker ,  Jonathan Paul Thompson ,  Ajay Nair

IPC: G06F9/48 ,  G06F11/36

Abstract: Systems and methods are described for implementing execution guarantees in an on-demand code execution system or other distributed code execution environment, such that the on-demand code execution system attempts to execute code only a desired number of times. The on-demand code execution system can utilize execution identifiers to distinguish between new and duplicative requests, and can decline to allocate computing resources for duplicative requests. The on-demand code execution system can further detect errors during execution, and rollback the execution to undo the execution's effects. The on-demand code execution system can then restart execution until the code has been execute the desired number of times.

公开(公告)号：US10853112B2

公开(公告)日：2020-12-01

申请号：US16544696

申请日：2019-08-19

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Allen Wagner ,  Sean Philip Reque

IPC: G06F9/455 ,  G06F9/48 ,  G06F11/36 ,  H04L29/08

Abstract: A system for providing a stateful virtual compute system is provided. The system may be configured to maintain a plurality of virtual machine instances. The system may be further configured to receive a request to execute a program code and select a virtual machine instance to execute the program code on the selected virtual machine instance. The system may further associate the selected virtual machine instance with shared resources and allow program codes executed in the selected virtual machine instance to access the shared resources.

公开(公告)号：US10824484B2

公开(公告)日：2020-11-03

申请号：US15595774

申请日：2017-05-15

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Timothy Allen Wagner ,  Ajay Nair ,  Marc John Brooker ,  Scott Daniel Wisniewski

IPC: G06F9/54 ,  G06F9/455 ,  G06F9/50 ,  G06F11/30 ,  H04L12/24

Abstract: A service manages a plurality of virtual machine instances for low latency execution of user codes. The service can provide the capability to execute user code in response to events triggered on various event sources and initiate execution of other control functions to improve the code execution environment in response to detecting errors or unexpected execution results. The service may maintain or communicate with a separate storage area for storing code execution requests that were not successfully processed by the service. Requests stored in such a storage area may subsequently be re-processed by the service.