公开(公告)号：US10102040B2

公开(公告)日：2018-10-16

申请号：US15197670

申请日：2016-06-29

Applicant: Amazon Technologies, Inc.

Inventor： Dylan Owen Marriner ,  Mauricio Roman ,  Marc John Brooker ,  Julian Embry Herwitz ,  Sean Reque

IPC: G06F9/46 ,  G06F9/50 ,  G06F9/455

Abstract: Systems and methods are described for adjusting a number of concurrent code executions allowed to be performed for a given user on an on-demand code execution environment or other distributed code execution environments. Such environments utilize pre-initialized virtual machine instances to enable execution of user-specified code in a rapid manner, without delays typically caused by initialization of the virtual machine instances. However, to improve utilization of computing resources, such environments may temporarily restrict the number of concurrent code executions performed on behalf of the given user to a number less than the maximum number of concurrent code executions allowed for the given user. Such environments may adjust the temporary restriction on the number of concurrent code executions based on the number of incoming code execution requests associated with the given user.

公开(公告)号：US10657061B1

公开(公告)日：2020-05-19

申请号：US15720670

申请日：2017-09-29

Applicant: Amazon Technologies, Inc.

Inventor： Dylan Owen Marriner

IPC: H04L12/24 ,  G06F12/0864 ,  G06Q10/06 ,  G06F12/1018 ,  H05K7/14 ,  H04L29/08 ,  G06F9/50

Abstract: A hash ring is used to determine and deploy configurations for a computer system for servicing customer requests. A worker manager managing a set of worker computing systems is deployed and associated with the hash ring. Various aspects of the computer system may be implemented according to configuration information for one or more attributes. Predecessor information is determined and used to obtain state information in connection with the configuration information.

公开(公告)号：US09977691B2

公开(公告)日：2018-05-22

申请号：US15197668

申请日：2016-06-29

Applicant: Amazon Technologies, Inc.

Inventor： Dylan Owen Marriner ,  Mauricio Roman ,  Marc John Brooker ,  Julian Embry Herwitz ,  Sean Reque

IPC: G06F9/455 ,  G06F9/50

CPC classification number: G06F9/45558 ,  G06F9/5077 ,  G06F9/5083 ,  G06F2009/4557 ,  G06F2009/45595

Abstract: Systems and methods are described for adjusting a number of concurrent code executions allowed to be performed for a given user on an on-demand code execution environment or other distributed code execution environments. Such environments utilize pre-initialized virtual machine instances to enable execution of user-specified code in a rapid manner, without delays typically caused by initialization of the virtual machine instances. However, to improve utilization of computing resources, such environments may temporarily restrict the number of concurrent code executions performed on behalf of the given user to a number less than the maximum number of concurrent code executions allowed for the given user. Such environments may adjust the temporary restriction on the number of concurrent code executions based on the number of incoming code execution requests associated with the given user and based on communication among the frontends processing the incoming code execution requests.

公开(公告)号：US12015603B2

公开(公告)日：2024-06-18

申请号：US17643784

申请日：2021-12-10

Applicant: Amazon Technologies, Inc.

Inventor： Mikhail Danilov ,  Deepthi Chelupati ,  David Nasi ,  Dylan Owen Marriner ,  Suganya Rajendran ,  Sean Tyler Myers

IPC: H04L29/06 ,  G06F9/50 ,  H04L9/40

CPC classification number: H04L63/083 ,  G06F9/5077 ,  H04L63/20

Abstract: Systems and methods are described for a multi-tenant mode of a serverless code execution system. For instance, a method may include maintaining a set of execution environments, wherein each execution environment is associated with a serverless function, wherein the serverless function is associated with a software as a service (SaaS) provider that is a tenant of a cloud services provider, wherein the SaaS provider provides services to sub-tenants, wherein the set of execution environments are partitioned based on sub-tenants of the SaaS provider; receiving a call to execute a serverless function, wherein the call includes a serverless function identifier and a sub-tenant identifier; identifying a sub-tenant-specific execution environment of the set of execution environments that is associated with the sub-tenant; and in response to identifying the tenant-specific execution environment, invoking the serverless function on the sub-tenant-specific execution environment.

公开(公告)号：US20230188516A1

公开(公告)日：2023-06-15

申请号：US17643784

申请日：2021-12-10

Applicant: Amazon Technologies, Inc.

Inventor： Mikhail Danilov ,  Deepthi Chelupati ,  David Nasi ,  Dylan Owen Marriner ,  Suganya Rajendran ,  Sean Tyler Myers

IPC: H04L9/40 ,  G06F9/50

CPC classification number: H04L63/083 ,  G06F9/5077 ,  H04L63/20

Abstract: Systems and methods are described for a multi-tenant mode of a serverless code execution system. For instance, a method may include maintaining a set of execution environments, wherein each execution environment is associated with a serverless function, wherein the serverless function is associated with a software as a service (SaaS) provider that is a tenant of a cloud services provider, wherein the SaaS provider provides services to sub-tenants, wherein the set of execution environments are partitioned based on sub-tenants of the SaaS provider; receiving a call to execute a serverless function, wherein the call includes a serverless function identifier and a sub-tenant identifier; identifying a sub-tenant-specific execution environment of the set of execution environments that is associated with the sub-tenant; and in response to identifying the tenant-specific execution environment, invoking the serverless function on the sub-tenant-specific execution environment.

公开(公告)号：US11144359B1

公开(公告)日：2021-10-12

申请号：US16447725

申请日：2019-06-20

Applicant: Amazon Technologies, Inc.

Inventor： Marc John Brooker ,  Dylan Owen Marriner

IPC: G06F9/50 ,  G06F9/455

Abstract: Systems and methods are described for managing reuse of sandboxed computing environments in a network-based on-demand code execution system. Users may generate tasks on the system by submitting code to a frontend, which may interact with multiple worker managers that manage task execution in sandboxed computing environments such as containers or virtual machine instances. A sandbox may be reusable once provisioned, but the resources required to definitively locate an idle sandbox may be significant relative to the cost of provisioning a new sandbox. The system may therefore manage reuse by randomly or semi-randomly selecting a worker manager and requesting that it provide an existing sandbox if one is available. If not, then the system may select a different worker manager and repeat the request, or after consuming a threshold amount of resources may request that the next worker manager provision a new sandbox if an existing one is not available.

公开(公告)号：US20200057680A1

公开(公告)日：2020-02-20

申请号：US16552535

申请日：2019-08-27

Applicant: Amazon Technologies, Inc.

Inventor： Dylan Owen Marriner ,  Mauricio Roman ,  Marc John Brooker ,  Julian Embry Herwitz ,  Sean Reque

IPC: G06F9/50 ,  G06F9/455

Abstract: Systems and methods are described for adjusting a number of concurrent code executions allowed to be performed for a given user on an on-demand code execution environment or other distributed code execution environments. Such environments utilize pre-initialized virtual machine instances to enable execution of user-specified code in a rapid manner, without delays typically caused by initialization of the virtual machine instances. However, to improve utilization of computing resources, such environments may temporarily restrict the number of concurrent code executions performed on behalf of the given user to a number less than the maximum number of concurrent code executions allowed for the given user. Such environments may adjust the temporary restriction on the number of concurrent code executions based on the number of incoming code execution requests associated with the given user.

公开(公告)号：US11263000B2

公开(公告)日：2022-03-01

申请号：US16779326

申请日：2020-01-31

Applicant: Amazon Technologies, Inc.

Inventor： Dylan Owen Marriner

IPC: G06F8/65

Abstract: An event-driven compute service upgrades an execution environment for registered functions of the compute service. Some compute nodes of the service have an updated version of the execution environment and some compute nodes have the old version of the execution environment. As a part of the upgrade process, some functions are executed in both environments. For example, for some invocations of a particular function, the function is executed in the updated execution environment while for other invocations of the same function, the function is executed in the old execution environment. Based on resulting status of the executions, the compute service determines that the particular function is compatible or incompatible with the updated version of the execution environment. The compute service performs subsequent executions of incompatible functions in the old version of the execution environment instead of in the updated version. A client may be notified of the incompatibility.

公开(公告)号：US10938668B1

公开(公告)日：2021-03-02

申请号：US15283192

申请日：2016-09-30

Applicant: Amazon Technologies, Inc.

Inventor： Matthew Joseph Zulak ,  Marc John Brooker ,  Dylan Owen Marriner ,  Julian Embry Herwitz ,  Mauricio Roman ,  Guanghao Ding ,  Sanath Kumar Ramesh

IPC: H04L12/24 ,  H04L29/08 ,  G06F9/48 ,  H04L12/803

Abstract: Computing resource service providers operate various services used to provide functionality to customers and other computing resources operated by various entities. These services may use consistent hash rings to direct a request to a particular worker. Previous versions of the consistent hash ring may be maintained such that predecessor information can be determined. When a request is received the request and predecessor information may be provided to a worker manager. The worker manager may utilize the predecessor information to obtain state information from a predecessor worker manager. The state information may then be used to process the request.

公开(公告)号：US10552141B1

公开(公告)日：2020-02-04

申请号：US15905675

申请日：2018-02-26

Applicant: Amazon Technologies, Inc.

Inventor： Dylan Owen Marriner

IPC: G06F9/44 ,  G06F8/65

Abstract: An event-driven compute service upgrades an execution environment for registered functions of the compute service. Some compute nodes of the service have an updated version of the execution environment and some compute nodes have the old version of the execution environment. As a part of the upgrade process, some functions are executed in both environments. For example, for some invocations of a particular function, the function is executed in the updated execution environment while for other invocations of the same function, the function is executed in the old execution environment. Based on resulting status of the executions, the compute service determines that the particular function is compatible or incompatible with the updated version of the execution environment. The compute service performs subsequent executions of incompatible functions in the old version of the execution environment instead of in the updated version. A client may be notified of the incompatibility.