公开(公告)号：US10942795B1

公开(公告)日：2021-03-09

申请号：US16698829

申请日：2019-11-27

Applicant: Amazon Technologies, Inc.

Inventor： David Yanacek ,  Sean Tyler Myers ,  Yogesh Aggarwal ,  Naveen Dasa Subramanyam ,  Amit Raghunath Kulkarni ,  Aritra Bandyopadhyay ,  Jianwei Cui

IPC: G06F9/54 ,  G06F16/22

Abstract: Systems and methods are described for reducing cold starts code within a serverless code execution system by providing a set of environments reserved for the code. A frontend utilizes a consistent hash ring to distribute calls for execution among a set of manager devices that manage environments in the system, distributed in a manner that groups calls together and attempts to distribute calls of the same group to a stable subset of the manager devices. Each group is assigned an arc, representing a subset of manager devices. When a call is received to execute a set of code that has environments reserved, the frontend distributes the call to a manager device of a reserved arc. When a call is received to execute a set of code that does not have environment reserved, the frontend distributes the call to an arc associated with an arc for unreserved executions.

公开(公告)号：US11119826B2

公开(公告)日：2021-09-14

申请号：US16698845

申请日：2019-11-27

Applicant: Amazon Technologies, Inc.

Inventor： David Yanacek ,  Sean Tyler Myers ,  Yogesh Aggarwal ,  Naveen Dasa Subramanyam ,  Amit Raghunath Kulkarni ,  Aritra Bandyopadhyay ,  Jianwei Cui

IPC: G06F9/46 ,  G06F9/50

Abstract: Systems and methods are described for reducing cold starts code within a serverless code execution system by providing a set of environments reserved for the code. A frontend distribute calls for execution among a set of manager devices that manage environments in the system, distributed in a manner that groups calls together and attempts to distribute calls of the same group to a stable subset of the manager devices. In the case that a user reduces or eliminates the number of environments reserved for the code, a frontend continues to distribute calls for execution of the code to those environments while they continue to be used. This reduces cold starts that might otherwise occur during reduction or elimination of reserved environments.

公开(公告)号：US11470048B1

公开(公告)日：2022-10-11

申请号：US16912485

申请日：2020-06-25

Applicant: Amazon Technologies, Inc.

Inventor： Osman Surkatty ,  David Yanacek

IPC: H04L9/40 ,  G06F9/455 ,  G06F9/48 ,  H04L12/66

Abstract: Systems and methods are described for providing on-demand virtual private environments (VPEs) to serverless code executions. Each VPE can represent a logical isolated network environment. On receiving a request to execute code, an on-demand code execution system can generate a VPE for the code and provision the VPE with network endpoints and gateways that provide access to network services and locations that the code is permitted to access, which services and locations can be identified based on permissions for the code. The on-demand code execution system can then execute the code within an execution environment attached to the VPE, such that network transmissions caused by the code are subject to network-level enforcement of the permissions for the code.

公开(公告)号：US20210157645A1

公开(公告)日：2021-05-27

申请号：US16698845

申请日：2019-11-27

Applicant: Amazon Technologies, Inc.

Inventor： David Yanacek ,  Sean Tyler Myers ,  Yogesh Aggarwal ,  Naveen Dasa Subramanyam ,  Amit Raghunath Kulkarni ,  Aritra Bandyopadhyay ,  Jianwei Cui

IPC: G06F9/50

Abstract: Systems and methods are described for reducing cold starts code within a serverless code execution system by providing a set of environments reserved for the code. A frontend distribute calls for execution among a set of manager devices that manage environments in the system, distributed in a manner that groups calls together and attempts to distribute calls of the same group to a stable subset of the manager devices. In the case that a user reduces or eliminates the number of environments reserved for the code, a frontend continues to distribute calls for execution of the code to those environments while they continue to be used. This reduces cold starts that might otherwise occur during reduction or elimination of reserved environments.