Predictive management of on-demand code execution

    公开(公告)号:US10365985B2

    公开(公告)日:2019-07-30

    申请号:US15804761

    申请日:2017-11-06

    Abstract: Systems and methods are described for monitoring code execution within an on-demand code execution environment or other distributed code execution environment. The distributed, asynchronous nature of such environment can make determining the interactions between code executions difficult relative to traditional, non-distributed systems. The present disclosure enables the interrelations between code executions to be monitored by injecting monitoring information into the calls between those code executions. The monitoring information may be propagated through calls, such that a “path” or “trace” of code executions and calls can be determined. Data generated based on the monitoring information can be used to generate a profile for a set of code, so that a developer or other user may easily debug or optimize execution of the code.

    CODE EXECUTION REQUEST ROUTING
    12.
    发明申请

    公开(公告)号:US20190227849A1

    公开(公告)日:2019-07-25

    申请号:US16372108

    申请日:2019-04-01

    Abstract: A system for providing low-latency compute capacity is provided. The system may be configured to route incoming code execution requests based on user indications to use specific containers running on a plurality of virtual machine instances. The system may be configured to process a code execution request, identify, based on the user indication that a specific container previously used to handle a request of similar type is to be used for handling the code execution request, and cause the code execution request to be handled using the specific container.

    PROCESSING EVENT MESSAGES FOR USER REQUESTS TO EXECUTE PROGRAM CODE

    公开(公告)号:US20190196884A1

    公开(公告)日:2019-06-27

    申请号:US16223934

    申请日:2018-12-18

    Abstract: A service manages a plurality of virtual machine instances for low latency execution of user codes. The service can provide the capability to execute user code in response to events triggered on an auxillary service to provide implicit and automatic rate matching and scaling between events being triggered on the auxiliary service and the corresponding execution of user code on various virtual machine instances. An auxiliary service may be configured as an event triggering service to detect events and generate event messages for execution of the user codes. The service can request, receive, or poll for event messages directly from the auxiliary service or via an intermediary message service. Event messages can be rapidly converted to requests to execute user code on the service. The time from processing the event message to initiating a request to begin code execution is less than a predetermined duration, for example, 100 ms.

    On-demand network code execution with cross-account aliases

    公开(公告)号:US10203990B2

    公开(公告)日:2019-02-12

    申请号:US15199613

    申请日:2016-06-30

    Abstract: Systems and methods are described for utilizing cross-account access to tasks on an on-demand code execution environment or other distributed code execution environment to implement an application programming interface (API) on a network-accessible service. An on-demand code execution environment can utilize pre-initialized virtual machine instances to enable execution of user-specified code in a rapid manner, without delays typically caused by initialization of the virtual machine instances. While users may generally execute their own code, the present application enables code of a first user to be executed by a second user, while maintaining the privacy and security of the code and associated accounts. Further, the present application enables a set of tasks to be grouped together as an API, enabling any user to create an API for a service, while the on-demand code execution environment manages execution of the tasks and allocation of underlying computing resources.

    Management of periodic requests for compute capacity

    公开(公告)号:US10042660B2

    公开(公告)日:2018-08-07

    申请号:US14871368

    申请日:2015-09-30

    Abstract: A system for monitoring incoming code execution requests and scheduling the corresponding code executions is provided. The system may be configured to maintain a plurality of virtual machine instances. The system may be further configured to determine whether at least some of the incoming code execution requests exhibit periodicity, and cause a reduced amount of idle compute capacity to be maintained on the virtual compute system. The system may be further configured to cause additional compute capacity to be added shortly before code execution requests are expected to be received.

    Metaevent handling for on-demand code execution environments

    公开(公告)号:US09928108B1

    公开(公告)日:2018-03-27

    申请号:US14869801

    申请日:2015-09-29

    Abstract: Systems and methods are described for generating and executing metaevents within an on-demand code execution environment. The code execution environment can include virtual machine instances that are pre-initialized to enable low latency execution of arbitrary user-defined code. Code execution can typically occur in response to a defined event trigger, such as a call to an application programming interface (API) from an external source. Code execution may also occur in response to metadata regarding the operation of the code execution environment. A user may specify criteria for “metaevents” based on the metadata, and also specify code to be executed in response to satisfaction of the criteria. When the code execution environment determines that the user's criteria is satisfied, a metaevent may be generated that causes execution of the set of code. This execution may, in turn, generate metadata that triggers one or more metaevents.

    DYNAMIC CODE DEPLOYMENT AND VERSIONING
    17.
    发明申请

    公开(公告)号:US20180039506A1

    公开(公告)日:2018-02-08

    申请号:US15658038

    申请日:2017-07-24

    Abstract: A system for providing dynamic code deployment and versioning is provided. The system may be configured to receive a first request to execute a newer program code on a virtual compute system, determine, based on the first request, that the newer program code is a newer version of an older program code loaded onto an existing container on a virtual machine instance on the virtual compute system, initiate a download of the newer program code onto a second container on the same virtual machine instance, and causing the first request to be processed with the older program code in the existing container.

    ASYNCHRONOUS TASK MANAGEMENT IN AN ON-DEMAND NETWORK CODE EXECUTION ENVIRONMENT

    公开(公告)号:US20170371706A1

    公开(公告)日:2017-12-28

    申请号:US15195897

    申请日:2016-06-28

    CPC classification number: G06F9/52 G06F9/485

    Abstract: Systems and methods are described for managing asynchronous code executions in an on-demand code execution system or other distributed code execution environment, in which multiple execution environments, such as virtual machine instances, can be used to enable rapid execution of user-submitted code. When asynchronous executions occur, one execution may become blocked while waiting for completion of another execution. Because the on-demand code execution system contains multiple execution environments, the system can efficiently handle a blocked execution by saving a state of the execution, and removing it from its execution environment. When a blocking dependency operation completes, the system can resume the blocked execution using the state information, in the same or different execution environment.

    Endpoint management system and virtual compute system

    公开(公告)号:US09785476B2

    公开(公告)日:2017-10-10

    申请号:US14682046

    申请日:2015-04-08

    Abstract: A system for integrating an endpoint management system and a virtual compute system is provided. The system may be configured to receive a first request to execute a proxy application programming interface (API) associated with a first resource of a plurality of resources maintained by the endpoint management system, determine, based at least in part on the first request and the proxy API, an API mapping definition associated with the proxy API, output a second request to execute a program code on the virtual compute system based on the API mapping definition associated with the proxy API, wherein the second request contains information associated with the first resource, receive a first response from the virtual compute system, wherein the first response contains information regarding the first resource, and output a second response based on the first response received from the virtual compute system.

Patent Agency Ranking