Generating and deploying packages for machine learning at edge devices

    公开(公告)号:US12293260B2

    公开(公告)日:2025-05-06

    申请号:US15884279

    申请日:2018-01-30

    Abstract: A provider network implements a machine learning deployment service for generating and deploying packages to implement machine learning at connected devices. The service may receive from a client an indication of an inference application, a machine learning framework to be used by the inference application, a machine learning model to be used by the inference application, and an edge device to run the inference application. The service may then generate a package based on the inference application, the machine learning framework, the machine learning model, and a hardware platform of the edge device. To generate the package, the service may optimize the model based on the hardware platform of the edge device and/or the machine learning framework. The service may then deploy the package to the edge device. The edge device then installs the inference application and performs actions based on inference data generated by the machine learning model.

    Determining IoT device compatibility with deployments

    公开(公告)号:US11671325B1

    公开(公告)日:2023-06-06

    申请号:US15801264

    申请日:2017-11-01

    Abstract: A provider network implements a service for receiving a request for a deployment from an IoT device and determining whether the IoT device is compatible with a deployment. The service may determine a configuration of the IoT device based on configuration information included in the request for the deployment. The service may then determine whether the configuration of the connected device satisfies configuration requirements for one or more components (e.g., functions) required for the deployment. In some cases, a particular version of a plurality of versions of a function may be compatible with the connected device. If the service determines that the IoT device is compatible with all of the components that are required for the deployment, then the service may generate a package that includes all of the components. The service may then deploy the package to the IoT device.

    LOCAL DATA CLASSIFICATION BASED ON A REMOTE SERVICE INTERFACE

    公开(公告)号:US20230073638A1

    公开(公告)日:2023-03-09

    申请号:US18055324

    申请日:2022-11-14

    Abstract: A connected device at a client network implements a local data classification service for classifying data based on a data classification service of a remote provider network. The local data classification service receives a request to classify data at one or more data sources of the client network. The request is initiated from a client device of the client network according to a management interface for a data classification service of a remote provider network (e.g., using the same API request used by the remote classification service). The local data classification service obtains at least some of the data from the one or more data sources of the client network. The local data classification service classifies the obtained data according to different types of sensitivity using the data classification engine in the execution environment without the data being exposed outside of a data isolation boundary of the client network.

    Overriding shared service interfaces

    公开(公告)号:US10817280B1

    公开(公告)日:2020-10-27

    申请号:US15985398

    申请日:2018-05-21

    Abstract: Technologies are described for a local interface override that allows a program code function to be executed on a computing hub and interface with a local service located on the computing hub. An example method may include loading, on a computing hub included in a local device network, a program code function configured to interface with a shared service located in a service provider environment. Loading a local library to overlay a service provider library, where the local library provides a local service interface for a local service located on the computing hub that is similar to a shared service interface for the shared service. Overriding the service provider library with the local library in response to service requests generated by the instance of the program code function; thereby providing the local service interface for the local service located on the computing hub.

    Adaptive quorum for a message broker service

    公开(公告)号:US10701167B1

    公开(公告)日:2020-06-30

    申请号:US15255130

    申请日:2016-09-01

    Abstract: A technology is provided for adapting a quorum size of messaging nodes in a service provider environment. An adaptive quorum evaluation is executed to determine a number of messaging nodes for a quorum of messaging nodes. A messaging environment trigger is identified to change the number of messaging nodes used for the quorum of messaging nodes. The number of messaging nodes used for the quorum of messaging nodes is changed based on the messaging environment trigger. Data for the message is synchronized with a quorum of messaging nodes before delivering the message.

Patent Agency Ranking