Inference flow orchestration service

    公开(公告)号:US11900169B1

    公开(公告)日:2024-02-13

    申请号:US17230784

    申请日:2021-04-14

    CPC classification number: G06F9/505 G06F16/9024 G06N20/00

    Abstract: Descriptors of machine learning tasks to be used to respond to analysis requests, indicating acceptable categories of runtime environments for the tasks and metrics to be collected from the tasks, are received via programmatic interfaces. In response to an analysis request, an orchestrator receives results from individual tasks as they become available, provides the results to other tasks, and causes a response to the request to be prepared using results from at least a subset of the tasks. Metrics collected from the tasks, and a visual representation of the tasks indicating their runtime environments are presented.

    Inference flow orchestration service

    公开(公告)号:US12197958B2

    公开(公告)日:2025-01-14

    申请号:US18408405

    申请日:2024-01-09

    Abstract: Descriptors of machine learning tasks to be used to respond to analysis requests, indicating acceptable categories of runtime environments for the tasks and metrics to be collected from the tasks, are received via programmatic interfaces. In response to an analysis request, an orchestrator receives results from individual tasks as they become available, provides the results to other tasks, and causes a response to the request to be prepared using results from at least a subset of the tasks. Metrics collected from the tasks, and a visual representation of the tasks indicating their runtime environments are presented.

    INFERENCE FLOW ORCHESTRATION SERVICE
    3.
    发明公开

    公开(公告)号:US20240152402A1

    公开(公告)日:2024-05-09

    申请号:US18408405

    申请日:2024-01-09

    CPC classification number: G06F9/505 G06F16/9024 G06N20/00

    Abstract: Descriptors of machine learning tasks to be used to respond to analysis requests, indicating acceptable categories of runtime environments for the tasks and metrics to be collected from the tasks, are received via programmatic interfaces. In response to an analysis request, an orchestrator receives results from individual tasks as they become available, provides the results to other tasks, and causes a response to the request to be prepared using results from at least a subset of the tasks. Metrics collected from the tasks, and a visual representation of the tasks indicating their runtime environments are presented.

Patent Agency Ranking