SYSTEMS AND METHODS FOR CONTINUED EDGE RESOURCE DEMAND LOAD ESTIMATION

    公开(公告)号:US20240303129A1

    公开(公告)日:2024-09-12

    申请号:US18366538

    申请日:2023-08-07

    CPC classification number: G06F9/505 G06F9/5072

    Abstract: Managing the resource demand load for edge systems is significantly more complex than for other systems, such as cloud environments. Embodiments herein provide edge resource demand load estimation systems and methods that inform scheduling and associated edge orchestration to ensure that edge system resource capacity is appropriately utilized. Efficient utilization allows an increased number of applications to be deployed at a reduced level of reserved resources. Also presented are embodiments of assurance mechanisms for monitoring edge resource demand load characterizations. In one or more embodiments, when an estimate or estimates are deemed to not be valid (e.g., having experienced stationary drift), updated estimates may be obtained.

    SYSTEMS AND METHODS FOR HYPERGRAPH EDGE RESOURCE DEMAND LOAD REPRESENTATION

    公开(公告)号:US20240303128A1

    公开(公告)日:2024-09-12

    申请号:US18366507

    申请日:2023-08-07

    CPC classification number: G06F9/505

    Abstract: Managing the resource demand load for edge systems is significantly more complex than for other systems, such as cloud environments. A time period in which an application or task is operating based on initial demand resource load values that are provided by a customer may be inaccurate, which may expose sub-standard execution. Embodiments herein seek to significantly mitigate the potential of sub-standard execution. Embodiments collect a repository of resource demand load usage data over a time period that can be used to accurately determine the statistical moments of uncertain resource demand load. In one or more embodiments, a repository of hypervector and/or hyperspace representations may be generated and used to help with resource demand load estimation.

    SYSTEMS AND METHODS FOR EDGE RESOURCE DEMAND LOAD ESTIMATION

    公开(公告)号:US20240303134A1

    公开(公告)日:2024-09-12

    申请号:US18366549

    申请日:2023-08-07

    CPC classification number: G06F9/5083

    Abstract: Managing the resource demand load for edge systems is significantly more complex than for other systems, such as cloud environments. Embodiments herein provide edge resource demand load estimation systems and methods that inform scheduling and associated edge orchestration to ensure that edge system resource capacity is appropriately utilized. Efficient utilization allows an increased number of applications to be deployed at a reduced level of reserved resources. Also presented are embodiments of assurance mechanisms for monitoring edge resource demand load characterizations. In one or more embodiments, when an estimate or estimates are deemed to not be valid (e.g., having experienced stationary drift), updated estimates may be obtained.

    SYSTEMS AND METHODS FOR HYPERGRAPH EDGE RESOURCE DEMAND KNOWLEDGE MANAGEMENT

    公开(公告)号:US20240303121A1

    公开(公告)日:2024-09-12

    申请号:US18366520

    申请日:2023-08-07

    CPC classification number: G06F9/5027

    Abstract: Managing the resource demand load for edge systems is significantly more complex than for other systems, such as cloud environments. A time period in which an application or task is operating based on initial demand resource load values that are provided by a customer may be inaccurate, which may expose sub-standard execution. Embodiments herein seek to significantly mitigate the potential of sub-standard execution. Embodiments collect a repository of resource demand load usage data over a time period that can be used to accurately determine the statistical moments of uncertain resource demand load. In one or more embodiments, a repository of hypervector and/or hyperspace representations may be generated and used to help with resource demand load estimation.

    SYSTEMS AND METHODS FOR EDGE SYSTEM RESOURCE CAPACITY DYNAMIC POLICY PLANNING FRAMEWORK

    公开(公告)号:US20240305535A1

    公开(公告)日:2024-09-12

    申请号:US18366490

    申请日:2023-08-07

    CPC classification number: H04L41/145 H04L41/5025

    Abstract: Managing the resource demand load for edge systems is significantly more complex than for other systems, such as cloud environments. Unlike cloud systems and other frameworks that are able to use closed-form solutions based on Poisson processes or other tractable Gaussian-based probability distributions, edge systems present complex waveforms, pareto/alpha-stable distributions, and long-range dependence. Based on elaborately designed embodiments that recognize the complexities of edge data, one can estimate scaling and multi-fractal dimensionality to determine predictive models.

    SYSTEMS AND METHODS FOR EDGE RESOURCE DEMAND LOAD SCHEDULING

    公开(公告)号:US20240303130A1

    公开(公告)日:2024-09-12

    申请号:US18366555

    申请日:2023-08-07

    CPC classification number: G06F9/505 G06F9/4881 G06F9/5038

    Abstract: Managing the resource demand load for edge systems is significantly more complex than for other systems, such as cloud environments. Edge resource demand load scheduling systems and methods are disclosed that can ensure that edge systems operate smoothly and efficiently while balancing multiple scheduling objectives. Scheduling techniques disclosed herein may utilize heuristic rules for candidate edge system selection (e.g., utilizing ARMA/ARIMA averages and/or service level objectives) and modified best fit decreasing (mBFD) assignment/allocation techniques.

    EDGE DOMAIN-SPECIFIC ACCELERATOR VIRTUALIZATION AND SCHEDULING

    公开(公告)号:US20240303124A1

    公开(公告)日:2024-09-12

    申请号:US18355351

    申请日:2023-07-19

    CPC classification number: G06F9/5038

    Abstract: Presented herein are embodiments to implement a temporal queueing system with class-based fair queuing and dynamic resource allocation based on a novel look-ahead capability to manage various models and workloads for utilization/efficiency improvements. Embodiments may be implemented to allocate accelerator resources based on platform-defined timeslots, and therefore significantly increase the ability of workloads to access hardware accelerator resources. Training and inference may be supported with flexible preemption and the ability to support run-to-completion for training tasks while still supporting non-run-to-completion for inference tasks. Embodiments may be implemented by an edge software operation platform through virtual accelerators to allow emulation of different types of hardware accelerators and to map to the hardware accelerators with hardware-specific procedures managed by an edge orchestrator and an edge endpoint. Accordingly, embodiments of the present disclosure reduce the requirements for the workload to manage platform capacity and hardware.

Patent Agency Ranking