Variable timeslices for processing latency-dependent workloads
    1.
    发明授权
    Variable timeslices for processing latency-dependent workloads 有权
    用于处理与延迟相关的工作负载的可变时间片

    公开(公告)号:US09529633B2

    公开(公告)日:2016-12-27

    申请号:US14484197

    申请日:2014-09-11

    Abstract: A virtualization host may implement variable timeslices for processing latency dependent workloads. Multiple virtual compute instances on a virtualization host may utilize virtual central processing units (vCPUs) to obtain physical processing resources, such as one or more central processing units (CPUs). A vCPU currently utilizing a CPU to performing processing work according to a scheduled timeslice may be preempted by a latency dependent vCPU before completion of the scheduled timeslice. The latency-dependent vCPU may complete processing work, and utilization of the CPU may be returned to the vCPU. A preemption compensation may be determined for the scheduled timeslice to increase the scheduled timeslice for the vCPU such that utilization for the vCPU is performed according to the increased scheduled timeslice.

    Abstract translation: 虚拟化主机可以实现可变时间片,用于处理与延迟相关的工作负载。 虚拟化主机上的多个虚拟计算实例可以利用虚拟中央处理单元(vCPU)来获得诸如一个或多个中央处理单元(CPU)的物理处理资源。 目前正在利用CPU执行根据调度的时间片的处理工作的vCPU可以在完成预定时间片之前被等待时间依赖的vCPU抢占。 等待时间依赖的vCPU可能完成处理工作,CPU的利用可能返回给vCPU。 可以为预定时间片确定抢占补偿以增加vCPU的调度时间片,以便根据增加的预定时间片来执行vCPU的利用。

    Compute platform optimization across heterogeneous hardware in a distributed computing environment

    公开(公告)号:US11128696B2

    公开(公告)日:2021-09-21

    申请号:US16367914

    申请日:2019-03-28

    Abstract: Techniques for an optimization service of a service provider network to help optimize the selection, configuration, and utilization, of virtual machine (VM) instance types to support workloads on behalf of users. The optimization service may implement the techniques described herein at various stages in a life cycle of a workload to help optimize the performance of the workload, and reduce underutilization of computing resources. For example, the optimization service may perform techniques to help new users select an optimized VM instance type on which to initially launch their workload. Further, the optimization service may monitor a workload for the life of the workload, and determine new VM instance types, and/or configuration modifications, that optimize the performance of the workload. The optimization service may provide recommendations to users that help improve performance of their workloads, and that also increase the aggregate utilization of computing resources of the service provider network.

    Optimizing hardware platform utilization for heterogeneous workloads in a distributed computing environment

    公开(公告)号:US11068312B2

    公开(公告)日:2021-07-20

    申请号:US16368072

    申请日:2019-03-28

    Abstract: Techniques for an optimization service of a service provider network to help optimize the selection, configuration, and utilization, of virtual machine (VM) instance types to support workloads on behalf of users. The optimization service may implement the techniques described herein at various stages in a life cycle of a workload to help optimize the performance of the workload, and reduce underutilization of computing resources. For example, the optimization service may perform techniques to help new users select an optimized VM instance type on which to initially launch their workload. Further, the optimization service may monitor a workload for the life of the workload, and determine new VM instance types, and/or configuration modifications, that optimize the performance of the workload. The optimization service may provide recommendations to users that help improve performance of their workloads, and that also increase the aggregate utilization of computing resources of the service provider network.

    Virtual machine migration
    4.
    发明授权

    公开(公告)号:US10698721B2

    公开(公告)日:2020-06-30

    申请号:US16194097

    申请日:2018-11-16

    Abstract: Migrating servers from client networks to virtual machines (VMs) on a provider network. A migration appliance is installed or booted on the client network, and a migration initiator is instantiated on the provider network. A VM and associated volumes are instantiated on the provider network. The initiator sends a request for a boot sector to the appliance; the appliance reads the blocks from a volume on the client network, converts the blocks to a format used by the VM, and sends the blocks to the initiator. The initiator boots the VM using the boot sector and the VM begins execution. The initiator then retrieves all data blocks for the VM from volumes on the client network via the appliance, stores the data to the volumes on the provider network, and fulfills requests from the VM from either local volumes or the remote volumes via the appliance.

    Compute platform optimization over the life of a workload in a distributed computing environment

    公开(公告)号:US12135980B2

    公开(公告)日:2024-11-05

    申请号:US17861795

    申请日:2022-07-11

    Abstract: Techniques for an optimization service of a service provider network to help optimize the selection, configuration, and utilization, of virtual machine (VM) instance types to support workloads on behalf of users. The optimization service may implement the techniques described herein at various stages in a life cycle of a workload to help optimize the performance of the workload, and reduce underutilization of computing resources. For example, the optimization service may perform techniques to help new users select an optimized VM instance type on which to initially launch their workload. Further, the optimization service may monitor a workload for the life of the workload, and determine new VM instance types, and/or configuration modifications, that optimize the performance of the workload. The optimization service may provide recommendations to users that help improve performance of their workloads, and that also increase the aggregate utilization of computing resources of the service provider network.

    Application architecture optimization and visualization

    公开(公告)号:US11194688B1

    公开(公告)日:2021-12-07

    申请号:US16406354

    申请日:2019-05-08

    Abstract: Techniques for an optimization service of a service provider network to generate an architecture diagram that represents an architecture of a web-based application. The optimization service may use the architecture diagram to determine modifications or changes to make to the application. For example, the optimization service may compare the architecture diagram with optimized architecture diagrams that represent application best practices, and determine the modifications or change to make to the application to optimize the application and bring the application in-line with best practices. Further, the optimization service may use the architecture diagram to generate a visualization, and provide the user account with the visualization of the architecture diagram to show users their application architecture.

    Optimizing Hardware Platform Utilization for Heterogeneous Workloads in a Distributed Computing Environment

    公开(公告)号:US20200310876A1

    公开(公告)日:2020-10-01

    申请号:US16368072

    申请日:2019-03-28

    Abstract: Techniques for an optimization service of a service provider network to help optimize the selection, configuration, and utilization, of virtual machine (VM) instance types to support workloads on behalf of users. The optimization service may implement the techniques described herein at various stages in a life cycle of a workload to help optimize the performance of the workload, and reduce underutilization of computing resources. For example, the optimization service may perform techniques to help new users select an optimized VM instance type on which to initially launch their workload. Further, the optimization service may monitor a workload for the life of the workload, and determine new VM instance types, and/or configuration modifications, that optimize the performance of the workload. The optimization service may provide recommendations to users that help improve performance of their workloads, and that also increase the aggregate utilization of computing resources of the service provider network.

    Classification of Workloads in a Distributed Computing Environment

    公开(公告)号:US20200310851A1

    公开(公告)日:2020-10-01

    申请号:US16367768

    申请日:2019-03-28

    Abstract: Techniques for an optimization service of a service provider network to help optimize the selection, configuration, and utilization, of virtual machine (VM) instance types to support workloads on behalf of users. The optimization service may implement the techniques described herein at various stages in a life cycle of a workload to help optimize the performance of the workload, and reduce underutilization of computing resources. For example, the optimization service may perform techniques to help new users select an optimized VM instance type on which to initially launch their workload. Further, the optimization service may monitor a workload for the life of the workload, and determine new VM instance types, and/or configuration modifications, that optimize the performance of the workload. The optimization service may provide recommendations to users that help improve performance of their workloads, and that also increase the aggregate utilization of computing resources of the service provider network.

    Automated error detection and recovery for GPU computations in a service environment

    公开(公告)号:US09836354B1

    公开(公告)日:2017-12-05

    申请号:US14263701

    申请日:2014-04-28

    CPC classification number: G06F11/1438

    Abstract: A service provider system may implement ECC-like features when executing computations on GPUs that do not include sufficient error detection and recovery for computations that are sensitive to bit errors. During execution of critical computations on behalf of customers, the system may automatically instrument program instructions received from the customers to cause each computation to be executed using multiple sets of hardware resources (e.g., different host machines, processor cores, or internal hardware resources). The service may provide APIs with which customers may instrument their code for execution using redundant resource instances, or specify parameters for applying the ECC-like features. The service or customer may instrument code to perform (or cause the system to perform) checkpointing operations at particular points in the code, and to compare intermediate results produced by different hardware resources. If the intermediate results do not match, the computation may be restarted from a checkpointed state.

Patent Agency Ranking