OPTIMIZED ASSIGNMENTS AND/OR GENERATION VIRTUAL MACHINE FOR REDUCER TASKS
    41.
    发明申请
    OPTIMIZED ASSIGNMENTS AND/OR GENERATION VIRTUAL MACHINE FOR REDUCER TASKS 有权
    优化分配和/或生成用于减少任务的虚拟机

    公开(公告)号:US20160103695A1

    公开(公告)日:2016-04-14

    申请号:US14509691

    申请日:2014-10-08

    CPC classification number: G06F9/45558 G06F9/5066 G06F2009/45562 H04L47/78

    Abstract: The present disclosure relates to assignment or generation of reducer virtual machines after the “map” phase is substantially complete in MapReduce. Instead of a priori placement, distribution of keys after the “map” phase over the mapper virtual machines can be used to efficiently reducer tasks in virtualized cloud infrastructure like OpenStack. By solving a constraint optimization problem, reducer VMs can be optimally assigned to process keys subject to certain constraints. In particular, the present disclosure describes a special variable matrix. Furthermore, the present disclosure describes several possible cost matrices for representing the costs determined based on the key distribution over the mapper VMs (and other suitable factors).

    Abstract translation: 本公开涉及在MapReduce中的“映射”阶段基本完成之后分配或生成reducer虚拟机。 在映射器虚拟机上的“映射”阶段之后,可以使用OpenStack虚拟化云基础设施中的有效减少任务来代替先验位置分配密钥。 通过解决约束优化问题,可以将reducer VM最优化地分配给具有某些限制的处理密钥。 具体地,本公开描述了特殊变量矩阵。 此外,本公开描述了用于表示基于映射器VM上的密钥分布(和其他合适因素)确定的成本的几种可能的成本矩阵。

    TASK SCHEDULING USING VIRTUAL CLUSTERS
    42.
    发明申请
    TASK SCHEDULING USING VIRTUAL CLUSTERS 有权
    任务调度使用虚拟集群

    公开(公告)号:US20150200867A1

    公开(公告)日:2015-07-16

    申请号:US14156169

    申请日:2014-01-15

    CPC classification number: H04L49/3045 H04L41/0896

    Abstract: In one embodiment, a device receives information regarding a data set to be processed by a map-reduce process. The device generates a set of virtual clusters for the map-reduce process based on network bandwidths between nodes of the virtual clusters, each node of the virtual cluster corresponding to a resource device, and associates the data set with a map-reduce process task. The device then schedules the execution of the task by a node of the virtual clusters based on the network bandwidth between the node and a source node on which the data set resides.

    Abstract translation: 在一个实施例中,设备接收关于要由地图缩减处理处理的数据集的信息。 该设备基于虚拟集群的节点之间的网络带宽,虚拟集群的每个节点对应于资源设备,并且将数据集与映射减少过程任务相关联,生成用于映射减少过程的一组虚拟集群。 然后,设备基于节点与数据集所驻留的源节点之间的网络带宽来调度虚拟集群的节点执行任务。

    Tenant-level sharding of disks with tenant-specific storage modules to enable policies per tenant in a distributed storage system

    公开(公告)号:US11354039B2

    公开(公告)日:2022-06-07

    申请号:US16879612

    申请日:2020-05-20

    Abstract: Embodiments include receiving an indication of a data storage module to be associated with a tenant of a distributed storage system, allocating a partition of a disk for data of the tenant, creating a first association between the data storage module and the disk partition, creating a second association between the data storage module and the tenant, and creating rules for the data storage module based on one or more policies configured for the tenant. Embodiments further include receiving an indication of a type of subscription model selected for the tenant, and selecting the disk partition to be allocated based, at least in part, on the subscription model selected for the tenant. More specific embodiments include generating a storage map indicating the first association between the data storage module and the disk partition and indicating the second association between the data storage module and the tenant.

    FPGA acceleration for serverless computing

    公开(公告)号:US11119821B2

    公开(公告)日:2021-09-14

    申请号:US16693930

    申请日:2019-11-25

    Abstract: In one embodiment, a method for FPGA accelerated serverless computing comprises receiving, from a user, a definition of a serverless computing task comprising one or more functions to be executed. A task scheduler performs an initial placement of the serverless computing task to a first host determined to be a first optimal host for executing the serverless computing task. The task scheduler determines a supplemental placement of a first function to a second host determined to be a second optimal host for accelerating execution of the first function, wherein the first function is not able to accelerated by one or more FPGAs in the first host. The serverless computing task is executed on the first host and the second host according to the initial placement and the supplemental placement.

    SYSTEMS AND METHODS FOR PROVIDING MANAGEMENT OF MACHINE LEARNING COMPONENTS

    公开(公告)号:US20210182729A1

    公开(公告)日:2021-06-17

    申请号:US16710499

    申请日:2019-12-11

    Abstract: A method can include receiving, at a workflow controller, a machine learning workflow, the machine learning workflow associated with a first task and a second task. The first task is training a machine learning model and the second task is deploying the model. The method can include segmenting, by the workflow controller, the machine learning workflow into a first sub-workflow associated with the first task and a second sub-workflow associated with the second task, assigning a first workflow agent to the first sub-workflow and assigning a second workflow agent to the second sub-workflow, selecting, by the first workflow agent and based on first resources needed to perform the first task, a first cluster for performing the first task and selecting, by the second workflow agent and based on second resources needed to perform the second task, a second cluster for performing the second task.

    Estimating model parameters for automatic deployment of scalable micro services

    公开(公告)号:US11005731B2

    公开(公告)日:2021-05-11

    申请号:US15480248

    申请日:2017-04-05

    Abstract: One aspect of the disclosure relates to, among other things, a method for optimizing and provisioning a software-as-a-service (SaaS). The method includes determining a graph comprising interconnected stages for the SaaS, wherein each stage has a replication factor and one or more metrics that are associated with one or more service level objectives of the SaaS, determining a first replication factor associated with a first one of the stages which meets a first service level objective of the SaaS, adjusting the first replication factor associated with the first one of the stage based on the determined first replication factor, and provisioning the SaaS onto networked computing resources based on the graph and replication factors associated with each stage.

    Virtualized network functions and service chaining in serverless computing infrastructure

    公开(公告)号:US10938677B2

    公开(公告)日:2021-03-02

    申请号:US16280983

    申请日:2019-02-20

    Abstract: In one embodiment, a method implements virtualized network functions in a serverless computing system having networked hardware resources. An interface of the serverless computing system receives a specification for a network service including a virtualized network function (VNF) forwarding graph (FG). A mapper of the serverless computing system determines an implementation graph comprising edges and vertices based on the specification. A provisioner of the serverless computing system provisions a queue in the serverless computing system for each edge. The provisioner further provisions a function in the serverless computing system for each vertex, wherein, for at least one or more functions, each one of said at least one or more functions reads incoming messages from at least one queue. The serverless computing system processes data packets by the queues and functions in accordance with the VNF FG. The queues and functions processes data packets in accordance with the VNF FG.

    Tenant-level sharding of disks with tenant-specific storage modules to enable policies per tenant in a distributed storage system

    公开(公告)号:US10671289B2

    公开(公告)日:2020-06-02

    申请号:US16268397

    申请日:2019-02-05

    Abstract: Embodiments include receiving an indication of a data storage module to be associated with a tenant of a distributed storage system, allocating a partition of a disk for data of the tenant, creating a first association between the data storage module and the disk partition, creating a second association between the data storage module and the tenant, and creating rules for the data storage module based on one or more policies configured for the tenant. Embodiments further include receiving an indication of a type of subscription model selected for the tenant, and selecting the disk partition to be allocated based, at least in part, on the subscription model selected for the tenant. More specific embodiments include generating a storage map indicating the first association between the data storage module and the disk partition and indicating the second association between the data storage module and the tenant.

Patent Agency Ranking