Annotation of network activity through different phases of execution

    公开(公告)号:US10122605B2

    公开(公告)日:2018-11-06

    申请号:US14629151

    申请日:2015-02-23

    Abstract: The subject technology provides a drillable time-series heat map, which combines information of separate network element (e.g., switch, router, server or storage) and relates them together through impact zones to correlate network wide events and the potential impact on the other units in the network. The subject technology also brings together the network and its components, the distributed application(s) and a heat map controller to proactively communicate with one another to disseminate information such as failures, timeouts, new jobs, etc. For an individual job (e.g., for a distributed application), the subject technology may monitor consumption of resources during different phases of execution to provide individual job profile data that could be presented as a drillable heat map. The heat map, in this regard, nay include resource utilization heat metrics of resources such as CPU, Input/Output (I/O), memory, etc., in the heat map or graphs and presented along with network activity.

    ANNOTATION OF NETWORK ACTIVITY THROUGH DIFFERENT PHASES OF EXECUTION
    2.
    发明申请
    ANNOTATION OF NETWORK ACTIVITY THROUGH DIFFERENT PHASES OF EXECUTION 审中-公开
    通过不同的执行阶段对网络活动进行归纳

    公开(公告)号:US20160011925A1

    公开(公告)日:2016-01-14

    申请号:US14629151

    申请日:2015-02-23

    Abstract: The subject technology provides a drillable time-series heat map, which combines information of separate network element (e.g., switch, router, server or storage) and relates them together through impact zones to correlate network wide events and the potential impact on the other units in the network. The subject technology also brings together the network and its components, the distributed application(s) and a heat map controller to proactively communicate with one another to disseminate information such as failures, timeouts, new jobs, etc. For an individual job (e.g., for a distributed application), the subject technology may monitor consumption of resources during different phases of execution to provide individual job profile data that could be presented as a drillable heat map. The heat map, in this regard, nay include resource utilization heat metrics of resources such as CPU, Input/Output (I/O), memory, etc., in the heat map or graphs and presented along with network activity.

    Abstract translation: 主题技术提供了一个可钻取的时间序列热图,其组合了单独网络元件(例如交换机,路由器,服务器或存储)的信息,并将它们通过冲击区域相关联,以将网络广泛事件和对其他单元的潜在影响相关联 在网络中。 主题技术还将网络及其组件,分布式应用程序和热图控制器组合在一起,以主动地相互通信,以传播诸如故障,超时,新作业等信息。对于单个作业(例如, 对于分布式应用),主题技术可以在不同的执行阶段监视资源的消耗,以提供可以呈现为可钻取的热图的单个作业简档数据。 在这方面,热图可以包括资源利用热量度量,如热图或图中的CPU,输入/输出(I / O),存储器等资源,并与网络活动一起呈现。

    Allocating resources for multi-phase, distributed computing jobs
    3.
    发明授权
    Allocating resources for multi-phase, distributed computing jobs 有权
    为多阶段分布式计算任务分配资源

    公开(公告)号:US09489225B2

    公开(公告)日:2016-11-08

    申请号:US14156149

    申请日:2014-01-15

    CPC classification number: G06F9/45533 G06F9/44505 G06F9/5005

    Abstract: In one embodiment, data indicative of the size of an intermediate data set generated by a first resource device is received at a computing device. The intermediate data set is associated with a virtual machine to process the intermediate data set. A virtual machine configuration is determined based on the size of the intermediate data set. A second resource device is selected to execute the virtual machine based on the virtual machine configuration and on an available bandwidth between the first and second resource devices. The virtual machine is then assigned to the second resource device to process the intermediate data set.

    Abstract translation: 在一个实施例中,在计算设备处接收指示由第一资源设备生成的中间数据集的大小的数据。 中间数据集与虚拟机相关联以处理中间数据集。 基于中间数据集的大小来确定虚拟机配置。 选择第二资源设备以基于虚拟机配置和第一和第二资源设备之间的可用带宽来执行虚拟机。 然后将虚拟机分配给第二资源设备以处理中间数据集。

    TASK SCHEDULING USING VIRTUAL CLUSTERS
    4.
    发明申请
    TASK SCHEDULING USING VIRTUAL CLUSTERS 有权
    任务调度使用虚拟集群

    公开(公告)号:US20150200867A1

    公开(公告)日:2015-07-16

    申请号:US14156169

    申请日:2014-01-15

    CPC classification number: H04L49/3045 H04L41/0896

    Abstract: In one embodiment, a device receives information regarding a data set to be processed by a map-reduce process. The device generates a set of virtual clusters for the map-reduce process based on network bandwidths between nodes of the virtual clusters, each node of the virtual cluster corresponding to a resource device, and associates the data set with a map-reduce process task. The device then schedules the execution of the task by a node of the virtual clusters based on the network bandwidth between the node and a source node on which the data set resides.

    Abstract translation: 在一个实施例中,设备接收关于要由地图缩减处理处理的数据集的信息。 该设备基于虚拟集群的节点之间的网络带宽,虚拟集群的每个节点对应于资源设备,并且将数据集与映射减少过程任务相关联,生成用于映射减少过程的一组虚拟集群。 然后,设备基于节点与数据集所驻留的源节点之间的网络带宽来调度虚拟集群的节点执行任务。

    Infrastructure aware adaptive resource allocation

    公开(公告)号:US11057387B2

    公开(公告)日:2021-07-06

    申请号:US16572337

    申请日:2019-09-16

    Abstract: Disclosed are systems, methods, and computer-readable storage media for infrastructure aware adaptive resource allocation. A resource manager can receive a request to allocate a first container instance in a network. The resource manager can determine a set of candidate computing nodes in the network that are capable of hosting the first container instance and request, from an infrastructure monitor that received infrastructure data from the network, health metrics for the set of candidate computing nodes. The resource manager can select, based on the health metrics for the set of candidate computing nodes, an optimal computing node to host the first container instance, and allocate the first container instance on the optimal computing node.

    INFRASTRUCTURE AWARE ADAPTIVE RESOURCE ALLOCATION

    公开(公告)号:US20200014698A1

    公开(公告)日:2020-01-09

    申请号:US16572337

    申请日:2019-09-16

    Abstract: Disclosed are systems, methods, and computer-readable storage media for infrastructure aware adaptive resource allocation. A resource manager can receive a request to allocate a first container instance in a network. The resource manager can determine a set of candidate computing nodes in the network that are capable of hosting the first container instance and request, from an infrastructure monitor that received infrastructure data from the network, health metrics for the set of candidate computing nodes. The resource manager can select, based on the health metrics for the set of candidate computing nodes, an optimal computing node to host the first container instance, and allocate the first container instance on the optimal computing node.

    NETWORK TRAFFIC MANAGEMENT USING HEAT MAPS WITH ACTUAL AND PLANNED /ESTIMATED METRICS
    7.
    发明申请
    NETWORK TRAFFIC MANAGEMENT USING HEAT MAPS WITH ACTUAL AND PLANNED /ESTIMATED METRICS 审中-公开
    使用实际和计划/估计的度量的热量进行网络交通管理

    公开(公告)号:US20160013990A1

    公开(公告)日:2016-01-14

    申请号:US14327385

    申请日:2014-07-09

    CPC classification number: H04L41/22 H04L41/0618 H04L41/065 H04L41/0677

    Abstract: The subject technology provides a single drillable time-series heat map, which combines information of separate network element (e.g., switch, router, server or storage) and relates them together through impact zones to correlate network wide events and the potential impact on the other units in the network. The subject technology also brings together the network and its components (storage, ToR switches, servers, switches, etc.), the distributed application(s) and a heat map controller to proactively communicate with one another to quickly disseminate information such as failures, timeouts, new jobs, etc. Such communication ensures a more predictive picture of the network and enable better adaptive scheduling and routing, which may result in better utilization of resources. The subject technology uses impact zones to make better decisions to place data in the network, and measures network utilization through “Planned Metrics” to provide more realistic usage of network.

    Abstract translation: 主题技术提供了一个可钻取的时间序列热图,其组合了单独网络元件(例如交换机,路由器,服务器或存储)的信息,并将它们通过冲击区域相关联,以将网络范围的事件和对另一个的潜在影响相关联 网络中的单位。 主题技术还将网络及其组件(存储,ToR交换机,服务器,交换机等),分布式应用程序和热图控制器组合在一起,主动地彼此通信,以快速传播诸如故障, 超时,新作业等。这样的通信确保了网络的更多预测性图像,并且实现了更好的自适应调度和路由,这可能导致更好地利用资源。 主题技术使用影响区域做出更好的决策,将数据放置在网络中,并通过“计划度量”来衡量网络利用率,以提供更实际的网络使用。

    INFRASTRUCTURE AWARE QUERY OPTIMIZATION
    8.
    发明申请

    公开(公告)号:US20180025052A1

    公开(公告)日:2018-01-25

    申请号:US15216228

    申请日:2016-07-21

    CPC classification number: G06F16/2453 G06F16/2455

    Abstract: Disclosed are systems, methods, and computer-readable storage media for infrastructure aware query optimization. A query optimizer can receive a first query for a first set of requested data and determine a set of computing nodes in a network that can provide the first set of requested data. The query optimizer can then request, from an infra monitor, health scores for the set of computing nodes that can provide the first set of requested data. The infra monitor can receive infrastructure data from the network. The query optimizer can select, based on the health scores, a subset of computing nodes from the set of computing nodes to service the first query, and request the first set of requested data from the subset of computing nodes.

    ALLOCATING RESOURCES FOR MULTI-PHASE, DISTRIBUTED COMPUTING JOBS
    10.
    发明申请
    ALLOCATING RESOURCES FOR MULTI-PHASE, DISTRIBUTED COMPUTING JOBS 有权
    分配资源用于多相,分布式计算作业

    公开(公告)号:US20150199208A1

    公开(公告)日:2015-07-16

    申请号:US14156149

    申请日:2014-01-15

    CPC classification number: G06F9/45533 G06F9/44505 G06F9/5005

    Abstract: In one embodiment, data indicative of the size of an intermediate data set generated by a first resource device is received at a computing device. The intermediate data set is associated with a virtual machine to process the intermediate data set. A virtual machine configuration is determined based on the size of the intermediate data set. A second resource device is selected to execute the virtual machine based on the virtual machine configuration and on an available bandwidth between the first and second resource devices. The virtual machine is then assigned to the second resource device to process the intermediate data set.

    Abstract translation: 在一个实施例中,在计算设备处接收指示由第一资源设备生成的中间数据集的大小的数据。 中间数据集与虚拟机相关联以处理中间数据集。 基于中间数据集的大小来确定虚拟机配置。 选择第二资源设备以基于虚拟机配置和第一和第二资源设备之间的可用带宽来执行虚拟机。 然后将虚拟机分配给第二资源设备以处理中间数据集。

Patent Agency Ranking