Accelerating data replication using multicast and non-volatile memory enabled nodes

    公开(公告)号:US11595474B2

    公开(公告)日:2023-02-28

    申请号:US15856716

    申请日:2017-12-28

    Abstract: A method for accelerating data operations across a plurality of nodes of one or more clusters of a distributed computing environment. Rack awareness information characterizing the plurality of nodes is retrieved and a non-volatile memory (NVM) capability of each node is determined. A write operation is received at a management node of the plurality of nodes and one or more of the rack awareness information and the NVM capability of the plurality of nodes are analyzed to select one or more nodes to receive at least a portion of the write operation, wherein at least one of the selected nodes has an NVM capability. A multicast group for the write operation is then generated wherein the selected nodes are subscribers of the multicast group, and the multicast group is used to perform hardware accelerated read or write operations at one or more of the selected nodes.

    OPTIMIZING SERVERLESS COMPUTING USING A DISTRIBUTED COMPUTING FRAMEWORK

    公开(公告)号:US20190303018A1

    公开(公告)日:2019-10-03

    申请号:US15943640

    申请日:2018-04-02

    Abstract: Aspects of the technology provide improvements to a Serverless Computing (SLC) workflow by determining when and how to optimize SLC jobs for computing in a Distributed Computing Framework (DCF). DCF optimization can be performed by abstracting SLC tasks into different workflow configurations to determined optimal arrangements for execution in a DCF environment. A process of the technology can include steps for receiving an SLC job including one or more SLC tasks, executing one or more of the tasks to determine a latency metric and a throughput metric for the SLC tasks, and determining if the SLC tasks should be converted to a Distributed Computing Framework (DCF) format based on the latency metric and the throughput metric. Systems and machine-readable media are also provided.

    MULTI-DATACENTER MESSAGE QUEUE
    3.
    发明申请

    公开(公告)号:US20200021663A1

    公开(公告)日:2020-01-16

    申请号:US16581636

    申请日:2019-09-24

    Abstract: Approaches are disclosed for distributing messages across multiple data centers where the data centers do not store messages using a same message queue protocol. In some embodiment, a network element translates messages from a message queue protocol (e.g., Kestrel, RABBITMQ, APACHE Kafka, and ACTIVEMQ) to an application layer messaging protocol (e.g., XMPP, MQTT, WebSocket protocol, or other application layer messaging protocols). In other embodiments, a network element translates messages from an application layer messaging protocol to a message queue protocol. Using the new approaches disclosed herein, data centers communicate using, at least in part, application layer messaging protocols to disconnect the message queue protocols used by the data centers and enable sharing messages between messages queues in the data centers. Consequently, the data centers can share messages regardless of whether the underlying message queue protocols used by the data centers (and the network devices therein) are compatible with one another.

    Cloud resource placement optimization and migration execution in federated clouds

    公开(公告)号:US10205677B2

    公开(公告)日:2019-02-12

    申请号:US14951110

    申请日:2015-11-24

    Abstract: The present disclosure describes a method for cloud resource placement optimization. A resources monitor monitors state information associated with cloud resources and physical hosts in the federated cloud having a plurality of clouds managed by a plurality of cloud providers. A rebalance trigger triggers a rebalancing request to initiate cloud resource placement optimization based on one or more conditions. A cloud resource placement optimizer determines an optimized placement of cloud resources on physical hosts across the plurality of clouds in the federated cloud based on (1) costs including migration costs, (2) the state information, and (3) constraints, wherein each physical host is identified in the constraints-driven optimization solver by an identifier of a respective cloud provider and an identifier of the physical host. A migrations enforcer determines an ordered migration plan and transmits requests to place or migrate cloud resources according to the ordered migration plan.

    Smart storage recovery in a distributed storage system

    公开(公告)号:US09830240B2

    公开(公告)日:2017-11-28

    申请号:US14712762

    申请日:2015-05-14

    Abstract: Embodiments include obtaining at least one system metric of a distributed storage system, generating one or more recovery parameters based on the at least one system metric, identifying at least one policy associated with data stored in a storage node of a plurality of storage nodes in the distributed storage system, and generating a recovery plan for the data based on the one or more recovery parameters and the at least one policy. In more specific embodiments, the recovery plan includes a recovery order for recovering the data. Further embodiments include initiating a recovery process to copy replicas of the data from a second storage node to a new storage node, wherein the replicas of the data are copied according to the recovery order indicated in the recovery plan.

    CLOUD RESOURCE PLACEMENT OPTIMIZATION AND MIGRATION EXECUTION IN FEDERATED CLOUDS

    公开(公告)号:US20170149687A1

    公开(公告)日:2017-05-25

    申请号:US14951110

    申请日:2015-11-24

    CPC classification number: H04L47/78 H04L67/1002

    Abstract: The present disclosure describes a method for cloud resource placement optimization. A resources monitor monitors state information associated with cloud resources and physical hosts in the federated cloud having a plurality of clouds managed by a plurality of cloud providers. A rebalance trigger triggers a rebalancing request to initiate cloud resource placement optimization based on one or more conditions. A cloud resource placement optimizer determines an optimized placement of cloud resources on physical hosts across the plurality of clouds in the federated cloud based on (1) costs including migration costs, (2) the state information, and (3) constraints, wherein each physical host is identified in the constraints-driven optimization solver by an identifier of a respective cloud provider and an identifier of the physical host. A migrations enforcer determines an ordered migration plan and transmits requests to place or migrate cloud resources according to the ordered migration plan.

    Correctly identifying potential anomalies in a distributed storage system
    7.
    发明授权
    Correctly identifying potential anomalies in a distributed storage system 有权
    正确识别分布式存储系统中的潜在异常

    公开(公告)号:US09575828B2

    公开(公告)日:2017-02-21

    申请号:US14794676

    申请日:2015-07-08

    Abstract: A method for assisting evaluation of anomalies in a distributed storage system is disclosed. The method includes a step of monitoring at least one system metric of the distributed storage system. The method further includes steps of maintaining a listing of patterns of the monitored system metric comprising patterns which previously did not result in a failure within one or more nodes of the distributed storage system, and, based on the monitoring, identifying a pattern (i.e., a time series motif) of the monitored system metric as a potential anomaly in the distributed storage system. The method also includes steps of automatically (i.e. without user input) performing a similarity search to determine whether the identified pattern satisfies one or more predefined similarity criteria with at least one pattern of the listing, and, upon positive determination, excepting the identified pattern from being identified as the potential anomaly.

    Abstract translation: 公开了一种用于辅助评估分布式存储系统中的异常的方法。 该方法包括监视分布式存储系统的至少一个系统度量的步骤。 该方法还包括以下步骤:维护所监视的系统度量的模式的列表,其包括先前不会在分布式存储系统的一个或多个节点内导致故障的模式,并且基于该监视,识别模式(即, 监控系统度量的时间序列主题作为分布式存储系统中的潜在异常。 该方法还包括自动执行相似性搜索(即,不进行用户输入)以确定所识别的模式是否满足具有列表的至少一种模式的一个或多个预定义相似性标准的步骤,并且在正确定义之后,除了所识别的模式 被确定为潜在的异常。

    MULTI-DATACENTER MESSAGE QUEUE
    8.
    发明申请
    MULTI-DATACENTER MESSAGE QUEUE 审中-公开
    多通道消息队列

    公开(公告)号:US20160337465A1

    公开(公告)日:2016-11-17

    申请号:US15154141

    申请日:2016-05-13

    Abstract: Approaches are disclosed for distributing messages across multiple data centers where the data centers do not store messages using a same message queue protocol. In some embodiment, a network element translates messages from a message queue protocol (e.g., Kestrel, RABBITMQ, APACHE Kafka, and ACTIVEMQ) to an application layer messaging protocol (e.g., XMPP, MQTT, WebSocket protocol, or other application layer messaging protocols). In other embodiments, a network element translates messages from an application layer messaging protocol to a message queue protocol. Using the new approaches disclosed herein, data centers communicate using, at least in part, application layer messaging protocols to disconnect the message queue protocols used by the data centers and enable sharing messages between messages queues in the data centers. Consequently, the data centers can share messages regardless of whether the underlying message queue protocols used by the data centers (and the network devices therein) are compatible with one another.

    Abstract translation: 公开了用于在多个数据中心分发消息的方法,其中数据中心不使用相同的消息队列协议来存储消息。 在一些实施例中,网络元件将来自消息队列协议(例如,Kestrel,RABBITMQ,APACHE Kafka和ACTIVEMQ)的消息转换为应用层消息传递协议(例如,XMPP,MQTT,WebSocket协议或其他应用层消息传递协议) 。 在其他实施例中,网络元件将消息从应用层消息传递协议转换为消息队列协议。 使用本文公开的新方法,数据中心至少部分地使用应用层消息传递协议进行通信,以断开由数据中心使用的消息队列协议,并使得能够在数据中心中的消息队列之间共享消息。 因此,数据中心可以共享消息,而不管数据中心(及其中的网络设备)使用的底层消息队列协议是否彼此兼容。

    Multi-datacenter message queue
    9.
    发明授权

    公开(公告)号:US10938937B2

    公开(公告)日:2021-03-02

    申请号:US16581636

    申请日:2019-09-24

    Abstract: Approaches are disclosed for distributing messages across multiple data centers where the data centers do not store messages using a same message queue protocol. In some embodiment, a network element translates messages from a message queue protocol (e.g., Kestrel, RABBITMQ, APACHE Kafka, and ACTIVEMQ) to an application layer messaging protocol (e.g., XMPP, MQTT, WebSocket protocol, or other application layer messaging protocols). In other embodiments, a network element translates messages from an application layer messaging protocol to a message queue protocol. Using the new approaches disclosed herein, data centers communicate using, at least in part, application layer messaging protocols to disconnect the message queue protocols used by the data centers and enable sharing messages between messages queues in the data centers. Consequently, the data centers can share messages regardless of whether the underlying message queue protocols used by the data centers (and the network devices therein) are compatible with one another.

    Optimizing serverless computing using a distributed computing framework

    公开(公告)号:US10678444B2

    公开(公告)日:2020-06-09

    申请号:US15943640

    申请日:2018-04-02

    Abstract: Aspects of the technology provide improvements to a Serverless Computing (SLC) workflow by determining when and how to optimize SLC jobs for computing in a Distributed Computing Framework (DCF). DCF optimization can be performed by abstracting SLC tasks into different workflow configurations to determined optimal arrangements for execution in a DCF environment. A process of the technology can include steps for receiving an SLC job including one or more SLC tasks, executing one or more of the tasks to determine a latency metric and a throughput metric for the SLC tasks, and determining if the SLC tasks should be converted to a Distributed Computing Framework (DCF) format based on the latency metric and the throughput metric. Systems and machine-readable media are also provided.

Patent Agency Ranking