Abstract:
A system and a method for prioritizing network traffic using application awareness and network awareness in a network environment is disclosed. An exemplary method can include receiving a network traffic priority for network traffic associated with a job performed by a distributed application; and based on the network traffic priority, assigning the network traffic to a network classification model, such as an access control list, associated with a network element for directing the network traffic in a network. The network classification model is associated with a network traffic priority class having defined quality of service (QoS) features, such that the network traffic traverses the network according to the defined QoS features.
Abstract:
A system can manage storage and access of data blocks in a hybrid environment. In one example, a system can identify a plurality of data block replicas distributed across sites, the plurality of data block replicas corresponding to respective blocks of data. The system can monitor events associated with the plurality of data block replicas and, based on the events, generate respective status and access data for the plurality of data block replicas. Based on the respective status and access data, the system can determine that one or more data block replicas associated with a block of data have reached a threshold. In response to the one or more data block replicas reaching the threshold, the system can modify a replica distribution across the sites for the block of data.
Abstract:
A distributed application framework, along with related systems and/or methods described herein, can intelligently place data using network knowledge. An exemplary method can include receiving data placement information from a distributed application that identifies a source node of data in a network and a list of potential destination nodes in the network for the distributed application to place the data; for each potential destination node, determining a network latency associated with transferring the data from the source node to the potential destination node using network metrics associated with the network; and sending the determined network latencies to the distributed application, such that the distributed application can assign the data to one of the potential destination nodes based on the determined network latencies.
Abstract:
A system and a method for prioritizing network traffic using application awareness and network awareness in a network environment is disclosed. An exemplary method can include receiving a network traffic priority for network traffic associated with a job performed by a distributed application; and based on the network traffic priority, assigning the network traffic to a network classification model, such as an access control list, associated with a network element for directing the network traffic in a network. The network classification model is associated with a network traffic priority class having defined quality of service (QoS) features, such that the network traffic traverses the network according to the defined QoS features.
Abstract:
A system and a method for prioritizing network traffic using application awareness and network awareness in a network environment is disclosed. An exemplary method can include receiving a network traffic priority for network traffic associated with a job performed by a distributed application; and based on the network traffic priority, assigning the network traffic to a network classification model, such as an access control list, associated with a network element for directing the network traffic in a network. The network classification model is associated with a network traffic priority class having defined quality of service (QoS) features, such that the network traffic traverses the network according to the defined QoS features.
Abstract:
Systems, methods, and computer program products to perform an operation comprising receiving a priority of a distributed computing job, an intermediate traffic type of the distributed computing job, and a set of candidate compute nodes available to process the distributed computing job, the candidate compute nodes each available to process at least one input split of the distributed computing job, and selecting a mapper node from the candidate compute nodes, for one of the input splits, wherein the mapper node is selected based on the priority and the intermediate traffic type of the distributed computing job, wherein the mapper compute node is further selected upon determining that the mapper node is not affected by an error, and a resource utilization score for the mapper node does not exceed a utilization threshold.
Abstract:
A system and a method for prioritizing network traffic using application awareness and network awareness in a network environment is disclosed. An exemplary method can include receiving a network traffic priority for network traffic associated with a job performed by a distributed application; and based on the network traffic priority, assigning the network traffic to a network classification model, such as an access control list, associated with a network element for directing the network traffic in a network. The network classification model is associated with a network traffic priority class having defined quality of service (QoS) features, such that the network traffic traverses the network according to the defined QoS features.
Abstract:
A distributed application framework, along with related systems and/or methods described herein, can intelligently place data using network knowledge. An exemplary method can include receiving data placement information from a distributed application that identifies a source node of data in a network and a list of potential destination nodes in the network for the distributed application to place the data; for each potential destination node, determining a network latency associated with transferring the data from the source node to the potential destination node using network metrics associated with the network; and sending the determined network latencies to the distributed application, such that the distributed application can assign the data to one of the potential destination nodes based on the determined network latencies.