RDMA transmit flow scheduling and pacing scheme for congestion management in high-performance AI/ML networks

    公开(公告)号:US12218855B2

    公开(公告)日:2025-02-04

    申请号:US18108541

    申请日:2023-02-10

    Abstract: A system for facilitating RDMA transmit flow scheduling and pacing is disclosed. The system may determine a set of groups. The groups may be associated with a range of transmission rates. The system may determine a transmission rate of a queue pair. The system may assign the QP to a first group of the set of groups. The transmission rate of the QP may be within the range of transmission rates of the first group. The system may determine an available QP of at least one group from the set of groups. The system may schedule transmission, by an arbiter, of the available QP. The system may transmit, by the arbiter, a message associated with the available QP.

    CHIP-TO-CHIP INTERCONNECT WITH A LAYERED COMMUNICATION ARCHITECTURE

    公开(公告)号:US20230385138A1

    公开(公告)日:2023-11-30

    申请号:US17824766

    申请日:2022-05-25

    CPC classification number: G06F9/546 G06F9/3005 G06F9/544

    Abstract: A system includes a first integrated circuit package including a first group of one or more artificial intelligence processing units and a first chip-to-chip interconnect communication unit and a second integrated circuit package including a second group of one or more artificial intelligence processing units and a second chip-to-chip interconnect communication unit. The system also includes an interconnect between the first integrated circuit package and the second integrated circuit package, wherein the first chip-to-chip interconnect communication unit and the second chip-to-chip interconnect communication unit manage ethernet-based communication via the interconnect using a layered communication architecture supporting a credit-based data flow control and a retransmission data flow control.

    CHIP-TO-CHIP INTERCONNECT WITH A LAYERED COMMUNICATION ARCHITECTURE

    公开(公告)号:US20240378097A1

    公开(公告)日:2024-11-14

    申请号:US18766195

    申请日:2024-07-08

    Abstract: A system includes a first integrated circuit package including a first group of one or more artificial intelligence processing units and a first chip-to-chip interconnect communication unit and a second integrated circuit package including a second group of one or more artificial intelligence processing units and a second chip-to-chip interconnect communication unit. The system also includes an interconnect between the first integrated circuit package and the second integrated circuit package, wherein the first chip-to-chip interconnect communication unit and the second chip-to-chip interconnect communication unit manage Ethernet-based communication via the interconnect using a layered communication architecture supporting a credit-based data flow control and a retransmission data flow control.

    Chip-to-chip interconnect with a layered communication architecture

    公开(公告)号:US12061939B2

    公开(公告)日:2024-08-13

    申请号:US17824766

    申请日:2022-05-25

    CPC classification number: G06F9/546 G06F9/3005 G06F9/544

    Abstract: A system includes a first integrated circuit package including a first group of one or more artificial intelligence processing units and a first chip-to-chip interconnect communication unit and a second integrated circuit package including a second group of one or more artificial intelligence processing units and a second chip-to-chip interconnect communication unit. The system also includes an interconnect between the first integrated circuit package and the second integrated circuit package, wherein the first chip-to-chip interconnect communication unit and the second chip-to-chip interconnect communication unit manage ethernet-based communication via the interconnect using a layered communication architecture supporting a credit-based data flow control and a retransmission data flow control.

    RDMA TRANSMIT FLOW SCHEDULING AND PACING SCHEME FOR CONGESTION MANAGEMENT IN HIGH-PERFORMANCE AI/ML NETWORKS

    公开(公告)号:US20240275736A1

    公开(公告)日:2024-08-15

    申请号:US18108541

    申请日:2023-02-10

    CPC classification number: H04L47/6275 H04L67/1097

    Abstract: A system for facilitating RDMA transmit flow scheduling and pacing is disclosed. The system may determine a set of groups. The groups may be associated with a range of transmission rates. The system may determine a transmission rate of a queue pair. The system may assign the QP to a first group of the set of groups. The transmission rate of the QP may be within the range of transmission rates of the first group. The system may determine an available QP of at least one group from the set of groups. The system may schedule transmission, by an arbiter, of the available QP. The system may transmit, by the arbiter, a message associated with the available QP.

    NETWORK AWARE LOAD BALANCING FOR ARTIFICIAL INTELLIGENCE NETWORK TRANSPORT

    公开(公告)号:US20240243992A1

    公开(公告)日:2024-07-18

    申请号:US18154216

    申请日:2023-01-13

    CPC classification number: H04L45/24 H04L43/0829 H04L45/566

    Abstract: Systems, apparatuses and methods provide technology that identifies a message that is to be transmitted across a network, divides the message into a plurality of portions that are arranged in a first order, and generates a plurality of packets based on the plurality of portions. The technology maps different network paths for the plurality of packets to be transmitted to a destination, sets headers of the plurality of packets to represent the first order and the different network paths, transmits the plurality of packets over the network in an out-of-order fashion to the destination based on the headers, and arranges the plurality of transmitted packets into the first order based on the headers of the plurality of packets.

Patent Agency Ranking