METHOD AND APPARATUS FOR PROCESSING DATA, REDUCTION SERVER, AND MAPPING SERVER

    公开(公告)号:US20240036728A1

    公开(公告)日:2024-02-01

    申请号:US18485847

    申请日:2023-10-12

    CPC classification number: G06F3/0608 G06F3/067 G06F3/0644 G06F3/064

    Abstract: Methods and apparatuses for processing data are provided. In an implementation, a method comprising: obtaining, by a reduction server of a plurality of reduction servers in a distributed processing system and from a first storage area, metadata of first data to be read, wherein the first data comprises a target data block in a plurality of data blocks of second data, and wherein the second data comprises a processing result of a mapping server of a plurality of mapping servers for input data, determining a first address of the first data in a global memory based on the metadata, wherein the global memory comprises memories of the plurality of mapping servers and the plurality of reduction servers, and reading the first data from the global memory based on the first address.

    METHOD AND APPARATUS FOR CONFIGURING QUALITY OF SERVICE POLICY FOR SERVICE, AND COMPUTING DEVICE

    公开(公告)号:US20220286409A1

    公开(公告)日:2022-09-08

    申请号:US17747234

    申请日:2022-05-18

    Abstract: This application provides a method and apparatus for configuring a quality of service policy for a service, and a computing device, and belongs to the field of network communications technologies. The method includes: obtaining a first data flow forwarded by a virtual switch; determining service information of the first data flow, where the service information includes a service type of the first data flow and an access path of the first data flow; determining, based on the service information of the first data flow, a quality of service QoS policy matching the first data flow; and configuring devices on the access path based on the matched QoS policy. According to this application, efficiency of configuring a quality of service policy for a service can be improved.

    DATA PROCESSING METHOD, APPARATUS, DEVICE, AND SYSTEM

    公开(公告)号:US20250130726A1

    公开(公告)日:2025-04-24

    申请号:US19000111

    申请日:2024-12-23

    Abstract: Example data processing methods and apparatus are described. In one example method, a control node estimates a data volume of result data obtained after a plurality of second computing nodes execute a data processing task in parallel. The control node determines a quantity of reduce tasks based on the data volume and memory information of a first computing node that executes a reduce task. Each of the plurality of second computing nodes partitions, based on the quantity of reduced tasks, the result data generated after the data processing task is executed, where each partition corresponds to one reduce task. The first computing node performs reduce processing on data obtained after partitioning is performed by the plurality of second computing nodes.

    COMPUTING NODE CLUSTER, DATA AGGREGATION METHOD, AND RELATED DEVICE

    公开(公告)号:US20240241826A1

    公开(公告)日:2024-07-18

    申请号:US18618572

    申请日:2024-03-27

    CPC classification number: G06F12/0802 G06F2212/60

    Abstract: A computing node cluster provided in this embodiment of this application includes a plurality of computing nodes, and the plurality of computing nodes include an aggregation computing node. The plurality of computing nodes are configured to jointly perform a write operation on to-be-written data. Each of the plurality of computing nodes is configured to return a write success after writing partial data in the to-be-written data to a local cache. The aggregation computing node is configured to aggregate the partial data stored in caches of the plurality of computing nodes into aggregated data with consecutive addresses, and write the aggregated data into a storage node.

Patent Agency Ranking