DATA PROCESSING METHOD, APPARATUS, DEVICE, AND SYSTEM

    公开(公告)号:US20250130726A1

    公开(公告)日:2025-04-24

    申请号:US19000111

    申请日:2024-12-23

    Abstract: Example data processing methods and apparatus are described. In one example method, a control node estimates a data volume of result data obtained after a plurality of second computing nodes execute a data processing task in parallel. The control node determines a quantity of reduce tasks based on the data volume and memory information of a first computing node that executes a reduce task. Each of the plurality of second computing nodes partitions, based on the quantity of reduced tasks, the result data generated after the data processing task is executed, where each partition corresponds to one reduce task. The first computing node performs reduce processing on data obtained after partitioning is performed by the plurality of second computing nodes.

Patent Agency Ranking