-
公开(公告)号:US10915365B2
公开(公告)日:2021-02-09
申请号:US16006503
申请日:2018-06-12
Applicant: Huawei Technologies Co., Ltd.
Inventor: Jiyuan Tang , Wei Wang , Yi Cai
IPC: G06F9/50 , G06F15/167 , G06F3/06 , G06F16/182
Abstract: A mapper node and a reducer node respectively run on different central processing units (CPUs) in a CPU pool, and a remote shared partition shared by the mapper node and the reducer node is delimited in the storage pool. The mapper node executes a map task to obtain a data segment, and stores the data segment into a remote shared partition. The reducer node directly obtains a to-be-processed data segment from the remote shared partition, and executes a reduce task on the to-be-processed data segment.
-
公开(公告)号:US10379906B2
公开(公告)日:2019-08-13
申请号:US15590542
申请日:2017-05-09
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Abstract: A method and apparatus for system call command batch processing are provided. The method enable system call commands of a same type to be processed in a same CPU core according to a sequence of entering a kernel, thereby ensuring that returned results of the system call commands are sequential.
-
公开(公告)号:US20180293108A1
公开(公告)日:2018-10-11
申请号:US16006503
申请日:2018-06-12
Applicant: Huawei Technologies Co., Ltd.
Inventor: Jiyuan Tang , Wei Wang , Yi Cai
IPC: G06F9/50
Abstract: A data processing method and apparatus, and a system, where the method applies to a system including a central processing unit (CPU) pool and a storage pool, a mapper node and a reducer node respectively run on different CPUs in the CPU pool, and a remote shared partition shared by the mapper node and the reducer node is delimited in the storage pool. In this method, the mapper node executes a map task, and stores a data segment obtained by executing the map task, into the remote shared partition, and the reducer node directly obtains a data segment to be processed by the reducer node from the remote shared partition, and executes a reduce task on the data segment. Hence, the method shortens a time for executing the Map/Reduce task.
-
-