公开(公告)号：US20180293075A1

公开(公告)日：2018-10-11

申请号：US16006878

申请日：2018-06-13

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Haiyan LIU ,  Jun XU ,  Qun YU

IPC: G06F9/38

CPC classification number: G06F9/38 ,  G06F9/5066 ,  G06F2209/5011

Abstract: A data processing method and apparatus are provided. A system includes a CPU pool and a storage pool, a mapper node and a reducer node respectively run on different CPUs in the CPU pool, and a remote storage area shared by the mapper node and the reducer node is delimited in the storage pool. In this method, the mapper node executes a map task, and stores a data segment obtained by executing the map task, into the remote storage area; and the reducer node directly obtains a data segment to be processed by the reducer node from the remote storage area, and executes a reduce task on the data segment. The method omits some actions in the prior art, and shortens a time for executing the Map/Reduce task.

公开(公告)号：US20170168952A1

公开(公告)日：2017-06-15

申请号：US15445349

申请日：2017-02-28

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Guanyu ZHU ,  Jun XU ,  Qun YU

IPC: G06F12/1009

CPC classification number: G06F12/1009 ,  G06F3/0643 ,  G06F12/00 ,  G06F12/109 ,  G06F17/30091 ,  G06F17/30123 ,  G06F2212/1024 ,  G06F2212/651 ,  G06F2212/656 ,  G06F2212/657

Abstract: A file access method and apparatus, and a storage system are provided. After receiving a file access request from a process, a first physical address space is accessed according to a preset first virtual address space and a preset first mapping relationship between the first virtual address space and the first physical address space, where the first physical address space stores a file system. After obtaining an index node of a target file from the first physical address space according to a file identifier of the target file carried in the file access request, a file page table of the target file is obtained according to file page table information. The file page table records a second physical address space in the first physical address space. The target file is accessed according to the second physical address space.