-
公开(公告)号:US20240220334A1
公开(公告)日:2024-07-04
申请号:US18604395
申请日:2024-03-13
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Inventor: Hua XU , Xiaoming BAO , Chun LIU , Minjun ZHOU , Jiahuai CHEN
IPC: G06F9/50
CPC classification number: G06F9/5083 , G06F9/5016 , G06F9/5038
Abstract: A data processing method in a distributed system is provided. The method includes: A management node splits a to-be-processed data processing request into a map task and a reduce task. A first worker node executes the map task, and writes intermediate data obtained by executing the map task into a shared storage area. The intermediate data is divided into a plurality of partitions based on a quantity of second worker nodes. Each partition belongs to one second worker node. An aggregation node stores, in a centralized manner, intermediate data that belongs to a same partition in the shared storage area. The second worker node obtains intermediate data of a corresponding partition to execute the reduce task.
-
公开(公告)号:US20210232817A1
公开(公告)日:2021-07-29
申请号:US17228390
申请日:2021-04-12
Applicant: Huawei Technologies Co., Ltd.
Inventor: Shuai GAO , Yueqiang LYU , Jiahuai CHEN
Abstract: This disclosure relates to an image recognition method: receiving, by a data center, a first feature value sent by a first edge station, where the data center communicates with the first edge station through a network, and the first feature value is obtained by the first edge station by preprocessing a first image obtained by the first edge station; determining a first attribute based on the first feature value; sending a first label to an edge station in an edge station set, where the first label includes a target feature value and the first attribute, the target feature value is a feature value associated with the first attribute, and the edge station set includes the first edge station; receiving at least one image recognition result sent by the edge station in the edge station set; and, determining a location of a target object based on the image recognition result.
-
公开(公告)号:US20250117145A1
公开(公告)日:2025-04-10
申请号:US18990923
申请日:2024-12-20
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Inventor: Xiaoming BAO , Hua XU , Chun LIU , Minjun ZHOU , Jiahuai CHEN
IPC: G06F3/06
Abstract: This disclosure provides data processing methods, apparatuses, and systems. In an implementation, a method comprises receiving, by a first data processing unit (DPU), a memory allocation request from a first service process in a computing node that comprises the first DPU, wherein the first DPU stores memory address assignment information that indicates a virtual memory address corresponding to a physical memory allocated by a storage node to the computing node. Determining, by the first DPU based on the memory address assignment information and in the virtual memory address corresponding to the physical memory allocated by the storage node to the computing node, a virtual memory address range assigned to the first service process, and when the first DPU receives a data storage request from the first service process, sending, by the first DPU, a write data request to the second DPU over a communication link between the first DPU and the second DPU.
-
-