Invention Application
- Patent Title: Distributing Model Data in Memories in Nodes in an Electronic Device
-
Application No.: US17489576Application Date: 2021-09-29
-
Publication No.: US20230065546A1Publication Date: 2023-03-02
- Inventor: Mohamed Assem Abd ElMohsen Ibrahim , Onur Kayiran , Shaizeen Aga
- Applicant: Advanced Micro Devices, Inc.
- Applicant Address: US CA Santa Clara
- Assignee: Advanced Micro Devices, Inc.
- Current Assignee: Advanced Micro Devices, Inc.
- Current Assignee Address: US CA Santa Clara
- Main IPC: G06F16/2457
- IPC: G06F16/2457

Abstract:
An electronic device includes a plurality of nodes, each node having a processor that performs operations for processing instances of input data through a model, a local memory that stores a separate portion of model data for the model, and a controller. The controller identifies model data that meets one or more predetermined conditions in the separate portion of the model data in the local memory in some or all of the nodes that is accessible by the processors when processing the instances of input data through the model. The controller then copies the model data that meets the one or more predetermined conditions from the separate portion of the model data in the local memory in the some or all of the nodes to local memories in other nodes. In this way, the controller distributes model data that meets the one or more predetermined conditions among the nodes, making the model data that meets the one or more predetermined conditions available to the nodes without performing remote memory accesses.
Information query