公开(公告)号：US20220309349A1

公开(公告)日：2022-09-29

申请号：US17839010

申请日：2022-06-13

申请人： Intel Corporation

发明人： Meenakshi Arunachalam ,  Arun Tejusve Raghunath Rajan ,  Deepthi Karkada ,  Adam Procter ,  Vikram Saletore

IPC分类号： G06N3/08 ,  G06F1/3203 ,  G06K9/62 ,  G06F1/324 ,  G06N3/063 ,  G06F1/3206 ,  G06N3/04 ,  G06V10/94

摘要： Methods, apparatus, systems and articles of manufacture for distributed training of a neural network are disclosed. An example apparatus includes a neural network trainer to select a plurality of training data items from a training data set based on a toggle rate of each item in the training data set. A neural network parameter memory is to store neural network training parameters. A neural network processor is to generate training data results from distributed training over multiple nodes of the neural network using the selected training data items and the neural network training parameters. The neural network trainer is to synchronize the training data results and to update the neural network training parameters.

公开(公告)号：US11966843B2

公开(公告)日：2024-04-23

申请号：US17839010

申请日：2022-06-13

申请人： Intel Corporation

发明人： Meenakshi Arunachalam ,  Arun Tejusve Raghunath Rajan ,  Deepthi Karkada ,  Adam Procter ,  Vikram Saletore

IPC分类号： G06N3/08 ,  G06F1/3203 ,  G06F1/3206 ,  G06F18/214 ,  G06N3/063 ,  G06V10/774 ,  G06V10/82 ,  G06V10/94 ,  G06N3/048

CPC分类号： G06N3/08 ,  G06F1/3203 ,  G06F1/3206 ,  G06F18/214 ,  G06N3/063 ,  G06V10/774 ,  G06V10/82 ,  G06V10/94 ,  G06N3/048

摘要： Methods, apparatus, systems and articles of manufacture for distributed training of a neural network are disclosed. An example apparatus includes a neural network trainer to select a plurality of training data items from a training data set based on a toggle rate of each item in the training data set. A neural network parameter memory is to store neural network training parameters. A neural network processor is to generate training data results from distributed training over multiple nodes of the neural network using the selected training data items and the neural network training parameters. The neural network trainer is to synchronize the training data results and to update the neural network training parameters.