公开(公告)号：US11574146B2

公开(公告)日：2023-02-07

申请号：US17104165

申请日：2020-11-25

Applicant: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.

Inventor： Long Li ,  Haifeng Wang ,  Weibao Gong

IPC: G06K9/62 ,  G06F9/50 ,  G06N3/08

Abstract: A method for updating a parameter of a model, a distributed training system, and an electric device are related to a field of deep learning technologies. The method includes: obtaining a batch training period of batch training data to be trained for a model; increasing priorities of tasks ranked at a bottom in a sequence of gradient communication tasks for parameters of the model when the batch training period is greater than or equal to a preset period threshold; and performing a communication of gradients of the parameters and updating the parameters based on priorities of the gradient communication tasks for the parameters in the model.