公开(公告)号：US20210357814A1

公开(公告)日：2021-11-18

申请号：US17362674

申请日：2021-06-29

Applicant: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.

Inventor： Xinxuan WU ,  Xuefeng YAO ,  Dianhai YU ,  Zhihua WU ,  Yanjun MA ,  Tian WU ,  Haifeng WANG

IPC: G06N20/00

Abstract: The present disclosure provides a method and apparatus for distributed training a model, an electronic device, and a computer readable storage medium. The method may include: performing, for each batch of training samples acquired by a distributed first trainer, model training through a distributed second trainer to obtain gradient information; updating a target parameter in a distributed built-in parameter server according to the gradient information; and performing, in response to determining that training for a preset number of training samples is completed, a parameter exchange between the distributed built-in parameter server and a distributed parameter server through the distributed first trainer to perform a parameter update on the initial model until training for the initial model is completed.