公开(公告)号：US20210342696A1

公开(公告)日：2021-11-04

申请号：US17376722

申请日：2021-07-15

Applicant: Huawei Technologies Co., Ltd.

Inventor： Xiaolong Bai ,  Pengfei Li ,  Zhenyu Zhang

IPC: G06N3/08 ,  G06N3/04

Abstract: A deep learning model training method includes generating N first gradient sets in a back propagation (BP) calculation in a jth iteration of N deep learning models, adjusting a communication sequence of gradients included in each of the first gradient sets to obtain an adjusted communication sequence, and sending, according to the adjusted communication sequence, the gradients included in each of the N first gradient sets to the parameter storage space.