公开(公告)号：US11487698B2

公开(公告)日：2022-11-01

申请号：US17216322

申请日：2021-03-29

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Shin-Young Ahn ,  Eun-Ji Lim ,  Yong-Seok Choi ,  Young-Choon Woo ,  Wan Choi

IPC: G06F15/173 ,  G06N3/08 ,  H04L67/10 ,  G06F9/50

Abstract: Disclosed herein are a parameter server and a method for sharing distributed deep-learning parameters using the parameter server. The method for sharing distributed deep-learning parameters using the parameter server includes initializing a global weight parameter in response to an initialization request by a master process; performing an update by receiving a learned local gradient parameter from the worker process, which performs deep-learning training after updating a local weight parameter using the global weight parameter; accumulating the gradient parameters in response to a request by the master process; and performing an update by receiving the global weight parameter from the master process that calculates the global weight parameter using the accumulated gradient parameters of the one or more worker processes.

公开(公告)号：US10990561B2

公开(公告)日：2021-04-27

申请号：US15984262

申请日：2018-05-18

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Shin-Young Ahn ,  Eun-Ji Lim ,  Yong-Seok Choi ,  Young-Choon Woo ,  Wan Choi

IPC: G06F15/16 ,  G06F15/173 ,  G06N3/08 ,  H04L29/08 ,  G06F9/50

Abstract: Disclosed herein are a parameter server and a method for sharing distributed deep-learning parameters using the parameter server. The method for sharing distributed deep-learning parameters using the parameter server includes initializing a global weight parameter in response to an initialization request by a master process; performing an update by receiving a learned local gradient parameter from the worker process, which performs deep-learning training after updating a local weight parameter using the global weight parameter; accumulating the gradient parameters in response to a request by the master process; and performing an update by receiving the global weight parameter from the master process that calculates the global weight parameter using the accumulated gradient parameters of the one or more worker processes.

公开(公告)号：US10831676B2

公开(公告)日：2020-11-10

申请号：US16165891

申请日：2018-10-19

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Yong-Seok Choi ,  Shin-Young Ahn ,  Eun-Ji Lim ,  Young-Choon Woo ,  Wan Choi

IPC: G06F12/1081 ,  G06F13/28 ,  G06F13/16

Abstract: Disclosed herein are an apparatus and method for interfacing with common memory. The apparatus for interfacing with common memory includes a computer-input/output (I/O)-interface-protocol-processing unit for receiving a packet for accessing common memory from a computer; a direct memory access unit for transforming the packet into an instruction for performing any one of reading from and writing to the common memory; and a common memory interface unit for transmitting the instruction to the common memory and receiving information about whether execution of the instruction is completed from the common memory.

公开(公告)号：US10585726B2

公开(公告)日：2020-03-10

申请号：US15979169

申请日：2018-05-14

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Eun-Ji Lim ,  Shin-Young Ahn ,  Yong-Seok Choi ,  Young-Choon Woo ,  Wan Choi

IPC: H04L7/04 ,  G06F9/54 ,  G06F9/52 ,  G06N20/00 ,  G06F15/167

Abstract: A parameter-sharing apparatus includes a memory allocation unit for managing allocation of a memory area, in which a parameter is to be stored, to a memory box, and updating a mapping table stored in the memory box based on allocation management of the memory area, and an operation processing unit for providing the memory allocation unit with parameter information required for the allocation management of the memory area in which the parameter is to be stored and sharing the parameter stored in the memory box.