PARAMETER SERVER AND METHOD FOR SHARING DISTRIBUTED DEEP LEARNING PARAMETER USING THE SAME

    公开(公告)号:US20180349313A1

    公开(公告)日:2018-12-06

    申请号:US15984262

    申请日:2018-05-18

    Abstract: Disclosed herein are a parameter server and a method for sharing distributed deep-learning parameters using the parameter server. The method for sharing distributed deep-learning parameters using the parameter server includes initializing a global weight parameter in response to an initialization request by a master process; performing an update by receiving a learned local gradient parameter from the worker process, which performs deep-learning training after updating a local weight parameter using the global weight parameter; accumulating the gradient parameters in response to a request by the master process; and performing an update by receiving the global weight parameter from the master process that calculates the global weight parameter using the accumulated gradient parameters of the one or more worker processes.

    APPARATUS AND METHOD FOR OFFLOADING PARALLEL COMPUTATION TASK

    公开(公告)号:US20240303111A1

    公开(公告)日:2024-09-12

    申请号:US18415925

    申请日:2024-01-18

    CPC classification number: G06F9/4881 G06F2209/486

    Abstract: Disclosed herein is an apparatus and method for offloading parallel computation tasks. The apparatus inserts requests to execute multiple parallel thread groups into at least one parallel thread group queues, wherein when a preset order of priority exists the requests to execute is inserted into the at least one parallel thread group queues according to the preset order of priority, executes parallel threads of the parallel thread groups using a parallel thread group execution request entry extracted from the parallel thread group queue according to the order of priority, inserts an execution result into an execution result queue when execution of the parallel threads according to an execution sequence scheduled in execution startup routine code is terminated, and checks the execution termination state of the parallel thread groups by checking the execution result queue.

Patent Agency Ranking