Model Parallel Processing Method and Apparatus Based on Multiple Graphic Processing Units
    2.
    发明申请
    Model Parallel Processing Method and Apparatus Based on Multiple Graphic Processing Units 有权
    基于多个图形处理单元的模型并行处理方法和装置

    公开(公告)号:US20160321776A1

    公开(公告)日:2016-11-03

    申请号:US15107475

    申请日:2015-06-19

    CPC classification number: G06T1/20 G06F9/48 G06T2200/28

    Abstract: A parallel data processing method based on multiple graphic processing units (GPUs) is provided, including: creating, in a central processing unit (CPU), a plurality of worker threads for controlling a plurality of worker groups respectively, the worker groups including a plurality of GPUs; binding each worker thread to a corresponding GPU; loading one batch of training data from a nonvolatile memory to a GPU video memory corresponding to one worker group; transmitting, between a plurality of GPUs corresponding to one worker group, data required by data processing performed by the GPUs through peer to peer; and controlling the plurality of GPUs to perform data processing in parallel through the worker threads.

    Abstract translation: 提供了一种基于多个图形处理单元(GPU)的并行数据处理方法,包括:在中央处理单元(CPU)中分别创建多个用于控制多个工作者组的工作线程,所述工作人员组包括多个 的GPU; 将每个工作线程绑定到相应的GPU; 将一批训练数据从非易失性存储器加载到对应于一个工作者组的GPU视频存储器; 在对应于一个工作组的多个GPU之间传输由GPU通过对等设备执行的数据处理所需的数据; 并且通过工作线程并行地控制多个GPU来执行数据处理。

    Data processing method, apparatus, and electronic device

    公开(公告)号:US10943324B2

    公开(公告)日:2021-03-09

    申请号:US16360604

    申请日:2019-03-21

    Abstract: A data processing method is described. A processor provides different training data sets to a plurality of graphics processing units (GPUs), respectively. The processor controls the plurality of GPUs to generate respective sets of modification parameters by performing respective training processes in a parallel manner using respectively managed versions of a predictive model according to the corresponding training data sets. The processor controls the plurality of GPUs to exchange, before completion of the respective training processes, at least a portion of the sets of modification parameters that have been generated by the plurality of GPUs. The processor also causes the plurality of GPUs to modify the respectively managed versions of the predictive model according to at least the portion of the sets of modification parameters exchanged among the plurality of GPUs.

    Data processing method and apparatus for training incremental model of neural network

    公开(公告)号:US11151451B2

    公开(公告)日:2021-10-19

    申请号:US16026784

    申请日:2018-07-03

    Abstract: A data processing method in a data processing device is provided. First to-be-processed data input into a neural network are obtained. Iterative training is performed on the neural network for a first preset number of times by using first target data in the first to-be-processed data, to obtain a seed model of the neural network. First newly added data generated after an elapse of time corresponding to the first time window is obtained, and the first newly added data and the first to-be-processed data are combined into second to-be-processed data. Iterative training is performed on the seed model for a second preset number of times by using second target data in the second to-be-processed data, to obtain a first incremental model of the neural network. A first preset area overlaps between the second time window and the first time window. The first incremental model online is published.

    DATA PARALLEL PROCESSING METHOD AND APPARATUS BASED ON MULTIPLE GRAPHIC PROCESSING UNITS
    6.
    发明申请
    DATA PARALLEL PROCESSING METHOD AND APPARATUS BASED ON MULTIPLE GRAPHIC PROCESSING UNITS 审中-公开
    基于多个图形处理单元的数据并行处理方法和装置

    公开(公告)号:US20160321777A1

    公开(公告)日:2016-11-03

    申请号:US15210278

    申请日:2016-07-14

    Abstract: A parallel data processing method based on multiple graphic processing units (GPUs) is provided, including: creating, in a central processing unit (CPU), a plurality of worker threads for controlling a plurality of worker groups respectively, the worker groups including one or more GPUs; binding each worker thread to a corresponding GPU; loading a plurality of batches of training data from a nonvolatile memory to GPU video memories in the plurality of worker groups; and controlling the plurality of GPUs to perform data processing in parallel through the worker threads. The method can enhance efficiency of multi-GPU parallel data processing. In addition, a parallel data processing apparatus is further provided.

    Abstract translation: 提供了一种基于多个图形处理单元(GPU)的并行数据处理方法,包括:在中央处理单元(CPU)中分别创建多个用于控制多个工作者组的工作线程,所述工作人员组包括一个或 更多GPU 将每个工作线程绑定到相应的GPU; 将多批培训数据从非易失性存储器加载到多个工作者组中的GPU视频存储器; 并且通过工作线程并行地控制多个GPU来执行数据处理。 该方法可以提高多GPU并行数据处理的效率。 另外,还提供并行数据处理装置。

Patent Agency Ranking