Computing system for performing efficient machine learning processing

    公开(公告)号:US11797841B2

    公开(公告)日:2023-10-24

    申请号:US16357438

    申请日:2019-03-19

    IPC分类号: G06N3/08 G06F7/483

    CPC分类号: G06N3/08 G06F7/483

    摘要: A computing system capable of obtaining a calculation speed exceeding that of 16-bit floating point processing while maintaining accuracy of calculation results. A computing system includes a parameter server, a communication path and a worker. The parameter server has a storage unit that stores a parameter value of a training target model, and a first conversion unit that converts the parameter value into data represented by a floating point number with 10 bits or less. The communication path transmits the data transmitted and received between the parameter server and the worker. The worker has a processing unit that computes a product and a sum of the data. The parameter server further has a second conversion unit that converts the data with 10 bits or less received from the worker into an updating difference, and an updating unit that updates the parameter value on the basis of the updating difference.