-
公开(公告)号:US10936938B2
公开(公告)日:2021-03-02
申请号:US15857587
申请日:2017-12-28
发明人: Minwei Feng , Yufei Ren , Yandong Wang , Li Zhang , Wei Zhang
IPC分类号: G06F3/048 , G06F3/0482 , G06F3/0484 , G06N3/04 , G06F16/904 , G06N3/10
摘要: A method for providing a graphical visualization of a neural network to a user is provided. The method includes generating the graphical visualization of the neural network at least in part by: representing layers of the neural network as respective three-dimensional blocks, wherein at least a first dimension of a given block is proportional to a computational complexity of a layer of the neural network represented by the given block; and representing data flows between the layers of the neural network as respective three-dimensional structures connecting blocks representing the layers of the neural network, wherein a first dimension of a given structure is proportional to each of a first dimension and a second dimension of a data flow represented by the given structure. The method also includes displaying the graphical visualization of the neural network to the user.
-
公开(公告)号:US10423575B2
公开(公告)日:2019-09-24
申请号:US15447262
申请日:2017-03-02
发明人: Michel H. T. Hack , Yufei Ren , Wei Tan , Yandong Wang , Xingbo Wu , Li Zhang , Wei Zhang
IPC分类号: G06F16/182 , G06F16/14
摘要: Computational storage techniques for distribute computing are disclosed. The computational storage server receives input from multiple clients, which is used by the server when executing one or more computation functions. The computational storage server can aggregate multiple client inputs before applying one or more computation functions. The computational storage server sets up: a first memory area for storing input received from multiple clients; a second memory area designated for storing the computation functions to be executed by the computational storage server using the input data received from the multiple clients; a client specific memory management area for storing metadata related to computations performed by the computational storage server for specific clients; and a persistent storage area for storing checkpoints associated with aggregating computations performed by the computation functions.
-
公开(公告)号:US10031883B2
公开(公告)日:2018-07-24
申请号:US14885320
申请日:2015-10-16
发明人: Michel H. Hack , Yufei Ren , Yandong Wang , Li Zhang
IPC分类号: G06F15/167 , G06F12/0813 , H04L29/08 , G06F17/00
摘要: A cache management system performs cache management in a Remote Direct Memory Access (RDMA) key value data store. The cache management system receives a request from at least one client configured to access a data item stored in a data location of a remote server, and determines a popularity of the data item based on a frequency at which the data location is accessed by the at least one client. The system is further configured to determine a lease period of the data item based on the frequency and assigning the lease period to the data location.
-
4.
公开(公告)号:US20170139596A1
公开(公告)日:2017-05-18
申请号:US14945031
申请日:2015-11-18
发明人: Michel H. T. Hack , Yufei Ren , Yandong Wang , Xingbo Wu , Li Zhang
CPC分类号: G06F3/064 , G06F3/0608 , G06F3/0638 , G06F3/0673 , G06F12/0802 , G06F2212/60
摘要: A method for compressing a group of key-value pairs, the method including dividing the group of key-value pairs into a plurality of segments, creating a plurality of blocks, each block of the plurality of blocks corresponding to a segment of the plurality of segments, and compressing each block of the plurality of blocks.
-
公开(公告)号:US10783437B2
公开(公告)日:2020-09-22
申请号:US15450010
申请日:2017-03-05
发明人: Minwei Feng , Yufei Ren , Yandong Wang , Li Zhang , Wei Zhang
摘要: A processing unit topology of a neural network including a plurality of processing units is determined. The neural network includes at least one machine in which each machine includes a plurality of nodes, and wherein each node includes at least one of the plurality of processing units. One or more of the processing units are grouped into a first group according to a first affinity. The first group is configured, using a processor and a memory, to use a first aggregation procedure for exchanging model parameters of a model of the neural network between the processing units of the first group. One or more of the processing units are grouped into a second group according to a second affinity. The second group is configured to use a second aggregation procedure for exchanging the model parameters between the processing units of the second group.
-
公开(公告)号:US10671563B2
公开(公告)日:2020-06-02
申请号:US16042379
申请日:2018-07-23
发明人: Michel H. Hack , Yufei Ren , Yandong Wang , Li Zhang
IPC分类号: G06F15/167 , G06F12/0813 , H04L29/08 , G06F17/00
摘要: A cache management system performs cache management in a Remote Direct Memory Access (RDMA) key value data store. The cache management system receives a request from at least one client configured to access a data item stored in a data location of a remote server, and determines a popularity of the data item based on a frequency at which the data location is accessed by the at least one client. The system is further configured to determine a lease period of the data item based on the frequency and assigning the lease period to the data location.
-
7.
公开(公告)号:US20170344905A1
公开(公告)日:2017-11-30
申请号:US15169471
申请日:2016-05-31
发明人: Michel H.T. Hack , Yufei Ren , Yandong Wang , Li Zhang
CPC分类号: G06N20/00 , G06F16/219
摘要: Version vector-based rules are used to facilitate asynchronous execution of machine learning algorithms. The method uses version vector based rule to generate aggregated parameters and determine when to return the parameters. The method also includes coordinating the versions of aggregated parameter sets among all the parameter servers. This allows to broadcast to enforce the version consistency; generate parameter sets in an on-demand manner to facilitate version control. Furthermore the method includes enhancing the version consistency at the learner's side and resolving the inconsistent version when mismatching versions are detected.
-
8.
公开(公告)号:US20170344904A1
公开(公告)日:2017-11-30
申请号:US15169411
申请日:2016-05-31
发明人: Michel H.T. Hack , Yufei Ren , Yandong Wang , Li Zhang
CPC分类号: G06N20/00 , G06F16/219
摘要: Version vector-based rules are used to facilitate asynchronous execution of machine learning algorithms. The method uses version vector based rule to generate aggregated parameters and determine when to return the parameters. The method also includes coordinating the versions of aggregated parameter sets among all the parameter servers. This allows to broadcast to enforce the version consistency; generate parameter sets in an on-demand manner to facilitate version control. Furthermore the method includes enhancing the version consistency at the learner's side and resolving the inconsistent version when mismatching versions are detected.
-
公开(公告)号:US11669502B2
公开(公告)日:2023-06-06
申请号:US16775612
申请日:2020-01-29
发明人: Michel H. T. Hack , Yufei Ren , Yandong Wang , Li Zhang
CPC分类号: G06F16/1873 , G06F16/219 , G06N20/00
摘要: Version vector-based rules are used to facilitate asynchronous execution of machine learning algorithms. The method uses version vector based rule to generate aggregated parameters and determine when to return the parameters. The method also includes coordinating the versions of aggregated parameter sets among all the parameter servers. This allows to broadcast to enforce the version consistency; generate parameter sets in an on-demand manner to facilitate version control. Furthermore the method includes enhancing the version consistency at the learner's side and resolving the inconsistent version when mismatching versions are detected.
-
公开(公告)号:US10685290B2
公开(公告)日:2020-06-16
申请号:US14982358
申请日:2015-12-29
发明人: Michel H. T. Hack , Yufei Ren , Yandong Wang , Li Zhang , Wei Zhang
摘要: One or more parameter changes for one or more parameters are computed at one or more worker nodes. The one or more parameters on a remote server are updated based on the computed one or more parameter changes. The updating is performed via one or more remote direct memory access atomic operations with the remote server.
-
-
-
-
-
-
-
-
-