公开(公告)号：US20250061313A1

公开(公告)日：2025-02-20

申请号：US18234358

申请日：2023-08-15

Applicant: SambaNova Systems, Inc.

Inventor： Jonathan Li ,  Urmish Thakker ,  Changran Hu ,  Varun Talwar ,  Bo Li ,  Venkat Krishna SRINIVASAN ,  Amol Sharma ,  Dong Hui Kim

IPC: G06N3/048 ,  G06N3/047

Abstract: A system includes one or more processors and a statically reconfigurable dataflow processor (SRDAP) coupled to the processors which are programmed to receive a first request to generate an instantiation of a computation graph to generate a probability distribution for N classes and retrieve a compiled graph of the computation graph. The computation graph includes a bias node and a probability distribution node for M classes. The bias node provides a biased tensor of size M to the probability distribution node by adding a bias tensor. The processors generate a bias tensor having N entries equal to zero and M−N entries having negative values and then load the compiled graph with the first bias tensor into a first set coarse-grained reconfigurable units of the SRDAP. Execution of the computation graph is initiated on the SRDAP to generate the probability distribution and a first inference is provided.

公开(公告)号：US20230315407A1

公开(公告)日：2023-10-05

申请号：US18129722

申请日：2023-03-31

Applicant: SambaNova Systems, Inc.

Inventor： Bowen YANG ,  Zhuo CHEN ,  Fei WANG ,  Venkat Krishna SRINIVASAN ,  Chen LIU ,  Junjue WANG ,  Arvind Krishna SUJEETH ,  Sumti JAIRATH

IPC: G06F8/41

CPC classification number: G06F8/433

Abstract: According to a computing method a compiler determines a recompute node included in a dataflow application and a checkpoint tensor produced by the recompute node. The compiler determines a recompute cost to recompute the checkpoint tensor, and a memory cost to checkpoint the checkpoint tensor in a memory. Based on the recompute cost and/or the memory cost, the compiler determines a solution cost and compares the solution cost to a solution threshold. Based on comparing the solution cost to the solution threshold, the compiler determines a checkpoint solution to execute the dataflow application. The checkpoint solution can comprise recomputing or checkpointing the checkpoint tensor. In some implementations, the compiler can determine a recompute ratio of the recompute cost to the memory cost and can compare the recompute ratio to the solution threshold. A computer program product and a computing system can implement aspects of the method.