公开(公告)号：US20230315410A1

公开(公告)日：2023-10-05

申请号：US18129714

申请日：2023-03-31

Applicant: SambaNova Systems, Inc.

Inventor： Bowen YANG ,  Zhuo CHEN ,  Chen LIU ,  Fei WANG ,  Ruobing WANG ,  Qinghua Li ,  Weiwei CHEN ,  Junjue WANG ,  Sumti JAIRATH

IPC: G06F8/41

CPC classification number: G06F8/443

Abstract: A method comprises a compiler analyzing a graph to determine a pipeline of operators based on a shared dimension of input and output tensors among the operators. The operators are included in the graph and the graph corresponds to a dataflow application. The compiler determines a tiling decision associated with the pipeline and a tiling cost associated with the tiling decision. The tiling decision can comprise a tile shape to slice tensors of operators of the pipeline. Based on the tiling cost, the compiler determines that the tiling decision improves an optimization objective and includes the pipeline and tiling decision in mapping decisions associated with executing the application on a computing system. The compiler can apply a tiling cost model to determine the tiling costs. A computer program product and a computing system can implement the method.