- 专利标题: INFERENCE PROCESSING OF DECISION TREE MODELS USING VECTOR INSTRUCTIONS
-
申请号: US18183187申请日: 2023-03-14
-
公开(公告)号: US20240311148A1公开(公告)日: 2024-09-19
- 发明人: Jan Van Lunteren
- 申请人: INTERNATIONAL BUSINESS MACHINES CORPORATION
- 申请人地址: US NY ARMONK
- 专利权人: INTERNATIONAL BUSINESS MACHINES CORPORATION
- 当前专利权人: INTERNATIONAL BUSINESS MACHINES CORPORATION
- 当前专利权人地址: US NY ARMONK
- 主分类号: G06F9/30
- IPC分类号: G06F9/30 ; G06F16/901
摘要:
Methods are provided for inference processing of a decision tree model in processing apparatus which executes vector instructions to perform inference computations on vectors of operands stored in vector registers of the apparatus. Such a method includes, for each decision tree of the model, indexing nodes of the tree by consecutive node indexes which are assigned to nodes in a breadth-first order and increase with node-depth in the tree. During the inference processing, a vector of N node indexes, corresponding to a set of nodes for which N inference computations will be performed in parallel, is stored in a vector register of the apparatus. The method further includes adaptively selecting the granularity N of the vector of node indexes, in dependence on (at least) the node-depth of nodes in the set, to accelerate inference processing of the model.
信息查询