公开(公告)号：US11615240B2

公开(公告)日：2023-03-28

申请号：US16581035

申请日：2019-09-24

Applicant: salesforce.com, inc.

Inventor： Xuan Phi Nguyen ,  Shafiq Rayhan Joty ,  Chu Hong Hoi

IPC: G06F40/205

Abstract: Embodiments described herein provide an attention-based tree encoding mechanism. Specifically, the attention layer receives as input the pre-parsed constituency tree of a sentence and the lower-layer representations of all nodes. The attention layer then performs upward accumulation to encode the tree structure from leaves to the root in a bottom-up fashion. Afterwards, weighted aggregation is used to compute the final representations of non-terminal nodes.

公开(公告)号：US20210049236A1

公开(公告)日：2021-02-18

申请号：US16581035

申请日：2019-09-24

Applicant: salesforce.com, inc.

Inventor： Xuan Phi Nguyen ,  Shafiq Rayhan Joty ,  Chu Hong Hoi

IPC: G06F17/27

Abstract: Embodiments described herein provide an attention-based tree encoding mechanism. Specifically, the attention layer receives as input the pre-parsed constituency tree of a sentence and the lower-layer representations of all nodes. The attention layer then performs upward accumulation to encode the tree structure from leaves to the root in a bottom-up fashion. Afterwards, weighted aggregation is used to compute the final representations of non-terminal nodes.