公开(公告)号：US20210374520A1

公开(公告)日：2021-12-02

申请号：US16886470

申请日：2020-05-28

Applicant: salesforce.com, inc.

Inventor： Arthur Zhang ,  Joshua Correa

IPC: G06N3/08 ,  G06N7/00

Abstract: Systems, devices, and techniques are disclosed for recommendations using a transformer neural network. User activity data including items and actions associated with users and a catalog including descriptions of the items may be received. User vectors for the users, item vectors for the items and action vectors the actions may be generated by applying singular vector decomposition to the user activity data. Sequence vectors may be generated based on item vectors and the action vectors. Transformer vectors may be generated by applying a text-to-text transferring transformer to descriptions of the items. Similarity vectors may be generated based on the transformer vectors. Merged vectors may be generated by merging the sequence vector, transformer vector, and similarity vector for items. A set of probabilities may be determined by inputting the user vector for the user, merged vectors for the items, and sequence vectors for the actions to a transformer neural network.

公开(公告)号：US11676015B2

公开(公告)日：2023-06-13

申请号：US16886470

申请日：2020-05-28

Applicant: salesforce.com, inc.

Inventor： Arthur Zhang ,  Joshua Correa

IPC: G06N3/08 ,  G06N20/20 ,  G06Q30/0601 ,  G06N7/01

CPC classification number: G06N3/08 ,  G06N7/01 ,  G06N20/20 ,  G06Q30/0631

Abstract: Systems, devices, and techniques are disclosed for recommendations using a transformer neural network. User activity data including items and actions associated with users and a catalog including descriptions of the items may be received. User vectors for the users, item vectors for the items and action vectors the actions may be generated by applying singular vector decomposition to the user activity data. Sequence vectors may be generated based on item vectors and the action vectors. Transformer vectors may be generated by applying a text-to-text transferring transformer to descriptions of the items. Similarity vectors may be generated based on the transformer vectors. Merged vectors may be generated by merging the sequence vector, transformer vector, and similarity vector for items. A set of probabilities may be determined by inputting the user vector for the user, merged vectors for the items, and sequence vectors for the actions to a transformer neural network.