公开(公告)号：US11934952B2

公开(公告)日：2024-03-19

申请号：US17124317

申请日：2020-12-16

Applicant: Salesforce, Inc.

Inventor： Tianxing He ,  Ehsan Hosseini-Asl ,  Bryan McCann ,  Caiming Xiong

IPC: G06N3/08

CPC classification number: G06N3/08

Abstract: Embodiments described herein provide natural language processing (NLP) systems and methods that utilize energy-based models (EBMs) to compute an exponentially-weighted energy-like term in the loss function to train an NLP classifier. Specifically, noise contrastive estimation (NCE) procedures are applied together with the EBM-based loss objectives for training the NLPs.