公开(公告)号：US12112131B2

公开(公告)日：2024-10-08

申请号：US17588043

申请日：2022-01-28

Applicant: Salesforce, Inc.

Inventor： Benjamin Newman ,  Nazneen Rajani ,  Prafulla Kumar Choubey

IPC: G06F40/30 ,  G06F3/08 ,  G06F40/126 ,  G06F40/279 ,  G06N3/044

CPC classification number: G06F40/279 ,  G06F40/126 ,  G06N3/044

Abstract: Embodiments described herein provide a system and method for extracting factual information. The system transforms a query into a natural language prompt in a format of a query subject and a queried relation. The system encodes, via an embedding layer of a pre-trained language model, the natural language prompt into a first embedding. The system encodes, via the adapter model, the first embedding into a second embedding based on a probability that the second embedding returns the factual information when the second embedding is fed the first attention layer of the pre-trained language model. The system decodes, by the first attention layer of the pre-trained language mode, the second embedding into a response to the query. The system extracts the factual information from the decoded response to the query.