公开(公告)号：US20230119109A1

公开(公告)日：2023-04-20

申请号：US17586467

申请日：2022-01-27

Applicant: salesforce.com, inc.

Inventor： Prafulla Kumar Choubey ,  Nazneen Rajani

IPC: G06N20/20 ,  G06K9/62 ,  G06F40/284

Abstract: Embodiments described herein provide a document summarization framework that controls different factual errors, referred to as “Mixture of Factual Experts (MoFE)” framework. MoFE applies an ensemble of factual expert models to control hallucination in summarization systems. Each factual expert model is trained to generate summaries with a unique type of factual quality. Factual consistency metrics may be used to filter training data in order to adjust the training inputs for each respective expert. The overall factual quality of MoFE may be achieved by controlling the relative weight of each factual expert. The experts may be ensembled (either through logits ensembling, or weighted average of parameters) in order to create a combined output that shares characteristics from each according to its relative weight.