公开(公告)号：US20250156456A1

公开(公告)日：2025-05-15

申请号：US18947752

申请日：2024-11-14

Applicant: Google LLC

Inventor： Ruoxi Sun ,  Xi Ye ,  Sercan Omer Arik

IPC: G06F16/332 ,  G06F40/30

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for grounding LLMs. In one aspect, a method includes accessing responses from a large language model, each response comprising data including: a query, an answer to the query, the answer comprising one or more statements, citations linking each statement to an evidence passage in a corpus; determining a grounding quality of the answer based on the evidence passages and the statements using an attribution evaluation model, wherein the grounding quality is a quantification of attribution of the statements in the answer to a document corpus; and tuning the large language model to obtain an adapted large language model that satisfies a grounding constraint based on grounding quality score.