公开(公告)号：US20240362940A1

公开(公告)日：2024-10-31

申请号：US18306604

申请日：2023-04-25

Applicant: Google LLC

Inventor： Jing Xiong ,  Tianli Yu ,  Shengyang Dai

IPC: G06V30/19

CPC classification number: G06V30/1912 ,  G06V30/1916

Abstract: A method includes receiving, from a user device associated with a user, a plurality of annotated documents. Each respective annotated document includes one or more fields and each respective field labeled by a respective annotation. The method includes, for a threshold number of iterations, randomly selecting a respective subset of annotated documents from the plurality of annotated documents; training a respective model on the respective subset of annotated documents; and generating, using the plurality of annotated documents not selected for the respective subset of annotated documents, a respective evaluation of the respective model. The method also includes providing, to the user device, each respective evaluation.