公开(公告)号：US10977518B1

公开(公告)日：2021-04-13

申请号：US16355617

申请日：2019-03-15

Applicant: Amazon Technologies, Inc.

Inventor： Rahul Sharma ,  Vikram Madan ,  James Robert Blair ,  Charles Bell

IPC: G06K9/62 ,  G06N5/04 ,  G06N20/00

Abstract: Techniques for generating and utilizing machine learning based adaptive instructions for annotation are described. An annotation service can use models to identify edge case data elements predicted to elicit differing annotations from annotators, “bad” data elements predicted to be difficult to annotate, and/or “good” data elements predicted to elicit matching or otherwise high-quality annotations from annotators. These sets of data elements can be automatically incorporated into annotation job instructions provided to annotators, resulting in improved overall annotation results via having efficiently and effectively “trained” the annotators how to perform the annotation task.