公开(公告)号：US11847670B1

公开(公告)日：2023-12-19

申请号：US17955783

申请日：2022-09-29

Applicant: Amazon Technologies, Inc.

Inventor： Xinyu Zhou ,  Xing Zhao ,  Qie Hu Huang ,  Kirtan Modi ,  Jae In Cho ,  Jiahui Jeff Wang

IPC: G06Q30/02 ,  G06Q30/0251 ,  G06Q30/0241 ,  G06Q30/0273

CPC classification number: G06Q30/0255 ,  G06Q30/0275 ,  G06Q30/0277

Abstract: Systems, devices, and methods are described herein for improving inventory management. As used herein, “inventory” refers to digital space at an inventory providers webpage at which content can be delivered. The disclosed techniques utilize reinforced machine learning and an offline training process to train various models with which a content request corresponding to the inventory can be classified according to historical requests and a selection process identified for the request (e.g., a direct or an indirect selection process). If an indirect selection process is chosen, the content request may be optimized for that process utilizing additional machine learning models trained using reinforced machine learning and the offline training process. The disclosed techniques enable the inventory provider to optimize content selections according to a preferred objective. The training operations are performed offline, in a training system configured to simulate the run time environment.