公开(公告)号：US20230129665A1

公开(公告)日：2023-04-27

申请号：US17457874

申请日：2021-12-06

Applicant: Microsoft Technology Licensing, LLC

Inventor： Peeyush KUMAR ,  Hui Qing LI ,  Vaishnavi NATTAR RANGANATHAN ,  Lillian Jane RATLIFF ,  Ranveer CHANDRA ,  Vishal JAIN ,  Michael McNab BASSANI ,  Jeremy Randall REYNOLDS

IPC: G06K9/62 ,  G06Q10/08

Abstract: A computing system including a processor configured to receive training data including, for each of a plurality of training timesteps, training forecast states associated with respective training-phase agents included in a training supply chain graph. The processor may train a reinforcement learning simulation of the training supply chain graph using the training data via policy gradient reinforcement learning. At each training timestep, the training forecast states may be shared between simulations of the training-phase agents during training. The processor may receive runtime forecast states associated with respective runtime agents included in a runtime supply chain graph. For a runtime agent, at the trained reinforcement learning simulation, the processor may generate a respective runtime action output associated with a corresponding runtime forecast state of the runtime agent based at least in part on the runtime forecast states. The processor may output the runtime action output.