公开(公告)号：US20230150550A1

公开(公告)日：2023-05-18

申请号：US17988701

申请日：2022-11-16

Applicant: Waymo LLC

Inventor： Xinwei Shi ,  Tian Lan ,  Jonathan Chandler Stroud ,  Zhishuai Zhang ,  Junhua Mao ,  Jeonhyung Kang ,  Khaled Refaat ,  Jiachen Li

IPC: B60W60/00 ,  B60W50/00 ,  B60W40/04 ,  G06N3/04 ,  G06N3/08

CPC classification number: B60W60/00274 ,  B60W60/0015 ,  B60W50/0097 ,  B60W40/04 ,  G06N3/049 ,  G06N3/08 ,  B60W2554/4029 ,  B60W2554/4045 ,  B60W2554/4046 ,  B60W2554/408 ,  B60W2556/10

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for agent behavior prediction using keypoint data. One of the methods includes obtaining data characterizing a scene in an environment, the data comprising: (i) context data comprising data characterizing historical trajectories of a plurality of agents up to the current time point; and (ii) keypoint data for a target agent; processing the context data using a context data encoder neural network to generate a context embedding for the target agent; processing the keypoint data using a keypoint encoder neural network to generate a keypoint embedding for the target agent; generating a combined embedding for the target agent from the context embedding and the keypoint embedding; and processing the combined embedding using a decoder neural network to generate a behavior prediction output for the target agent that characterizes predicted behavior of the target agent after the current time point.