公开(公告)号：US20190228495A1

公开(公告)日：2019-07-25

申请号：US16255038

申请日：2019-01-23

申请人： Nvidia Corporation

发明人： Jonathan Tremblay ,  Stan Birchfield ,  Stephen Tyree ,  Thang To ,  Jan Kautz ,  Artem Molchanov

IPC分类号： G06T1/00 ,  G06T7/73 ,  B25J9/16

摘要： Various embodiments enable a robot, or other autonomous or semi-autonomous device or system, to receive data involving the performance of a task in the physical world. The data can be provided as input to a perception network to infer a set of percepts about the task, which can correspond to relationships between objects observed during the performance. The percepts can be provided as input to a plan generation network, which can infer a set of actions as part of a plan. Each action can correspond to one of the observed relationships. The plan can be reviewed and any corrections made, either manually or through another demonstration of the task. Once the plan is verified as correct, the plan (and any related data) can be provided as input to an execution network that can infer instructions to cause the robot, and/or another robot, to perform the task.

公开(公告)号：US20210390653A1

公开(公告)日：2021-12-16

申请号：US17458221

申请日：2021-08-26

申请人： Nvidia Corporation

发明人： Jonathan Tremblay ,  Stan Birchfield ,  Stephen Tyree ,  Thang To ,  Jan Kautz ,  Artem Molchanov

IPC分类号： G06T1/00 ,  G06T7/73 ,  B25J9/16 ,  G06N3/08 ,  G05B13/00

摘要： Various embodiments enable a robot, or other autonomous or semi-autonomous device or system, to receive data involving the performance of a task in the physical world. The data can be provided as input to a perception network to infer a set of percepts about the task, which can correspond to relationships between objects observed during the performance. The percepts can be provided as input to a plan generation network, which can infer a set of actions as part of a plan. Each action can correspond to one of the observed relationships. The plan can be reviewed and any corrections made, either manually or through another demonstration of the task. Once the plan is verified as correct, the plan (and any related data) can be provided as input to an execution network that can infer instructions to cause the robot, and/or another robot, to perform the task.

公开(公告)号：US11941719B2

公开(公告)日：2024-03-26

申请号：US16255038

申请日：2019-01-23

申请人： Nvidia Corporation

发明人： Jonathan Tremblay ,  Stan Birchfield ,  Stephen Tyree ,  Thang To ,  Jan Kautz ,  Artem Molchanov

IPC分类号： G06T9/00 ,  B25J9/16 ,  G05B13/00 ,  G06N3/08 ,  G06T1/00 ,  G06T7/73 ,  G05D1/00

CPC分类号： G06T1/0014 ,  B25J9/161 ,  B25J9/1661 ,  B25J9/1697 ,  G05B13/00 ,  G06N3/08 ,  G06T7/73 ,  G05D1/0088 ,  G05D1/0221 ,  G05D2201/0213 ,  G06T2207/20081 ,  G06T2207/20084

摘要： Various embodiments enable a robot, or other autonomous or semi-autonomous device or system, to receive data involving the performance of a task in the physical world. The data can be provided as input to a perception network to infer a set of percepts about the task, which can correspond to relationships between objects observed during the performance. The percepts can be provided as input to a plan generation network, which can infer a set of actions as part of a plan. Each action can correspond to one of the observed relationships. The plan can be reviewed and any corrections made, either manually or through another demonstration of the task. Once the plan is verified as correct, the plan (and any related data) can be provided as input to an execution network that can infer instructions to cause the robot, and/or another robot, to perform the task.