公开(公告)号：US12131529B2

公开(公告)日：2024-10-29

申请号：US18098625

申请日：2023-01-18

Applicant: TOYOTA RESEARCH INSTITUTE, INC.

Inventor： Jeremy Ma ,  Josh Petersen ,  Umashankar Nagarajan ,  Michael Laskey ,  Daniel Helmick ,  James Borders ,  Krishna Shankar ,  Kevin Stone ,  Max Bajracharya

IPC: B25J9/16 ,  G06F18/214 ,  G06F18/28 ,  G06N3/08 ,  G06T7/246 ,  G06T7/33 ,  G06T7/55 ,  G06T7/73 ,  G06T19/20 ,  G06V10/75 ,  G06V10/764 ,  G06V10/774 ,  G06V10/82 ,  G06V20/10 ,  G06V20/20

CPC classification number: G06V20/10 ,  B25J9/1605 ,  B25J9/1661 ,  B25J9/1664 ,  B25J9/1671 ,  B25J9/1697 ,  G06F18/214 ,  G06F18/28 ,  G06N3/08 ,  G06T7/248 ,  G06T7/33 ,  G06T7/55 ,  G06T7/74 ,  G06T19/20 ,  G06V10/751 ,  G06V10/764 ,  G06V10/774 ,  G06V10/82 ,  G06V20/20 ,  B25J9/163 ,  G05B2219/37567 ,  G05B2219/40543 ,  G05B2219/40564 ,  G06T2200/04 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/20081 ,  G06T2207/20104

Abstract: A method for performing a task by a robotic device includes mapping a group of task image pixel descriptors associated with a first group of pixels in a task image of a task environment to a group of teaching image pixel descriptors associated with a second group of pixels in a teaching image based on positioning the robotic device within the task environment. The method also includes determining a relative transform between the task image and the teaching image based on mapping the plurality of task image pixel descriptors. The relative transform indicates a change in one or more of points of 3D space between the task image and the teaching image. The method also includes performing the task associated with the set of parameterized behaviors based on updating one or more parameters of a set of parameterized behaviors associated with the teaching image based on determining the relative transform.

公开(公告)号：US11580724B2

公开(公告)日：2023-02-14

申请号：US16570852

申请日：2019-09-13

Applicant: TOYOTA RESEARCH INSTITUTE, INC.

Inventor： Jeremy Ma ,  Josh Petersen ,  Umashankar Nagarajan ,  Michael Laskey ,  Daniel Helmick ,  James Borders ,  Krishna Shankar ,  Kevin Stone ,  Max Bajracharya

IPC: B25J9/16 ,  G06V20/10 ,  G06T7/73 ,  G06T7/55 ,  G06K9/62 ,  G06N3/08 ,  G06T19/20 ,  G06T7/246 ,  G06T7/33 ,  G06V10/75 ,  G06V20/20

Abstract: A method for controlling a robotic device is presented. The method includes positioning the robotic device within a task environment. The method also includes mapping descriptors of a task image of a scene in the task environment to a teaching image of a teaching environment. The method further includes defining a relative transform between the task image and the teaching image based on the mapping. Furthermore, the method includes updating parameters of a set of parameterized behaviors based on the relative transform to perform a task corresponding to the teaching image.