公开(公告)号：US11379471B1

公开(公告)日：2022-07-05

申请号：US16998252

申请日：2020-08-20

Applicant: Apple Inc.

Inventor： Daniel Laszlo Kovacs

IPC: G06F16/23 ,  G06F16/245 ,  G06F16/28

Abstract: A method includes maintaining a hierarchical datastore for an agent instantiated in a computer-generated reality (CGR) environment. The hierarchical datastore includes a first storage hierarchy associated with a first data type and a second storage hierarchy associated with a second data type. The method includes detecting a sensory input that includes sensory input data. The method includes determining a type of the sensory input data. The method includes, in response to the sensory input data being of the first data type, storing the sensory input data in the first storage hierarchy for a first amount of time associated with the first storage hierarchy. The method includes, in response to the sensory input data being of the second data type, storing the sensory input data in the second storage hierarchy for a second amount of time that is different from the first amount of time.

公开(公告)号：US12249016B2

公开(公告)日：2025-03-11

申请号：US18136700

申请日：2023-04-19

Applicant: Apple Inc.

Inventor： Daniel Laszlo Kovacs

IPC: G06T13/40 ,  G06N3/006 ,  G06N20/00 ,  G06T19/00 ,  G06T19/20

Abstract: A method includes obtaining, by a first agent engine that generates actions for a first agent, a first objective of the first agent. In some implementations, the method includes generating, by the first agent engine, a first influence for a second agent engine that generates actions for a computer-generated reality (CGR) representation of a second agent. In some implementations, the first influence is based on the first objective of the first agent. In some implementations, the method includes triggering the CGR representation of the second agent to perform a set of one or more actions that advances the first objective of the first agent. In some implementations, the second agent engine generates the set of one or more actions based on the first influence generated by the first agent engine.

公开(公告)号：US11710276B1

公开(公告)日：2023-07-25

申请号：US17358876

申请日：2021-06-25

Applicant: Apple Inc.

Inventor： Daniel Laszlo Kovacs ,  Siva Chandra Mouli Sivapurapu ,  Payal Jotwani ,  Noah Jonathan Gamboa

IPC: G06T17/00 ,  G06N3/00 ,  G06T19/00

CPC classification number: G06T19/003

Abstract: In one implementation, a method for improved motion planning. The method includes: obtaining a macro task for a virtual agent within a virtual environment; generating a search-tree based on at least one of the macro task, a state of the virtual environment, and a state of the virtual agent, wherein the search-tree includes a plurality of task nodes corresponding to potential tasks for performance by the virtual agent in furtherance of the macro task; and determining physical motion plans (PMPs) for at least some of the plurality of task nodes within the search-tree in order to generate a lookahead planning gradient for the first time, wherein a granularity of a PMP for a respective task node in the first search-tree is a function of the temporal distance of the respective task node from the first time.

公开(公告)号：US11645797B1

公开(公告)日：2023-05-09

申请号：US16998257

申请日：2020-08-20

Applicant: Apple Inc.

Inventor： Daniel Laszlo Kovacs

IPC: G06T13/00 ,  G06N3/08 ,  G06N3/04

CPC classification number: G06T13/00 ,  G06N3/04 ,  G06N3/08

Abstract: Various implementations disclosed herein include devices, systems, and methods for controlling motion of CGR objects. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, a method includes determining, by a first animation controller, values for a first set of animation parameters associated with a first animation for a computer-generated reality (CGR) object. In some implementations, the CGR object is associated with a plurality of joints. In some implementations, the method includes generating, by a motion controller, respective joint movements for the plurality of joints based on the values for the first set of animation parameters. In some implementations, the method includes manipulating the CGR object in accordance with the respective joint movements for the plurality of joints in order to provide an appearance that CGR object is moving within a degree of similarity to the first animation.

公开(公告)号：US11532139B1

公开(公告)日：2022-12-20

申请号：US17323775

申请日：2021-05-18

Applicant: Apple Inc.

Inventor： Daniel Laszlo Kovacs ,  Payal Jotwani

IPC: G06T19/00 ,  G06T17/20 ,  G06T15/08

Abstract: In some implementations, a method of improved pathfinding is performed at a virtual agent operating system including non-transitory memory and one or more processors coupled with the non-transitory memory. The method includes: determining an initial path for a virtual agent to a target destination based at least in part on a navigation mesh of an XR environment; actuating locomotive elements of the virtual agent in order to move the virtual agent according to the initial path; while moving according to the initial path, detecting a node of a navigation graph; in response to detecting the node of the navigation graph: obtaining navigation information from the node of the navigation graph; and determining an updated path from the node to the target destination based at least in part on the navigation mesh and the navigation information; and actuating the locomotive elements of the virtual agent according to the updated path.

公开(公告)号：US20230377237A1

公开(公告)日：2023-11-23

申请号：US18136700

申请日：2023-04-19

Applicant: Apple Inc.

Inventor： Daniel Laszlo Kovacs

IPC: G06T13/40 ,  G06T19/00 ,  G06T19/20 ,  G06N3/006 ,  G06N20/00

CPC classification number: G06T13/40 ,  G06T19/006 ,  G06T19/20 ,  G06N3/006 ,  G06N20/00

Abstract: A method includes obtaining, by a first agent engine that generates actions for a first agent, a first objective of the first agent. In some implementations, the method includes generating, by the first agent engine, a first influence for a second agent engine that generates actions for a computer-generated reality (CGR) representation of a second agent. In some implementations, the first influence is based on the first objective of the first agent. In some implementations, the method includes triggering the CGR representation of the second agent to perform a set of one or more actions that advances the first objective of the first agent. In some implementations, the second agent engine generates the set of one or more actions based on the first influence generated by the first agent engine.

公开(公告)号：US11804012B1

公开(公告)日：2023-10-31

申请号：US17323799

申请日：2021-05-18

Applicant: Apple Inc.

Inventor： Daniel Laszlo Kovacs ,  Payal Jotwani ,  Dan Feng

IPC: G06T19/00 ,  G06T17/20

CPC classification number: G06T19/003 ,  G06T17/20

Abstract: In some implementations, a method of navigation mesh exploration is performed at a virtual agent operating system. The method includes: determining one or more first sensory perception regions for one or more senses of a virtual agent based on a first perceptual vector associated with the virtual agent; generating a first portion of a navigation mesh for the XR environment based on the one or more first sensory perception regions, wherein the first portion of the navigation mesh includes candidate subsequent locations different from the first location; and in response to detecting movement of the virtual agent to a respective candidate subsequent location among candidate subsequent locations, generating a second portion of the navigation mesh for the XR environment based on one or more second sensory perception regions for the one or more senses of the virtual agent relative to the respective candidate subsequent location.

公开(公告)号：US11670028B1

公开(公告)日：2023-06-06

申请号：US16998263

申请日：2020-08-20

Applicant: Apple Inc.

Inventor： Daniel Laszlo Kovacs

IPC: G06T13/40 ,  G06N20/00 ,  G06T19/00 ,  G06T19/20 ,  G06N3/006

CPC classification number: G06T13/40 ,  G06N3/006 ,  G06N20/00 ,  G06T19/006 ,  G06T19/20

Abstract: A method includes obtaining, by a first agent engine that generates actions for a first agent, a first objective of the first agent. In some implementations, the method includes generating, by the first agent engine, a first influence for a second agent engine that generates actions for a computer-generated reality (CGR) representation of a second agent. In some implementations, the first influence is based on the first objective of the first agent. In some implementations, the method includes triggering the CGR representation of the second agent to perform a set of one or more actions that advances the first objective of the first agent. In some implementations, the second agent engine generates the set of one or more actions based on the first influence generated by the first agent engine.