Method and device for navigation mesh exploration

    公开(公告)号:US11804012B1

    公开(公告)日:2023-10-31

    申请号:US17323799

    申请日:2021-05-18

    Applicant: Apple Inc.

    CPC classification number: G06T19/003 G06T17/20

    Abstract: In some implementations, a method of navigation mesh exploration is performed at a virtual agent operating system. The method includes: determining one or more first sensory perception regions for one or more senses of a virtual agent based on a first perceptual vector associated with the virtual agent; generating a first portion of a navigation mesh for the XR environment based on the one or more first sensory perception regions, wherein the first portion of the navigation mesh includes candidate subsequent locations different from the first location; and in response to detecting movement of the virtual agent to a respective candidate subsequent location among candidate subsequent locations, generating a second portion of the navigation mesh for the XR environment based on one or more second sensory perception regions for the one or more senses of the virtual agent relative to the respective candidate subsequent location.

    Methods and Systems for Composing and Executing a Scene

    公开(公告)号:US20250054249A1

    公开(公告)日:2025-02-13

    申请号:US18926113

    申请日:2024-10-24

    Applicant: Apple Inc.

    Abstract: In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.

    Modeling a physical environment based on saliency

    公开(公告)号:US11869144B1

    公开(公告)日:2024-01-09

    申请号:US17678229

    申请日:2022-02-23

    Applicant: Apple Inc.

    CPC classification number: G06T17/00 G06T15/04 G06V10/462

    Abstract: In some implementations, a device includes one or more sensors, one or more processors and a non-transitory memory. In some implementations, a method includes determining that a first portion of a physical environment is associated with a first saliency value and a second portion of the physical environment is associated with a second saliency value that is different from the first saliency value. In some implementations, the method includes obtaining, via the one or more sensors, environmental data corresponding to the physical environment. In some implementations, the method includes generating, based on the environmental data, a model of the physical environment by modeling the first portion with a first set of modeling features that is a function of the first saliency value and modeling the second portion with a second set of modeling features that is a function of the second saliency value.

    Directing a virtual agent based on eye behavior of a user

    公开(公告)号:US12210678B2

    公开(公告)日:2025-01-28

    申请号:US18381472

    申请日:2023-10-18

    Applicant: Apple Inc.

    Abstract: According to various implementations, a method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a virtual agent that is associated with a first viewing frustum. The first viewing frustum includes a user avatar associated with a user, and the user avatar includes a visual representation of one or more eyes. The method includes, while displaying the virtual agent associated with the first viewing frustum, obtaining eye tracking data that is indicative of eye behavior associated with an eye of the user, updating the visual representation of one or more eyes based on the eye behavior, and directing the virtual agent to perform an action based on the updating and scene information associated with the electronic device.

    Power-Sensitive Control of Virtual Agents
    6.
    发明公开

    公开(公告)号:US20240038228A1

    公开(公告)日:2024-02-01

    申请号:US18226536

    申请日:2023-07-26

    Applicant: Apple Inc.

    CPC classification number: G10L15/22 G10L2015/228

    Abstract: In some implementations, a method includes displaying, on a display, an environment that includes a representation of a virtual agent that is associated with a sensory characteristic. In some implementations, the method includes selecting, based on the sensory characteristic associated with the virtual agent, a subset of a plurality of sensors to provide sensor data for the virtual agent. In some implementations, the method includes providing the sensor data captured by the subset of the plurality of sensors to the virtual agent in order to reduce power consumption of the device. In some implementations, the method includes displaying a manipulation of the representation of the virtual agent based on an interpretation of the sensor data by the virtual agent.

    Methods and Systems for Composing and Executing a Scene

    公开(公告)号:US20230089049A1

    公开(公告)日:2023-03-23

    申请号:US17853557

    申请日:2022-06-29

    Applicant: Apple Inc.

    Abstract: In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.

    Directing a Virtual Agent Based on Eye Behavior of a User

    公开(公告)号:US20230026511A1

    公开(公告)日:2023-01-26

    申请号:US17848818

    申请日:2022-06-24

    Applicant: Apple Inc.

    Abstract: According to various implementations, a method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a virtual agent that is associated with a first viewing frustum. The first viewing frustum includes a user avatar associated with a user, and the user avatar includes a visual representation of one or more eyes. The method includes, while displaying the virtual agent associated with the first viewing frustum, obtaining eye tracking data that is indicative of eye behavior associated with an eye of the user, updating the visual representation of one or more eyes based on the eye behavior, and directing the virtual agent to perform an action based on the updating and scene information associated with the electronic device.

    Methods and systems for composing and executing a scene

    公开(公告)号:US12169902B2

    公开(公告)日:2024-12-17

    申请号:US17853557

    申请日:2022-06-29

    Applicant: Apple Inc.

    Abstract: In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.

    Environmentally Aware Gestures
    10.
    发明公开

    公开(公告)号:US20240085987A1

    公开(公告)日:2024-03-14

    申请号:US18367146

    申请日:2023-09-12

    Applicant: Apple Inc.

    CPC classification number: G06F3/017 G06T13/40 G06V40/20

    Abstract: In one implementation, a method of presenting a scene is performed at a device including a display, one or more processors, and non-transitory memory. The method includes displaying, on the display, a virtual character in association with a physical environment at a character location in a three-dimensional coordinate system of the physical environment. The method includes determining, for an object, an object location in the three-dimensional coordinate system of the physical environment. The method includes displaying, on the display, the virtual character at the character location performing a gesture based on the object location.

Patent Agency Ranking