-
公开(公告)号:US12210678B2
公开(公告)日:2025-01-28
申请号:US18381472
申请日:2023-10-18
Applicant: Apple Inc.
Inventor: Mu Qiao , Dan Feng , Bo Morgan , Mark E. Drummond
Abstract: According to various implementations, a method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a virtual agent that is associated with a first viewing frustum. The first viewing frustum includes a user avatar associated with a user, and the user avatar includes a visual representation of one or more eyes. The method includes, while displaying the virtual agent associated with the first viewing frustum, obtaining eye tracking data that is indicative of eye behavior associated with an eye of the user, updating the visual representation of one or more eyes based on the eye behavior, and directing the virtual agent to perform an action based on the updating and scene information associated with the electronic device.
-
公开(公告)号:US12008720B1
公开(公告)日:2024-06-11
申请号:US17746218
申请日:2022-05-17
Applicant: Apple Inc.
Inventor: Bo Morgan , Payal Jotwani , Angela Blechschmidt , Mark E. Drummond , Daniel Ulbricht
CPC classification number: G06T19/003 , G06T2200/24 , G06T2210/61
Abstract: In one implementation, a method of achieving an objective using a scene graph includes identifying a set of transition couples of a plurality of transition couples between sets of spatial relationships of the scene graph, wherein each spatial relationship of a respective first set of spatial relationships indicated by each transition couple of the set of transition couples is included in an initial set of spatial relationships or an respective second set of spatial relationships indicated by a previous transition couple and wherein a particular spatial relationship is included in a respective second set of spatial relationships of a last transition couple of the set of transition couples.
-
公开(公告)号:US20240038228A1
公开(公告)日:2024-02-01
申请号:US18226536
申请日:2023-07-26
Applicant: Apple Inc.
Inventor: Dan Feng , Behrooz Mahasseni , Bo Morgan , Daniel L. Kovacs , Mu Qiao
IPC: G10L15/22
CPC classification number: G10L15/22 , G10L2015/228
Abstract: In some implementations, a method includes displaying, on a display, an environment that includes a representation of a virtual agent that is associated with a sensory characteristic. In some implementations, the method includes selecting, based on the sensory characteristic associated with the virtual agent, a subset of a plurality of sensors to provide sensor data for the virtual agent. In some implementations, the method includes providing the sensor data captured by the subset of the plurality of sensors to the virtual agent in order to reduce power consumption of the device. In some implementations, the method includes displaying a manipulation of the representation of the virtual agent based on an interpretation of the sensor data by the virtual agent.
-
公开(公告)号:US11699270B2
公开(公告)日:2023-07-11
申请号:US17740052
申请日:2022-05-09
Applicant: Apple Inc.
Inventor: Bo Morgan , Mark E. Drummond , Peter Meier , Cameron J. Dunn , John Christopher Russell , Siva Chandra Mouli Sivapurapu , Ian M. Richter
CPC classification number: G06T19/006 , A63F13/55 , G06F3/011 , G06F40/14
Abstract: In various implementations, a device surveys a scene and presents, within the scene, a extended reality (XR) environment including one or more assets that evolve over time (e.g., change location or age). Modeling such an XR environment at various timescales can be computationally intensive, particularly when modeling the XR environment over larger timescales. Accordingly, in various implementations, different models are used to determine the environment state of the XR environment when presenting the XR environment at different timescales.
-
公开(公告)号:US20230089049A1
公开(公告)日:2023-03-23
申请号:US17853557
申请日:2022-06-29
Applicant: Apple Inc.
Inventor: Mark E. Drummond , Daniel L. Kovacs , Shaun D. Budhram , Edward Ahn , Behrooz Mahasseni , Aashi Manglik , Payal Jotwani , Mu Qiao , Bo Morgan , Noah Gamboa , Michael J. Gutensohn , Dan Feng , Siva Chandra Mouli Sivapurapu
IPC: G06T19/00
Abstract: In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.
-
公开(公告)号:US20230026511A1
公开(公告)日:2023-01-26
申请号:US17848818
申请日:2022-06-24
Applicant: Apple Inc.
Inventor: Mu Qiao , Dan Feng , Bo Morgan , Mark E. Drummond
Abstract: According to various implementations, a method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a virtual agent that is associated with a first viewing frustum. The first viewing frustum includes a user avatar associated with a user, and the user avatar includes a visual representation of one or more eyes. The method includes, while displaying the virtual agent associated with the first viewing frustum, obtaining eye tracking data that is indicative of eye behavior associated with an eye of the user, updating the visual representation of one or more eyes based on the eye behavior, and directing the virtual agent to perform an action based on the updating and scene information associated with the electronic device.
-
公开(公告)号:US20210398327A1
公开(公告)日:2021-12-23
申请号:US17465334
申请日:2021-09-02
Applicant: Apple Inc.
Inventor: Mark Drummond , Bo Morgan , Siva Chandra Mouli Sivapurapu
Abstract: In some implementations, a method includes obtaining, by a virtual intelligent agent (VIA), a perceptual property vector (PPV) for a graphical representation of a physical element. In some implementations, the PPV includes one or more perceptual characteristic values characterizing the graphical representation of the physical element. In some implementations, the method includes instantiating a graphical representation of the VIA in a graphical environment that includes the graphical representation of the physical element and an affordance that is associated with the graphical representation of the physical element. In some implementations, the method includes generating, by the VIA, an action for the graphical representation of the VIA based on the PPV. In some implementations, the method includes displaying a manipulation of the affordance by the graphical representation of the VIA in order to effectuate the action generated by the VIA.
-
公开(公告)号:US20210272381A1
公开(公告)日:2021-09-02
申请号:US17325454
申请日:2021-05-20
Applicant: Apple Inc.
Inventor: Mark Drummond , Siva Chandra Mouli Sivapurapu , Bo Morgan
Abstract: A method includes generating, in coordination with an emergent content engine, a first objective for a first objective-effectuator and a second objective for a second objective-effectuator instantiated in a computer-generated reality (CGR) environment. The first and second objectives are associated with a mutual plan. The method includes generating, based on characteristic values associated with the first and second objective-effectuators a first directive for the first objective-effectuator and a second directive for the second objective-effectuator. The first directive limits actions generated by the first objective-effectuator over a first set of time frames associated with the first objective and the second directive limits actions generated by the second objective-effectuator over a second set of time frames associated with the second objective. The method includes displaying manipulations of CGR representations of the first and second objective-effectuators in the CGR environment in accordance with the first and second directives.
-
公开(公告)号:US11055930B1
公开(公告)日:2021-07-06
申请号:US16862998
申请日:2020-04-30
Applicant: Apple Inc.
Inventor: Mark Drummond , Siva Chandra Mouli Sivapurapu , Bo Morgan
Abstract: A method includes generating, in coordination with an emergent content engine, a first objective for a first objective-effectuator and a second objective for a second objective-effectuator instantiated in a computer-generated reality (CGR) environment. The first and second objectives are associated with a mutual plan. The method includes generating, based on characteristic values associated with the first and second objective-effectuators a first directive for the first objective-effectuator and a second directive for the second objective-effectuator. The first directive limits actions generated by the first objective-effectuator over a first set of time frames associated with the first objective and the second directive limits actions generated by the second objective-effectuator over a second set of time frames associated with the second objective. The method includes displaying manipulations of CGR representations of the first and second objective-effectuators in the CGR environment in accordance with the first and second directives.
-
-
-
-
-
-
-
-