-
公开(公告)号:US20240338086A1
公开(公告)日:2024-10-10
申请号:US18746675
申请日:2024-06-18
Applicant: Meta Platforms Technologies, LLC
Inventor: Aaron FAUCHER , Pol PLA I CONESA , Daniel ROSAS , Nathan ASCHENBACH
IPC: G06F3/01 , G06F3/04886
CPC classification number: G06F3/017 , G06F3/013 , G06F3/04886 , G06F3/011
Abstract: Aspects of the present disclosure are directed to triggering virtual keyboard selections using multiple input modalities. An interface manager can display an interface, such as a virtual keyboard, to a user in an artificial reality environment. Implementations of the interface manager can track user eye gaze input and user hand input (e.g., hand or finger motion). The interface manager can resolve a character selection on the virtual keyboard according to the tracked user gaze input based on detection that the user's hand motion meets a trigger criteria. For example, the interface manager can: detect that the tracked user hand motion meets the trigger criteria at a given point in time; and resolve a selection from the virtual keyboard (e.g., selection of a displayed character) according to the tracked user gaze on the virtual keyboard at the given point in time.
-
公开(公告)号:US20240104870A1
公开(公告)日:2024-03-28
申请号:US18532438
申请日:2023-12-07
Applicant: Meta Platforms Technologies, LLC
Inventor: Anna FUSTE LLEIXA , Pol PLA I CONESA , Daniel ROSAS , Aaron FAUCHER , Roger IBARS MARTINEZ , Nathan ASCHENBACH , Hae Jin LEE , Jing MA , Ana GARCIA PUYOL , Amber CHOO
CPC classification number: G06T19/006 , G06F3/013 , G06F3/017 , G06T15/00
Abstract: In some implementations, the disclosed systems and methods can detect an interaction with respect to a set of virtual objects, which can start with a particular gesture, and take an action with respect to one or more virtual objects based on a further interaction (e.g., holding the gesture for a particular amount of time, moving the gesture in a particular direction, releasing the gesture, etc.).
In some implementations, the disclosed systems and methods can automatically review a 3D video to determine a depicted user or avatar movement pattern (e.g., dance moves, repair procedure, playing an instrument, etc.).
In some implementations, the disclosed systems and methods can allow the gesture to included a flat hand with the user's thumb next to the palm, with the gesture toward the user's face.-
公开(公告)号:US20240331287A1
公开(公告)日:2024-10-03
申请号:US18742396
申请日:2024-06-13
Applicant: Meta Platforms Technologies, LLC
Inventor: Yeliz KARADAYI , Wai Leong CHAK , Michal HLAVAC , Pol PLA I CONESA
CPC classification number: G06T17/005 , G06T13/40
Abstract: A virtual object system can orchestrate virtual objects defined as a collection of components and with inheritance in an object hierarchy. Virtual object components can include a container, data, a template, and a controller. A container can define the volume the virtual object is authorized to write into. A virtual object's data can specify features such as visual elements, parameters, links to external data, meta-data, etc. The template can define view states of the virtual object and contextual breakpoints for transitioning between them. Each view state can control when and how the virtual object presents data elements. The controller can define logic for the virtual object to respond to input, context, etc. The definition of each object can specify which other object in an object hierarchy that object extends, where extending an object includes inheriting that object's components, which can be modified or overwritten as part of the extension.
-
4.
公开(公告)号:US20240264851A1
公开(公告)日:2024-08-08
申请号:US18636891
申请日:2024-04-16
Applicant: Meta Platforms Technologies, LLC
Inventor: John Jacob BLAKELEY , Michal HLAVAC , Pol PLA I CONESA , Michael ISHIGAKI , Jonathan Michael PROTO , Paul MEALY , Kevin HARPER , Jenny KAM , Jossie E. TIRADO ARROYO
IPC: G06F9/451 , G06F3/0484 , G06T11/00
CPC classification number: G06F9/451 , G06F3/0484 , G06T11/00
Abstract: The present disclosure provides world-controlled augments and application-controlled augments. World-controlled augments can be controlled directly by a shell in the artificial reality environment. To allow even inexperienced users to develop world-controlled augments, a world-controlled builder system is provided. Application-controlled augments may be resource intensive (e.g., using eye-tracking, social-media tie-ins, etc.), may support complicated interactions among themselves, may require or have extensive use of inputs and permissioned resources, and are controlled by their hosting application. When a running application is halted, the application closes its application-controlled augments but can choose to have the XR system run a “place-holder” world-controlled augment for as long as the application is not running. The place-holder world-controlled augment preserves the appearance of the application in the artificial reality environment but uses few system resources. Upon a user selecting a place-holder world-controlled augment, the XR system can run the associated application and close the place-holder world-controlled augment.
-
公开(公告)号:US20230169745A1
公开(公告)日:2023-06-01
申请号:US18159280
申请日:2023-01-25
Applicant: Meta Platforms Technologies, LLC
Inventor: Yeliz KARADAYI , Wai Leong CHAK , Michal HLAVAC , Pol PLA I CONESA
CPC classification number: G06T19/20 , G06T19/006 , G06F16/2291 , G06T2200/24 , G06T2219/2008
Abstract: A virtual object system can orchestrate virtual objects defined as a collection of components and with inheritance in an object hierarchy. Virtual object components can include a container, data, a template, and a controller. A container can define the volume the virtual object is authorized to write into. A virtual object's data can specify features such as visual elements, parameters, links to external data, meta-data, etc. The template can define view states of the virtual object and contextual breakpoints for transitioning between them. Each view state can control when and how the virtual object presents data elements. The controller can define logic for the virtual object to respond to input, context, etc. The definition of each object can specify which other object in an object hierarchy that object extends, where extending an object includes inheriting that object's components, which can be modified or overwritten as part of the extension.
-
公开(公告)号:US20230324997A1
公开(公告)日:2023-10-12
申请号:US17717585
申请日:2022-04-11
Applicant: Meta Platforms Technologies, LLC
Inventor: Aaron FAUCHER , Pol PLA I CONESA , Daniel ROSAS , Nathan ASCHENBACH
IPC: G06F3/01 , G06F3/04886
CPC classification number: G06F3/017 , G06F3/04886 , G06F3/013
Abstract: Aspects of the present disclosure are directed to triggering virtual keyboard selections using multiple input modalities. An interface manager can display an interface, such as a virtual keyboard, to a user in an artificial reality environment. Implementations of the interface manager can track user eye gaze input and user hand input (e.g., hand or finger motion). The interface manager can resolve a character selection on the virtual keyboard according to the tracked user gaze input based on detection that the user's hand motion meets a trigger criteria. For example, the interface manager can: detect that the tracked user hand motion meets the trigger criteria at a given point in time; and resolve a selection from the virtual keyboard (e.g., selection of a displayed character) according to the tracked user gaze on the virtual keyboard at the given point in time.
-
公开(公告)号:US20230324992A1
公开(公告)日:2023-10-12
申请号:US18190604
申请日:2023-03-27
Applicant: Meta Platforms Technologies, LLC
Inventor: Roger IBARS MARTINEZ , Johnathon SIMMONS , Pol PLA I CONESA , Nathan ASCHENBACH , Aaron FAUCHER , Chris ROJAS , Emron Jackson HENRY , Bryan SPARKS
IPC: G06F3/01 , G06F3/0354
CPC classification number: G06F3/013 , G06F3/03547
Abstract: Aspects of the disclosure are directed to an interface for receiving input using multiple modalities in an artificial reality environment. The interface can be a virtual keyboard displayed in an artificial reality environment that includes characters arranged as elements. Implementations include an artificial reality device/system for displaying the artificial reality environment and receiving user input in a first modality, and a controller device for receiving user input in an additional input modality. For example, the artificial reality system can be configured to receive user gaze input as a first input modality and the controller device can be configured to receive input in a second modality, such as touch input received at a trackpad. An interface manager can process input in one or more of the modalities to control an indicator on the virtual interface. The interface manager can also resolve character selections from the virtual interface according to the input.
-
公开(公告)号:US20230324986A1
公开(公告)日:2023-10-12
申请号:US17716456
申请日:2022-04-08
Applicant: Meta Platforms Technologies, LLC
Inventor: Roger IBARS MARTINEZ , Johnathon SIMMONS , Pol PLA I CONESA , Nathan ASCHENBACH , Aaron FAUCHER , Chris ROJAS , Emron Jackson HENRY , Bryan SPARKS
IPC: G06F3/01 , G06F3/04886 , G06F3/04883
CPC classification number: G06F3/013 , G06F3/04886 , G06F3/04883
Abstract: Aspects of the disclosure are directed to an interface for receiving input using multiple modalities in an artificial reality environment. The interface can be a virtual keyboard displayed in an artificial reality environment that includes characters arranged as elements. Implementations include an artificial reality device/system for displaying the artificial reality environment and receiving user input in a first modality, and a controller device for receiving user input in an additional input modality. For example, the artificial reality system can be configured to receive user gaze input as a first input modality and the controller device can be configured to receive input in a second modality, such as touch input received at a trackpad. An interface manager can process input in the multiple modalities to control an indicator on the virtual interface. The interface manager can also resolve character selections from the virtual interface according to the input.
-
公开(公告)号:US20230245386A1
公开(公告)日:2023-08-03
申请号:US18297155
申请日:2023-04-07
Applicant: Meta Platforms Technologies, LLC
Inventor: Yeliz KARADAYI , Wai Leong CHAK , Michal HLAVAC , Pol PLA I CONESA
CPC classification number: G06T17/005 , G06T13/40
Abstract: A virtual object system can orchestrate virtual objects defined as a collection of components and with inheritance in an object hierarchy. Virtual object components can include a container, data, a template, and a controller. A container can define the volume the virtual object is authorized to write into. A virtual object's data can specify features such as visual elements, parameters, links to external data, meta-data, etc. The template can define view states of the virtual object and contextual breakpoints for transitioning between them. Each view state can control when and how the virtual object presents data elements. The controller can define logic for the virtual object to respond to input, context, etc. The definition of each object can specify which other object in an object hierarchy that object extends, where extending an object includes inheriting that object's components, which can be modified or overwritten as part of the extension.
-
公开(公告)号:US20230126837A1
公开(公告)日:2023-04-27
申请号:US17511909
申请日:2021-10-27
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor: Yeliz KARADAYI , Wai Leong CHAK , Michal HLAVAC , Pol PLA I CONESA
Abstract: A virtual object system can orchestrate virtual objects defined as a collection of components and with inheritance in an object hierarchy. Virtual object components can include a container, data, a template, and a controller. A container can define the volume the virtual object is authorized to write into. A virtual object’s data can specify features such as visual elements, parameters, links to external data, meta-data, etc. The template can define view states of the virtual object and contextual breakpoints for transitioning between them. Each view state can control when and how the virtual object presents data elements. The controller can define logic for the virtual object to respond to input, context, etc. The definition of each object can specify which other object in an object hierarchy that object extends, where extending an object includes inheriting that object’s components, which can be modified or overwritten as part of the extension.
-
-
-
-
-
-
-
-
-