公开(公告)号：US20240104870A1

公开(公告)日：2024-03-28

申请号：US18532438

申请日：2023-12-07

Applicant: Meta Platforms Technologies, LLC

Inventor： Anna FUSTE LLEIXA ,  Pol PLA I CONESA ,  Daniel ROSAS ,  Aaron FAUCHER ,  Roger IBARS MARTINEZ ,  Nathan ASCHENBACH ,  Hae Jin LEE ,  Jing MA ,  Ana GARCIA PUYOL ,  Amber CHOO

IPC: G06T19/00 ,  G06F3/01 ,  G06T15/00

CPC classification number: G06T19/006 ,  G06F3/013 ,  G06F3/017 ,  G06T15/00

Abstract: In some implementations, the disclosed systems and methods can detect an interaction with respect to a set of virtual objects, which can start with a particular gesture, and take an action with respect to one or more virtual objects based on a further interaction (e.g., holding the gesture for a particular amount of time, moving the gesture in a particular direction, releasing the gesture, etc.).
In some implementations, the disclosed systems and methods can automatically review a 3D video to determine a depicted user or avatar movement pattern (e.g., dance moves, repair procedure, playing an instrument, etc.).
In some implementations, the disclosed systems and methods can allow the gesture to included a flat hand with the user's thumb next to the palm, with the gesture toward the user's face.

公开(公告)号：US20230324992A1

公开(公告)日：2023-10-12

申请号：US18190604

申请日：2023-03-27

Applicant: Meta Platforms Technologies, LLC

Inventor： Roger IBARS MARTINEZ ,  Johnathon SIMMONS ,  Pol PLA I CONESA ,  Nathan ASCHENBACH ,  Aaron FAUCHER ,  Chris ROJAS ,  Emron Jackson HENRY ,  Bryan SPARKS

IPC: G06F3/01 ,  G06F3/0354

CPC classification number: G06F3/013 ,  G06F3/03547

Abstract: Aspects of the disclosure are directed to an interface for receiving input using multiple modalities in an artificial reality environment. The interface can be a virtual keyboard displayed in an artificial reality environment that includes characters arranged as elements. Implementations include an artificial reality device/system for displaying the artificial reality environment and receiving user input in a first modality, and a controller device for receiving user input in an additional input modality. For example, the artificial reality system can be configured to receive user gaze input as a first input modality and the controller device can be configured to receive input in a second modality, such as touch input received at a trackpad. An interface manager can process input in one or more of the modalities to control an indicator on the virtual interface. The interface manager can also resolve character selections from the virtual interface according to the input.

公开(公告)号：US20230324986A1

公开(公告)日：2023-10-12

申请号：US17716456

申请日：2022-04-08

Applicant: Meta Platforms Technologies, LLC

Inventor： Roger IBARS MARTINEZ ,  Johnathon SIMMONS ,  Pol PLA I CONESA ,  Nathan ASCHENBACH ,  Aaron FAUCHER ,  Chris ROJAS ,  Emron Jackson HENRY ,  Bryan SPARKS

IPC: G06F3/01 ,  G06F3/04886 ,  G06F3/04883

CPC classification number: G06F3/013 ,  G06F3/04886 ,  G06F3/04883

Abstract: Aspects of the disclosure are directed to an interface for receiving input using multiple modalities in an artificial reality environment. The interface can be a virtual keyboard displayed in an artificial reality environment that includes characters arranged as elements. Implementations include an artificial reality device/system for displaying the artificial reality environment and receiving user input in a first modality, and a controller device for receiving user input in an additional input modality. For example, the artificial reality system can be configured to receive user gaze input as a first input modality and the controller device can be configured to receive input in a second modality, such as touch input received at a trackpad. An interface manager can process input in the multiple modalities to control an indicator on the virtual interface. The interface manager can also resolve character selections from the virtual interface according to the input.