公开(公告)号：US20230324997A1

公开(公告)日：2023-10-12

申请号：US17717585

申请日：2022-04-11

Applicant: Meta Platforms Technologies, LLC

Inventor： Aaron FAUCHER ,  Pol PLA I CONESA ,  Daniel ROSAS ,  Nathan ASCHENBACH

IPC: G06F3/01 ,  G06F3/04886

CPC classification number: G06F3/017 ,  G06F3/04886 ,  G06F3/013

Abstract: Aspects of the present disclosure are directed to triggering virtual keyboard selections using multiple input modalities. An interface manager can display an interface, such as a virtual keyboard, to a user in an artificial reality environment. Implementations of the interface manager can track user eye gaze input and user hand input (e.g., hand or finger motion). The interface manager can resolve a character selection on the virtual keyboard according to the tracked user gaze input based on detection that the user's hand motion meets a trigger criteria. For example, the interface manager can: detect that the tracked user hand motion meets the trigger criteria at a given point in time; and resolve a selection from the virtual keyboard (e.g., selection of a displayed character) according to the tracked user gaze on the virtual keyboard at the given point in time.

公开(公告)号：US20240338086A1

公开(公告)日：2024-10-10

申请号：US18746675

申请日：2024-06-18

Applicant: Meta Platforms Technologies, LLC

Inventor： Aaron FAUCHER ,  Pol PLA I CONESA ,  Daniel ROSAS ,  Nathan ASCHENBACH

IPC: G06F3/01 ,  G06F3/04886

CPC classification number: G06F3/017 ,  G06F3/013 ,  G06F3/04886 ,  G06F3/011

Abstract: Aspects of the present disclosure are directed to triggering virtual keyboard selections using multiple input modalities. An interface manager can display an interface, such as a virtual keyboard, to a user in an artificial reality environment. Implementations of the interface manager can track user eye gaze input and user hand input (e.g., hand or finger motion). The interface manager can resolve a character selection on the virtual keyboard according to the tracked user gaze input based on detection that the user's hand motion meets a trigger criteria. For example, the interface manager can: detect that the tracked user hand motion meets the trigger criteria at a given point in time; and resolve a selection from the virtual keyboard (e.g., selection of a displayed character) according to the tracked user gaze on the virtual keyboard at the given point in time.

公开(公告)号：US20240104870A1

公开(公告)日：2024-03-28

申请号：US18532438

申请日：2023-12-07

Applicant: Meta Platforms Technologies, LLC

Inventor： Anna FUSTE LLEIXA ,  Pol PLA I CONESA ,  Daniel ROSAS ,  Aaron FAUCHER ,  Roger IBARS MARTINEZ ,  Nathan ASCHENBACH ,  Hae Jin LEE ,  Jing MA ,  Ana GARCIA PUYOL ,  Amber CHOO

IPC: G06T19/00 ,  G06F3/01 ,  G06T15/00

CPC classification number: G06T19/006 ,  G06F3/013 ,  G06F3/017 ,  G06T15/00

Abstract: In some implementations, the disclosed systems and methods can detect an interaction with respect to a set of virtual objects, which can start with a particular gesture, and take an action with respect to one or more virtual objects based on a further interaction (e.g., holding the gesture for a particular amount of time, moving the gesture in a particular direction, releasing the gesture, etc.).
In some implementations, the disclosed systems and methods can automatically review a 3D video to determine a depicted user or avatar movement pattern (e.g., dance moves, repair procedure, playing an instrument, etc.).
In some implementations, the disclosed systems and methods can allow the gesture to included a flat hand with the user's thumb next to the palm, with the gesture toward the user's face.