公开(公告)号：US20230130535A1

公开(公告)日：2023-04-27

申请号：US17936884

申请日：2022-09-30

Applicant: Meta Platforms Technologies, LLC

Inventor： Jing MA ,  Paul Armistead HOOVER ,  Joshuah VINCENT ,  Tali ZVI ,  Hyunbin PARK ,  Michal HLAVAC ,  Kiryl KLIUSHKIN ,  William WONG

IPC: G06T13/40 ,  G06T19/00 ,  H04N7/15

Abstract: The disclosed technology can execute rules for an ambient avatar to perform physical interactions based on a status of a represented user and/or a context of a viewing user. The disclosed technology can further evaluate and select movement points that support avatar movement in an artificial reality environment. The disclosed technology can yet further detect trigger conditions and transition a user presence in a shared communication session. And the disclosed technology can generate stylized 3D avatars from 2D images.

公开(公告)号：US20230215120A1

公开(公告)日：2023-07-06

申请号：US18182783

申请日：2023-03-13

Applicant: Meta Platforms Technologies, LLC

Inventor： Jing MA ,  Gerrit Hendrik HOFMEESTER ,  John Jacob BLAKELEY ,  Camila Cortes DE ALMEIDA E DE VINCENZO ,  Gagneet Singh MAC ,  Jenna VELEZ ,  Cody CHAR ,  Annika RODRIGUES ,  Michael LUO

IPC: G06T19/00 ,  G06Q50/00 ,  G02B27/00

CPC classification number: G06T19/006 ,  G06Q50/01 ,  G02B27/0093 ,  G02B27/017

Abstract: The present embodiments relate to display of glints associated with real-world objects in an environment displayed on an extra reality (XR) device. The glint can include a virtual object associated with a real-world object, such as an indication of a social interaction associated with a real-world object, a content item tagged to an object, etc. The system as described herein can present glints on a display of an XR device based on a distance between the XR device and a location associated with the glint. Responsive to selection of a glint in the environment, additional information can be presented relating to the glint or another action can be taken, such as to open an application. In some instances, a glint can include a series of search results relating to a corresponding real-world object to provide additional information relating to the real-world object.

公开(公告)号：US20230045759A1

公开(公告)日：2023-02-09

申请号：US17393830

申请日：2021-08-04

Applicant: Meta Platforms Technologies, LLC

Inventor： Jing MA ,  Paul Armistead HOOVER ,  Oscar MURILLO ,  Fang-Yu YANG

IPC: H04N7/14 ,  H04N5/89 ,  G06T19/00

Abstract: A 3D calling system can provide 3D calls in various modes according to transitions and can provide affordances (i.e., visual or auditory cues) to improve 3D call image capturing. The 3D calling system of a recipient in a 3D call can display a hologram (from images captured by an external capture device (ECD)) or avatar of a sending call participant in a variety of ways, such as by making them “world-locked,” “ECD-locked,” or “body-locked.” The selection of a 3D call mode can be based on factors such as whether an ECD is active, whether the ECD is in motion, and user selections. In various cases, the 3D calling system can trigger various affordances to improve the quality of the images captured by the sender’s ECD, such as a displayed virtual object and/or an auditory cue, either signaling to the user that a current ECD configuration is non-optimal and/or providing instructions for an improved ECD configuration.

公开(公告)号：US20230412724A1

公开(公告)日：2023-12-21

申请号：US17840725

申请日：2022-06-15

Applicant: Meta Platforms Technologies, LLC

Inventor： Jing MA ,  Paul Armistead HOOVER ,  Joshuah VINCENT

IPC: H04M1/72454 ,  G06F3/01 ,  G02B27/00 ,  G02B27/01 ,  G06N20/00

CPC classification number: H04M1/72454 ,  G06F3/013 ,  G02B27/0093 ,  G02B27/0103 ,  G02B27/0172 ,  G06N20/00 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0174

Abstract: Aspects of the present disclosure are directed to controlling a sending side of an augmented call based on a receiving user's gaze. Some implementations provide a hologram moderation system in which a receiving user's gaze can control how the system generates a representation of a sending user on a sending side. For example, some implementations can moderate the capture or generation of hologram data representing the sending user when the receiving user isn't focused on the hologram that results from the data. Such moderations can reduce power consumption, bandwidth, heat production, and/or processing power needed by the artificial reality system when the receiving user is not looking at the hologram of the sending user, such as when the sending user is in the receiving user's periphery or outside the receiving user's field-of-view.

公开(公告)号：US20240104870A1

公开(公告)日：2024-03-28

申请号：US18532438

申请日：2023-12-07

Applicant: Meta Platforms Technologies, LLC

Inventor： Anna FUSTE LLEIXA ,  Pol PLA I CONESA ,  Daniel ROSAS ,  Aaron FAUCHER ,  Roger IBARS MARTINEZ ,  Nathan ASCHENBACH ,  Hae Jin LEE ,  Jing MA ,  Ana GARCIA PUYOL ,  Amber CHOO

IPC: G06T19/00 ,  G06F3/01 ,  G06T15/00

CPC classification number: G06T19/006 ,  G06F3/013 ,  G06F3/017 ,  G06T15/00

Abstract: In some implementations, the disclosed systems and methods can detect an interaction with respect to a set of virtual objects, which can start with a particular gesture, and take an action with respect to one or more virtual objects based on a further interaction (e.g., holding the gesture for a particular amount of time, moving the gesture in a particular direction, releasing the gesture, etc.).
In some implementations, the disclosed systems and methods can automatically review a 3D video to determine a depicted user or avatar movement pattern (e.g., dance moves, repair procedure, playing an instrument, etc.).
In some implementations, the disclosed systems and methods can allow the gesture to included a flat hand with the user's thumb next to the palm, with the gesture toward the user's face.