公开(公告)号：US20240046618A1

公开(公告)日：2024-02-08

申请号：US18274371

申请日：2021-03-11

Applicant: Google LLC

Inventor： Yinda Zhang ,  Feitong Tan ,  Danhang Tang ,  Mingsong Dou ,  Kaiwen Guo ,  Sean Ryan Francesco Fanello ,  Sofien Bouaziz ,  Cem Keskin ,  Ruofei Du ,  Rohit Kumar Pandey ,  Deqing Sun

IPC: G06V10/771 ,  G06T17/00 ,  G06T7/70 ,  G06V10/44 ,  G06V10/75

CPC classification number: G06V10/771 ,  G06T17/00 ,  G06T7/70 ,  G06V10/44 ,  G06V10/751 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Systems and methods for training models to predict dense correspondences across images such as human images. A model may be trained using synthetic training data created from one or more 3D computer models of a subject. In addition, one or more geodesic distances derived from the surfaces of one or more of the 3D models may be used to generate one or more loss values, which may in turn be used in modifying the model's parameters during training.

公开(公告)号：US11765320B2

公开(公告)日：2023-09-19

申请号：US17444890

申请日：2021-08-11

Applicant: Google LLC

Inventor： Ruofei Du ,  Alex Olwal

IPC: H04N7/15 ,  G06F3/01 ,  G06N3/04 ,  G06T3/60 ,  G06T13/20 ,  G06T13/40 ,  G06T17/20

CPC classification number: H04N7/157 ,  G06F3/013 ,  G06N3/04 ,  G06T3/608 ,  G06T13/205 ,  G06T13/40 ,  G06T17/20

Abstract: According to a general aspect, a method can include receiving a photo of a virtual conference participant, and a depth map based on the photo, and generating a plurality of synthesized images based on the photo. The plurality of synthesized images can have respective simulated gaze directions of the virtual conference participant. The method can also include receiving, during a virtual conference, an indication of a current gaze direction of the virtual conference participant. The method can further include animating, in a display of the virtual conference, an avatar corresponding with the virtual conference participant. The avatar can be based on the photo. Animating the avatar can be based on the photo, the depth map and at least one synthesized image of the plurality of synthesized images, the at least one synthesized image corresponding with the current gaze direction.

公开(公告)号：US20230122450A1

公开(公告)日：2023-04-20

申请号：US17451587

申请日：2021-10-20

Applicant: Google LLC

Inventor： Alex Olwal ,  Ruofei Du

IPC: G02B27/01 ,  G06K9/00 ,  G06T7/50 ,  G06F3/14 ,  G06F3/01 ,  G10L17/06 ,  H04R1/40 ,  H04R3/00 ,  G10L17/02

Abstract: Augmented reality devices can be configured to display messages in response to sounds from an environment. A variety of techniques can be combined to localize and track the sources of the sounds in the environment. Messages created in response to the sounds can then be anchored to their corresponding sources in order to provide a user with a clear understanding of the location of sources of the messages. Additionally, these anchored messages can be enhanced with additional information, such as identification, to further the user’s understanding of the sources of the messages. The anchored messages can track relative movement to integrate with the AR environment.