公开(公告)号：US20240290025A1

公开(公告)日：2024-08-29

申请号：US18588948

申请日：2024-02-27

Applicant: GOOGLE LLC

Inventor： Yinda Zhang ,  Sean Ryan Francesco Fanello ,  Ziqian Bai ,  Feitong Tan ,  Zeng Huang ,  Kripasindhu Sarkar ,  Danhang Tang ,  Di Qiu ,  Abhimitra Meka ,  Ruofei Du ,  Mingsong Dou ,  Sergio Orts Escolano ,  Rohit Kumar Pandey ,  Thabo Beeler

IPC: G06T13/40 ,  G06T7/90 ,  G06T17/20 ,  G06V10/44

CPC classification number: G06T13/40 ,  G06T7/90 ,  G06T17/20 ,  G06V10/44 ,  G06T2207/10024 ,  G06T2207/20084

Abstract: A method comprises receiving a first sequence of images of a portion of a user, the first sequence of images being monocular images; generating an avatar based on the first sequence of images, the avatar being based on a model including a feature vector associated with a vertex; receiving a second sequence of images of the portion of the user; and based on the second sequence of images, modifying the avatar with a displacement of the vertex to represent a gesture of the avatar.

公开(公告)号：US20250111477A1

公开(公告)日：2025-04-03

申请号：US18477219

申请日：2023-09-28

Applicant: GOOGLE LLC

Inventor： Sergio Orts Escolano ,  Zhiwen Fan ,  Di Qiu ,  Yinda Zhang ,  Daoye Wang ,  Erroll Wood ,  Abhimitra Meka ,  Hossam Isack ,  Paulo Fabiano Urnau Gotardo ,  Kripasindhu Sarkar ,  Thabo Beeler ,  Zhengyang Shen ,  Alexander Sahba Koumis

IPC: G06T5/50 ,  G06T7/194 ,  H04N5/272

Abstract: A method including capturing a first plurality of images that include a foreground object and a background, capturing a second plurality of images that include the background, generating an alpha matte based on the first plurality of images and the second plurality of images using a trained machine learned model trained using a loss function configured to cause the trained machine learned model to learn high-frequency details of the foreground object, generating a foreground object image based on the first plurality of images and the second plurality of images using the trained machine learned model, and synthesizing an image including the foreground object image and a second background scene using the alpha matte.