公开(公告)号：US20210390789A1

公开(公告)日：2021-12-16

申请号：US17109045

申请日：2020-12-01

Applicant: QUALCOMM Incorporated

Inventor： Peng LIU ,  Lei WANG ,  Zhen WANG ,  Ke-Li CHENG ,  Ning BI

IPC: G06T19/20 ,  G06K9/00 ,  G06T17/20 ,  G06T7/70 ,  G06T7/50 ,  G06T11/00 ,  G06K9/62

Abstract: Systems and techniques are provided for facial image augmentation. An example method can include obtaining a first image capturing a face. Using the first image, the method can determine, using a prediction model, a UV face position map including a two-dimensional (2D) representation of a three-dimensional (3D) structure of the face. The method can generate, based on the UV face position map, a 3D model of the face. The method can generate an extended 3D model of the face by extending the 3D model to include region(s) beyond a boundary of the 3D model. The region(s) can include a forehead region, a region surrounding at least a portion of the face, and/or other region. The method can generate, based on the extended 3D model, a second image depicting the face in a rotated position relative to a position of the face in the first image.

公开(公告)号：US20250157148A1

公开(公告)日：2025-05-15

申请号：US18509041

申请日：2023-11-14

Applicant: QUALCOMM Incorporated

Inventor： Chieh-Ming KUO ,  Ke-Li CHENG ,  Yan DENG ,  Kuang-Man HUANG ,  Michel Adib SARKIS

IPC: G06T17/20 ,  G06V40/16

Abstract: Techniques and systems are provided for generating a representation of a face. For instance, a process can include obtaining a plurality of images of a face, extracting features for each image of the plurality of images to generate a plurality of feature maps and fusing the plurality of feature maps based on features of the plurality of feature maps along a common axis to generate an aligned feature map.

公开(公告)号：US20250095299A1

公开(公告)日：2025-03-20

申请号：US18469453

申请日：2023-09-18

Applicant: QUALCOMM Incorporated

Inventor： Wei-Lun CHANG ,  Ke-Li CHENG ,  Michel Adib SARKIS

IPC: G06T17/20 ,  G06T15/04

Abstract: Techniques and systems are provided for generating a three-dimensional facial model. For instance, a process can include: obtaining a frame, the frame including a face; obtaining a mesh 3D model of the face; generating facial texture information associated with the face based on the frame and the mesh 3D model; generating, based on the facial texture information, displacement map information; and applying the displacement map information to the mesh 3D model to generate a finetuned mesh 3D model.

公开(公告)号：US20240029354A1

公开(公告)日：2024-01-25

申请号：US17813556

申请日：2022-07-19

Applicant: QUALCOMM Incorporated

Inventor： Ke-Li CHENG ,  Anupama S ,  Kuang-Man HUANG ,  Chieh-Ming KUO ,  Avani RAO ,  Chiranjib CHOUDHURI ,  Michel Adib SARKIS ,  Ning BI ,  Ajit Deepak GUPTE

IPC: G06T17/10 ,  G06T15/04 ,  G06V40/16 ,  G06V10/77

CPC classification number: G06T17/10 ,  G06T15/04 ,  G06V40/171 ,  G06V10/7715 ,  G06T2200/08

Abstract: Systems and techniques are provided for generating a texture for a three-dimensional (3D) facial model. For example, a process can include obtaining a first frame, the first frame including a first portion of a face. In some aspects, the process can include generating a 3D facial model based on the first frame and generating a first facial feature corresponding to the first portion of the face. In some examples, the process includes obtaining a second frame, the second frame including a second portion of the face. In some cases, the second portion of the face at least partially overlaps the first portion of the face. In some examples, the process includes combining the first facial feature with the second facial feature to generate an enhanced facial feature, wherein the combining is performed to enhance an appearance of select areas of the enhanced facial feature.

公开(公告)号：US20220058871A1

公开(公告)日：2022-02-24

申请号：US16998975

申请日：2020-08-20

Applicant: QUALCOMM Incorporated

Inventor： Ke-Li CHENG ,  Kuang-Man HUANG ,  Michel Adib SARKIS ,  Gerhard REITMAYR ,  Ning BI

IPC: G06T17/20 ,  G06T7/12 ,  G06T19/00

Abstract: Techniques are provided for generating three-dimensional models of objects from one or more images or frames. For example, at least one frame of an object in a scene can be obtained. A portion of the object is positioned on a plane in the at least one frame. The plane can be detected in the at least one frame and, based on the detected plane, the object can be segmented from the plane in the at least one frame. A three-dimensional (3D) model of the object can be generated based on segmenting the object from the plane. A refined mesh can be generated for a portion of the 3D model corresponding to the portion of the object positioned on the plane.

公开(公告)号：US20210390770A1

公开(公告)日：2021-12-16

申请号：US16994481

申请日：2020-08-14

Applicant: QUALCOMM Incorporated

Inventor： Chieh-Ming KUO ,  Ke-Li CHENG ,  Michel Adib SARKIS

IPC: G06T17/00 ,  G06T7/60 ,  G06T7/90 ,  G06K9/00

Abstract: Techniques are provided for generating one or more three-dimensional (3D) models. In one example, an image of an object (e.g., a face or other object) is obtained, and a 3D model of the object in the image is generated. The 3D model includes geometry information. Color information for the 3D model is determined, and a fitted 3D model of the object is generated based on a modification of the geometry information and the color information for the 3D model. In some cases, the color information (e.g., determination and/or modification of the color information) and the fitted 3D model can be based on one or more vertex-level fitting processes. A refined 3D model of the object is generated based on the fitted 3D model and depth information associated with the fitted 3D model. In some cases, the refined 3D model can be based on a pixel-level refinement or fitting process.