公开(公告)号：US11615587B2

公开(公告)日：2023-03-28

申请号：US16994481

申请日：2020-08-14

Applicant: QUALCOMM Incorporated

Inventor： Chieh-Ming Kuo ,  Ke-Li Cheng ,  Michel Adib Sarkis

IPC: G06T17/00 ,  G06T7/60 ,  G06T7/90 ,  G06V40/16

Abstract: Techniques are provided for generating one or more three-dimensional (3D) models. In one example, an image of an object (e.g., a face or other object) is obtained, and a 3D model of the object in the image is generated. The 3D model includes geometry information. Color information for the 3D model is determined, and a fitted 3D model of the object is generated based on a modification of the geometry information and the color information for the 3D model. In some cases, the color information (e.g., determination and/or modification of the color information) and the fitted 3D model can be based on one or more vertex-level fitting processes. A refined 3D model of the object is generated based on the fitted 3D model and depth information associated with the fitted 3D model. In some cases, the refined 3D model can be based on a pixel-level refinement or fitting process.

公开(公告)号：US12112433B2

公开(公告)日：2024-10-08

申请号：US17714743

申请日：2022-04-06

Applicant: QUALCOMM INCORPORATED

Inventor： Wei-Lun Chang ,  Michel Adib Sarkis ,  Chieh-Ming Kuo ,  Kuang-Man Huang

IPC: G06T17/20 ,  G06N3/045 ,  G06V10/22

CPC classification number: G06T17/20 ,  G06N3/045 ,  G06V10/235

Abstract: Methods, systems, and apparatuses are provided to automatically reconstruct an image, such as a 3D image. For example, a computing device may obtain an image, and may apply a first trained machine learning process to the image to generate coefficient values characterizing the image in a plurality of dimensions. Further, the computing device may generate a mesh based on the coefficient values. The computing device may apply a second trained machine learning process to the coefficient values and the image to generate a displacement map. Based on the mesh and the displacement map, the computing device may generate output data characterizing an aligned mesh. The computing device may store the output data within a data repository. In some examples, the computing device provides the output data for display.

公开(公告)号：US12062130B2

公开(公告)日：2024-08-13

申请号：US17403656

申请日：2021-08-16

Applicant: QUALCOMM Incorporated

Inventor： Yan Deng ,  Michel Adib Sarkis ,  Ning Bi ,  Chieh-Ming Kuo

IPC: G06T17/00 ,  G06T13/40 ,  G06T19/20

CPC classification number: G06T17/00 ,  G06T13/40 ,  G06T19/20 ,  G06T2219/2004

Abstract: Systems and techniques are provided for performing video-based activity recognition. For example, a process can include generating a three-dimensional (3D) model of a first portion of an object based on one or more frames depicting the object. The process can also include generating a mask for the one or more frames, the mask including an indication of one or more regions of the object. The process can further include generating a 3D base model based on the 3D model of the first portion of the object and the mask, the 3D base model representing the first portion of the object and a second portion of the object. The process can include generating, based on the mask and the 3D base model, a 3D model of the second portion of the object.