公开(公告)号：US11514658B2

公开(公告)日：2022-11-29

申请号：US17153773

申请日：2021-01-20

Applicant: QUALCOMM Incorporated

Inventor： Ashar Ali ,  Gokee Dane ,  Gerhard Reitmayr

IPC: G06T17/20 ,  G06T19/20 ,  G06T15/20

Abstract: Systems and techniques are provided for modeling three-dimensional (3D) meshes using multi-view image data. An example method can include determining, based on a first image of a target, first 3D mesh parameters for the target corresponding to a first coordinate frame; determining, based on a second image of the target, second 3D mesh parameters for the target corresponding to a second coordinate frame; determining third 3D mesh parameters for the target in a third coordinate frame, the third 3D mesh parameters being based on the first and second 3D mesh parameters and relative rotation and translation parameters of image sensors that captured the first and second images; determining a loss associated with the third 3D mesh parameters, the loss being based on the first and second 3D mesh parameters and the relative rotation and translation parameters; determining 3D mesh parameters based on the loss and third 3D mesh parameters.

公开(公告)号：US11769263B2

公开(公告)日：2023-09-26

申请号：US17144102

申请日：2021-01-07

Applicant: QUALCOMM Incorporated

Inventor： Samuel Sunarjo ,  Gokce Dane ,  Ashar Ali ,  Upal Mahbub

IPC: G06T7/33 ,  G06T7/73 ,  G06T17/20 ,  G06T19/20

CPC classification number: G06T7/344 ,  G06T7/75 ,  G06T17/205 ,  G06T19/20 ,  G06T2207/10028 ,  G06T2219/2016

Abstract: Systems and techniques are provided for registering three-dimensional (3D) images to deformable models. An example method can include determining, based on an image of a target and associated depth information, a 3D mesh of the target; determining different sets of rotation and translation parameters based on modifications to rotation and translation parameters of the 3D mesh; generating, based on the different sets of rotation and translation parameters, different 3D meshes having different orientations, different poses, and/or different alignments relative to the target; determining different sets of model parameters associated with the different 3D meshes, based on modifications to the different sets of rotation and translation parameters; generating, based on the different sets of model parameters, different additional 3D meshes having different orientations, different poses, and/or different alignments relative to the target; and selecting a final 3D mesh of the target from the different additional 3D meshes.

公开(公告)号：US11748913B2

公开(公告)日：2023-09-05

申请号：US17189105

申请日：2021-03-01

Applicant: QUALCOMM Incorporated

Inventor： Ashar Ali ,  Gokce Dane ,  Upal Mahbub ,  Samuel Sunarjo ,  Gerhard Reitmayr

IPC: G06N3/08 ,  G06T17/00 ,  G06T17/20 ,  G06T7/00 ,  G06T7/80

CPC classification number: G06T7/97 ,  G06N3/08 ,  G06T7/80 ,  G06T17/20 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Systems and techniques are provided for modeling three-dimensional (3D) meshes using images. An example method can include receiving, via a neural network system, an image of a target and metadata associated with the image and/or a device that captured the image; determining, based on the image and metadata, first 3D mesh parameters of a first 3D mesh of the target, the first 3D mesh parameters and first 3D mesh corresponding to a first reference frame associated with the image and/or the device; and determining, based on the first 3D mesh parameters, second 3D mesh parameters for a second 3D mesh of the target, the second 3D mesh parameters and second 3D mesh corresponding to a second reference frame, the second reference frame including a 3D coordinate system of a real-world scene where the target is located.