公开(公告)号：US11769263B2

公开(公告)日：2023-09-26

申请号：US17144102

申请日：2021-01-07

Applicant: QUALCOMM Incorporated

Inventor： Samuel Sunarjo ,  Gokce Dane ,  Ashar Ali ,  Upal Mahbub

IPC: G06T7/33 ,  G06T7/73 ,  G06T17/20 ,  G06T19/20

CPC classification number: G06T7/344 ,  G06T7/75 ,  G06T17/205 ,  G06T19/20 ,  G06T2207/10028 ,  G06T2219/2016

Abstract: Systems and techniques are provided for registering three-dimensional (3D) images to deformable models. An example method can include determining, based on an image of a target and associated depth information, a 3D mesh of the target; determining different sets of rotation and translation parameters based on modifications to rotation and translation parameters of the 3D mesh; generating, based on the different sets of rotation and translation parameters, different 3D meshes having different orientations, different poses, and/or different alignments relative to the target; determining different sets of model parameters associated with the different 3D meshes, based on modifications to the different sets of rotation and translation parameters; generating, based on the different sets of model parameters, different additional 3D meshes having different orientations, different poses, and/or different alignments relative to the target; and selecting a final 3D mesh of the target from the different additional 3D meshes.

公开(公告)号：US11748913B2

公开(公告)日：2023-09-05

申请号：US17189105

申请日：2021-03-01

Applicant: QUALCOMM Incorporated

Inventor： Ashar Ali ,  Gokce Dane ,  Upal Mahbub ,  Samuel Sunarjo ,  Gerhard Reitmayr

IPC: G06N3/08 ,  G06T17/00 ,  G06T17/20 ,  G06T7/00 ,  G06T7/80

CPC classification number: G06T7/97 ,  G06N3/08 ,  G06T7/80 ,  G06T17/20 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Systems and techniques are provided for modeling three-dimensional (3D) meshes using images. An example method can include receiving, via a neural network system, an image of a target and metadata associated with the image and/or a device that captured the image; determining, based on the image and metadata, first 3D mesh parameters of a first 3D mesh of the target, the first 3D mesh parameters and first 3D mesh corresponding to a first reference frame associated with the image and/or the device; and determining, based on the first 3D mesh parameters, second 3D mesh parameters for a second 3D mesh of the target, the second 3D mesh parameters and second 3D mesh corresponding to a second reference frame, the second reference frame including a 3D coordinate system of a real-world scene where the target is located.