公开(公告)号：US20220215564A1

公开(公告)日：2022-07-07

申请号：US17144102

申请日：2021-01-07

Applicant: QUALCOMM Incorporated

Inventor： Samuel SUNARJO ,  Gokce DANE ,  Ashar ALI ,  Upal MAHBUB

IPC: G06T7/33 ,  G06T7/73 ,  G06T17/20 ,  G06T19/20

Abstract: Systems and techniques are provided for registering three-dimensional (3D) images to deformable models. An example method can include determining, based on an image of a target and associated depth information, a 3D mesh of the target; determining different sets of rotation and translation parameters based on modifications to rotation and translation parameters of the 3D mesh; generating, based on the different sets of rotation and translation parameters, different 3D meshes having different orientations, different poses, and/or different alignments relative to the target; determining different sets of model parameters associated with the different 3D meshes, based on modifications to the different sets of rotation and translation parameters; generating, based on the different sets of model parameters, different additional 3D meshes having different orientations, different poses, and/or different alignments relative to the target; and selecting a final 3D mesh of the target from the different additional 3D meshes.

公开(公告)号：US20240242443A1

公开(公告)日：2024-07-18

申请号：US18153498

申请日：2023-01-12

Applicant: QUALCOMM Incorporated

Inventor： Adithya Reddy NALLABOLU ,  Upal MAHBUB ,  Samuel SUNARJO ,  Gokce DANE

IPC: G06T19/00 ,  G06F3/01 ,  G06F21/35

CPC classification number: G06T19/006 ,  G06F3/012 ,  G06F3/013 ,  G06F21/35 ,  G06T2219/024

Abstract: Systems and techniques are described herein for enabling a multi-user extended reality (XR) experience. In one illustrative example, a user device can receive, associated with a user from a host device, a message comprising a prompt to join an XR room hosted by the host device. The user device can connect to the host device based on the message. The user device can can obtain images of a three-dimensional (3D) scene of a physical environment and can transmit the images to the host device. The user device can receive synthetic content from the host device. A virtual representation of the user can be localized with respect to the XR room based on features in the images matched with features of the 3D scene of the physical environment. The user device can render the synthetic content for the XR room based on a pose of the apparatus.

公开(公告)号：US20220277489A1

公开(公告)日：2022-09-01

申请号：US17189105

申请日：2021-03-01

Applicant: QUALCOMM Incorporated

Inventor： Ashar ALI ,  Gokce DANE ,  Upal MAHBUB ,  Samuel SUNARJO ,  Gerhard REITMAYR

IPC: G06T7/00 ,  G06T7/80 ,  G06T17/20 ,  G06N3/08

Abstract: Systems and techniques are provided for modeling three-dimensional (3D) meshes using images. An example method can include receiving, via a neural network system, an image of a target and metadata associated with the image and/or a device that captured the image; determining, based on the image and metadata, first 3D mesh parameters of a first 3D mesh of the target, the first 3D mesh parameters and first 3D mesh corresponding to a first reference frame associated with the image and/or the device; and determining, based on the first 3D mesh parameters, second 3D mesh parameters for a second 3D mesh of the target, the second 3D mesh parameters and second 3D mesh corresponding to a second reference frame, the second reference frame including a 3D coordinate system of a real-world scene where the target is located.