公开(公告)号：US20240281996A1

公开(公告)日：2024-08-22

申请号：US18110803

申请日：2023-02-16

Applicant: QUALCOMM Incorporated

Inventor： Srujan Babu NANDIPATI ,  Chiranjib CHOUDHURI ,  Pushkar GORUR SHESHAGIRI ,  Vinod Kumar SAINI ,  Ajit Deepak GUPTE

IPC: G06T7/73 ,  G06T7/246 ,  H04N23/68

CPC classification number: G06T7/73 ,  G06T7/246 ,  H04N23/6812 ,  G06T2207/10028 ,  G06T2207/30244 ,  H04N23/682

Abstract: Imaging systems and techniques are described. A system receives an image of an environment captured using an image sensor according to an image capture setting, and receives motion data captured using a motion sensor. The system determines a weight associated with at least one of a plurality of features of the environment in the image based on an estimated motion blur level for the at least one of the features of the environment in the image. The estimated motion blur level is based on the motion data and the image capture setting. The system tracks the features of the environment across a plurality of images (that includes the received image) according to respective weights (that include the determined weight) for the features of the environment across the plurality of images. The system can use the tracked features for mapping the environment and/or determining the pose of the system.

公开(公告)号：US20240096049A1

公开(公告)日：2024-03-21

申请号：US17933334

申请日：2022-09-19

Applicant: QUALCOMM Incorporated

Inventor： Vinod Kumar SAINI ,  Pushkar GORUR SHESHAGIRI ,  Srujan Babu NANDIPATI ,  Chiranjib CHOUDHURI ,  Ajit Deepak GUPTE

IPC: G06V10/60 ,  G06T7/11 ,  G06T7/20 ,  G06T7/70 ,  G06T17/05 ,  G06V10/25 ,  G06V10/44 ,  G06V20/50

CPC classification number: G06V10/60 ,  G06T7/11 ,  G06T7/20 ,  G06T7/70 ,  G06T17/05 ,  G06V10/25 ,  G06V10/44 ,  G06V20/50 ,  G06T2207/10028 ,  G06T2207/10144 ,  G06V2201/07

Abstract: Disclosed are systems, apparatuses, processes, and computer-readable media to capture images with subjects at different depths. A method of processing image data includes obtaining, at an imaging device, a first image of an environment from an image sensor of the imaging device; determining a region of interest of the first image based on features depicted in the first image, wherein the features are associated with the environment; determining a representative luma value associated with the first image based on image data in the region of interest of the first image; determining one or more exposure control parameters based on the representative luma value; and obtaining, at the imaging device, a second image captured based on the one or more exposure control parameters.

公开(公告)号：US20230266589A1

公开(公告)日：2023-08-24

申请号：US17678944

申请日：2022-02-23

Applicant: QUALCOMM Incorporated

Inventor： John EATON ,  Manikandan MEIYOOR VELAYUTHAM ,  Mario SANCHEZ ,  Thirukumaran DECHINAMOORTHY ,  Chiranjib CHOUDHURI

IPC: G02B27/01 ,  G06V40/20 ,  G10L15/25

CPC classification number: G02B27/0172 ,  G06V40/20 ,  G10L15/25 ,  G02B2027/0138

Abstract: Systems and techniques are provided for an adjustable camera system for mouth tracking. An example apparatus can include a housing with an opening formed in a first side of the housing, wherein one or more surfaces of the housing are configured to engage a head of a user; and a structure including a lens configured to receive incident light, wherein the structure is configured to move from a retracted state where at least a portion of the structure is retracted into the opening in the first side of the housing, to an extended state where at least a portion of the structure that includes the lens structure extends from the first side of the housing.

公开(公告)号：US20240104180A1

公开(公告)日：2024-03-28

申请号：US17932897

申请日：2022-09-16

Applicant: QUALCOMM Incorporated

Inventor： Anupama S ,  Chiranjib CHOUDHURI ,  Avani RAO ,  Ajit Deepak GUPTE

IPC: G06F21/32 ,  G06V10/82 ,  G06V40/16

CPC classification number: G06F21/32 ,  G06V10/82 ,  G06V40/171

Abstract: Systems and techniques are provided for performing user authentication. For example, a process can include obtaining a plurality of images associated with a face and a facial expression of the user, wherein each respective image of the plurality of images includes a different portion of the face. An encoder neural network can be used to generate one or more predicted three-dimensional (3D) facial modeling parameters, wherein the encoder neural network generates the one or more predicted 3D facial modeling parameters based on the plurality of images. A reference 3D facial model associated with the face and the facial expression can be obtained. An error can be determined between the one or more predicted 3D facial modeling parameters and the reference 3D facial model, and the user can be authenticated user based on the error being less than a pre-determined authentication threshold.

公开(公告)号：US20240029354A1

公开(公告)日：2024-01-25

申请号：US17813556

申请日：2022-07-19

Applicant: QUALCOMM Incorporated

Inventor： Ke-Li CHENG ,  Anupama S ,  Kuang-Man HUANG ,  Chieh-Ming KUO ,  Avani RAO ,  Chiranjib CHOUDHURI ,  Michel Adib SARKIS ,  Ning BI ,  Ajit Deepak GUPTE

IPC: G06T17/10 ,  G06T15/04 ,  G06V40/16 ,  G06V10/77

CPC classification number: G06T17/10 ,  G06T15/04 ,  G06V40/171 ,  G06V10/7715 ,  G06T2200/08

Abstract: Systems and techniques are provided for generating a texture for a three-dimensional (3D) facial model. For example, a process can include obtaining a first frame, the first frame including a first portion of a face. In some aspects, the process can include generating a 3D facial model based on the first frame and generating a first facial feature corresponding to the first portion of the face. In some examples, the process includes obtaining a second frame, the second frame including a second portion of the face. In some cases, the second portion of the face at least partially overlaps the first portion of the face. In some examples, the process includes combining the first facial feature with the second facial feature to generate an enhanced facial feature, wherein the combining is performed to enhance an appearance of select areas of the enhanced facial feature.

公开(公告)号：US20230095621A1

公开(公告)日：2023-03-30

申请号：US17484601

申请日：2021-09-24

Applicant: QUALCOMM Incorporated

Inventor： Pushkar GORUR SHESHAGIRI ,  Ajit Deepak GUPTE ,  Chiranjib CHOUDHURI ,  Gerhard REITMAYR ,  Youngmin PARK

IPC: G06T7/73 ,  G06K9/00 ,  G06T7/246 ,  G06K9/46

Abstract: Systems and techniques are described herein for processing frames. The systems and techniques can be implemented by various types of systems, such as by an extended reality (XR) system or device. In some cases, a process can include obtaining feature information associated with a feature in a current frame, wherein the feature information is based on one or more previous frames; determining an estimated pose of the apparatus associated with the current frame; obtaining a distance associated with the feature in the current frame; and determining an estimated scale of the feature in the current frame based on the feature information associated with the feature, the estimated pose, and the distance associated with the feature.

公开(公告)号：US20250005851A1

公开(公告)日：2025-01-02

申请号：US18345843

申请日：2023-06-30

Applicant: QUALCOMM Incorporated

Inventor： Arpit BHATNAGAR ,  Chiranjib CHOUDHURI ,  Anupama S ,  Avani RAO ,  Ajit Deepak GUPTE

IPC: G06T17/00 ,  G06T15/04 ,  G06T15/10 ,  G10L15/02 ,  G10L15/22 ,  G10L25/18

Abstract: Systems and techniques are described herein for generating models of faces. For instance, a method for generating models of faces is provided. The method may include obtaining one or more images of one or both eyes of a face of a user; obtaining audio data based on utterances of the user; and generating, using a machine-learning model, a three-dimensional model of the face of the user based on the one or more images and the audio data.

公开(公告)号：US20230410447A1

公开(公告)日：2023-12-21

申请号：US17845884

申请日：2022-06-21

Applicant: QUALCOMM Incorporated

Inventor： Ke-Li CHENG ,  Anupama S ,  Kuang-Man HUANG ,  Chieh-Ming KUO ,  Avani RAO ,  Chiranjib CHOUDHURI ,  Michel Adib SARKIS ,  Ajit Deepak GUPTE ,  Ning BI

IPC: G06T19/20 ,  G06T7/73 ,  G06T17/00 ,  G06V40/16

CPC classification number: G06T19/20 ,  G06T7/75 ,  G06T17/00 ,  G06V40/171 ,  G06T2207/20081 ,  G06T2207/30201 ,  G06T2200/08 ,  G06T2219/2021

Abstract: Systems and techniques are provided for generating a three-dimensional (3D) facial model. For example, a process can include obtaining at least one input image associated with a face. In some aspects, the process can include obtaining a pose for a 3D facial model associated with the face. In some examples, the process can include generating, by a machine learning model, the 3D facial model associated with the face. In some cases, one or more parameters associated with a shape component of the 3D facial model are conditioned on the pose. In some implementations, the 3D facial model is configured to vary in shape based on the pose for the 3D facial model associated with the face.

公开(公告)号：US20220366597A1

公开(公告)日：2022-11-17

申请号：US17307920

申请日：2021-05-04

Applicant: QUALCOMM Incorporated

Inventor： Srujan Babu NANDIPATI ,  Pushkar GORUR SHESHAGIRI ,  Chiranjib CHOUDHURI ,  Ajit Deepak GUPTE ,  Gerhard REITMAYR

IPC: G06T7/73 ,  G06T7/20 ,  G02B27/01 ,  G06T7/33

Abstract: Systems and techniques are provided for determining and applying corrected poses in digital content experiences. An example method can include receiving, from one or more sensors associated with an apparatus, inertial measurements and one or more frames of a scene; based on the one or more frames and the inertial measurements, determining, via a first filter, an angular and linear motion of the apparatus and a gravity vector indicating a direction of gravitational force interacting with the apparatus; when a motion of the apparatus is below a threshold, determining, via a second filter, an updated gravity vector indicating a direction of gravitational force interacting with the apparatus; determining, based on the updated gravity vector, parameters for aligning an axis of the scene with a gravity direction in a real-world spatial frame; and aligning, using the parameters, the axis of the scene with the gravity direction in the real-world spatial frame.

公开(公告)号：US20200271450A1

公开(公告)日：2020-08-27

申请号：US16284766

申请日：2019-02-25

Applicant: QUALCOMM Incorporated

Inventor： Pushkar GORUR SHESHAGIRI ,  Chayan SHARMA ,  Chiranjib CHOUDHURI ,  Ajit Deepak GUPTE

IPC: G01C21/20 ,  G06T7/11 ,  G06N3/02 ,  G06T19/00 ,  G06F1/16

Abstract: Systems, methods, and computer-readable media are provided for immersive extended reality experiences on mobile platforms. In some examples, a method can include obtaining sensor measurements from one or more sensors on a mobile platform and/or a device associated with a user in the mobile platform, the sensor measurements including motion parameters associated with the mobile platform and the user; identifying features of the mobile platform and an environment outside of the mobile platform; tracking, using the sensor measurements, a first pose of the mobile platform relative to the environment outside of the mobile platform; tracking, using the sensor measurements, a second pose of the user relative to at least one of the features of the mobile platform; and tracking, based on the first pose and the second pose, a third pose of the user relative to at least one of the features of the environment outside of the mobile platform.