-
公开(公告)号:US20230035282A1
公开(公告)日:2023-02-02
申请号:US17384522
申请日:2021-07-23
Applicant: QUALCOMM Incorporated
Inventor: Kuang-Man HUANG , Min-Hui Lin , Ke-Li CHENG , Michel Adib SARKIS
Abstract: Systems and techniques are provided for generating one or more models. For example, a process can include obtaining a plurality of input images corresponding to faces of one or more people during a training interval. The process can include determining a value of the coefficient representing at least the portion of the facial expression for each of the plurality of input images during the training interval. The process can include determining, from the determined values of the coefficient representing at least the portion of the facial expression for each of the plurality of input images during the training interval, an extremum value of the coefficient representing at least the portion of the facial expression during the training interval. The process can include generating an updated bounding value for the coefficient representing at least the portion of the facial expression based on the initial bounding value and the extremum value.
-
公开(公告)号:US20240078731A1
公开(公告)日:2024-03-07
申请号:US17930257
申请日:2022-09-07
Applicant: QUALCOMM Incorporated
Inventor: Scott BEITH , Suzana ARELLANO , Michel Adib SARKIS , Matthew FISCHLER , Ke-Li CHENG , Stephane VILLETTE
CPC classification number: G06T13/205 , G06T13/40 , G06V40/174
Abstract: A device includes a memory and one or more processors configured to process image data corresponding to a user's face to generate face data. The one or more processors are configured to process sensor data to generate feature data and to generate a representation of an avatar based on the face data and the feature data. The one or more processors are also configured to generate an audio output for the avatar based on the sensor data.
-
公开(公告)号:US20220343602A1
公开(公告)日:2022-10-27
申请号:US17744484
申请日:2022-05-13
Applicant: QUALCOMM Incorporated
Inventor: Ke-Li CHENG , Kuang-Man HUANG , Michel Adib SARKIS , Gerhard REITMAYR , Ning BI
Abstract: Techniques are provided for generating three-dimensional models of objects from one or more images or frames. For example, at least one frame of an object in a scene can be obtained. A portion of the object is positioned on a plane in the at least one frame. The plane can be detected in the at least one frame and, based on the detected plane, the object can be segmented from the plane in the at least one frame. A three-dimensional (3D) model of the object can be generated based on segmenting the object from the plane. A refined mesh can be generated for a portion of the 3D model corresponding to the portion of the object positioned on the plane.
-
公开(公告)号:US20190130582A1
公开(公告)日:2019-05-02
申请号:US16172534
申请日:2018-10-26
Applicant: QUALCOMM Incorporated
Inventor: Ke-Li CHENG , Ying CHEN , Yang ZHOU , Chen-Lan Chester YEN
Abstract: Provided are methods, apparatus, and computer-readable mediums for tracking objects that intersect with an exclusion zone defined for a scene being captured by a video camera. An exclusion zone can delineate an area of a video frame where background objects may be moving. The exclusion zone informs an object tracking system that objects within the exclusion zone should not be tracked. In various implementations, the object tracking system can determine that a bounding box for a blob intersects with the exclusion zone. The object tracking system can further, based on the bounding box intersecting with the exclusion zone, prevent outputting of a blob tracker associated with the blob.
-
公开(公告)号:US20250095259A1
公开(公告)日:2025-03-20
申请号:US18470032
申请日:2023-09-19
Applicant: QUALCOMM Incorporated
Inventor: Ke-Li CHENG , Wei-Lun CHANG , Michel Adib SARKIS
Abstract: Techniques and systems are provided for generating a representation of a face. For instance, a process can include obtaining one or more images of a face. The process can further include generating an encoded expression representing an expression of the face, wherein predetermined characteristics of the face remain constant relative to the encoded expression. The process can further include mapping the encoded expression to a corresponding expression of a facial model. The process can further include generating the representation of the facial model based on the encoded expression.
-
公开(公告)号:US20240062467A1
公开(公告)日:2024-02-22
申请号:US18346579
申请日:2023-07-03
Applicant: QUALCOMM Incorporated
Inventor: Michel Adib SARKIS , Chiranjib CHOUDHURI , Ke-Li CHENG , Ajit Deepak GUPTE , Ning BI , Cristina DOBRIN , Ramesh CHANDRASEKHAR , Imed BOUAZIZI , Liangping MA , Thomas STOCKHAMMER , Nikolai Konrad LEUNG
CPC classification number: G06T17/20 , G06T13/40 , G06T7/70 , G06V10/60 , G06V40/11 , G06T2207/30201
Abstract: Systems and techniques are described for establishing one or more virtual sessions between users. For instance, a first device can transmit, to a second device, a call establishment request for a virtual representation call for a virtual session and can receive, from the second device, a call acceptance indicating acceptance of the call establishment request. The first device can transmit, to the second device, first mesh information for a first virtual representation of a first user of the first device and first mesh animation parameters for the first virtual representation. The first device can receive, from the second device, second mesh information for a second virtual representation of a second user of the second device and second mesh animation parameters for the second virtual representation. The first device can generate, based on the second mesh information and the second mesh animation parameters, the second virtual representation of the second user.
-
公开(公告)号:US20240005607A1
公开(公告)日:2024-01-04
申请号:US18353592
申请日:2023-07-17
Applicant: QUALCOMM Incorporated
Inventor: Ke-Li CHENG , Kuang-Man HUANG , Michel Adib SARKIS , Gerhard REITMAYR , Ning BI
CPC classification number: G06T17/205 , G06T7/12 , G06T19/006 , G06T2210/56
Abstract: Techniques are provided for generating three-dimensional models of objects from one or more images or frames. For example, at least one frame of an object in a scene can be obtained. A portion of the object is positioned on a plane in the at least one frame. The plane can be detected in the at least one frame and, based on the detected plane, the object can be segmented from the plane in the at least one frame. A three-dimensional (3D) model of the object can be generated based on segmenting the object from the plane. A refined mesh can be generated for a portion of the 3D model corresponding to the portion of the object positioned on the plane.
-
公开(公告)号:US20250095270A1
公开(公告)日:2025-03-20
申请号:US18469443
申请日:2023-09-18
Applicant: QUALCOMM Incorporated
Inventor: Ke-Li CHENG , Wei-Lun CHANG , Michel Adib SARKIS
Abstract: Systems and techniques are provided for synthesizing facial features of a three-dimensional (3D) facial model. For example, a process can include obtaining a first frame, the first frame including a first portion of a face; generating a first facial feature corresponding to the first portion of the face; obtaining a second frame, the second frame including a second portion of the face, wherein the second portion of the face at least partially overlaps the first portion of the face; generating a one-dimensional second facial feature corresponding to the second portion of the face; generating a set of weights based on the one-dimensional second facial feature; and applying the set of weights to the first facial feature to generate a weighted facial feature.
-
公开(公告)号:US20240078732A1
公开(公告)日:2024-03-07
申请号:US17930244
申请日:2022-09-07
Applicant: QUALCOMM Incorporated
Inventor: Scott BEITH , Suzana ARELLANO , Michel Adib SARKIS , Matthew FISCHLER , Ke-Li CHENG , Stephane VILLETTE
CPC classification number: G06T13/40 , G06F3/012 , G06V20/41 , G06V40/174
Abstract: A device includes a memory and one or more processors configured to process sensor data to determine a semantical context associated with the sensor data. The one or more processors are also configured to generate adjusted face data based on the determined semantical context and face data. The adjusted face data includes an avatar facial expression that corresponds to the semantical context.
-
公开(公告)号:US20230410447A1
公开(公告)日:2023-12-21
申请号:US17845884
申请日:2022-06-21
Applicant: QUALCOMM Incorporated
Inventor: Ke-Li CHENG , Anupama S , Kuang-Man HUANG , Chieh-Ming KUO , Avani RAO , Chiranjib CHOUDHURI , Michel Adib SARKIS , Ajit Deepak GUPTE , Ning BI
CPC classification number: G06T19/20 , G06T7/75 , G06T17/00 , G06V40/171 , G06T2207/20081 , G06T2207/30201 , G06T2200/08 , G06T2219/2021
Abstract: Systems and techniques are provided for generating a three-dimensional (3D) facial model. For example, a process can include obtaining at least one input image associated with a face. In some aspects, the process can include obtaining a pose for a 3D facial model associated with the face. In some examples, the process can include generating, by a machine learning model, the 3D facial model associated with the face. In some cases, one or more parameters associated with a shape component of the 3D facial model are conditioned on the pose. In some implementations, the 3D facial model is configured to vary in shape based on the pose for the 3D facial model associated with the face.
-
-
-
-
-
-
-
-
-