-
公开(公告)号：US11734844B2
公开(公告)日：2023-08-22
申请号：US17823764
申请日：2022-08-31
Applicant: Snap Inc.
Inventor： Liuhao Ge , Zhou Ren , Yuncheng Li , Zehao Xue , Yingying Wang
CPC classification number: G06T7/50 , G06N3/045 , G06N3/08 , G06T7/75 , G06T17/20 , G06V10/774 , G06V10/82 , G06V40/107 , G06T2207/10004
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for receiving a monocular image that includes a depiction of a hand and extracting features of the monocular image using a plurality of machine learning techniques. The program and method further include modeling, based on the extracted features, a pose of the hand depicted in the monocular image by adjusting skeletal joint positions of a three-dimensional (3D) hand mesh using a trained graph convolutional neural network (CNN); modeling, based on the extracted features, a shape of the hand in the monocular image by adjusting blend shape values of the 3D hand mesh representing surface features of the hand depicted in the monocular image using the trained graph CNN; and generating, for display, the 3D hand mesh adjusted to model the pose and shape of the hand depicted in the monocular image.
-
公开(公告)号：US11551374B2
公开(公告)日：2023-01-10
申请号：US17015819
申请日：2020-09-09
Applicant: Snap Inc.
Inventor： Yuncheng Li , Jonathan M. Rodriguez, II , Zehao Xue , Yingying Wang
Abstract: Systems and methods herein describe using a neural network to identify a first set of joint location coordinates and a second set of joint location coordinates and identifying a three-dimensional hand pose based on both the first and second sets of joint location coordinates.
-
公开(公告)号：US11120597B2
公开(公告)日：2021-09-14
申请号：US16749753
申请日：2020-01-22
Applicant: Snap Inc.
Abstract: The present invention relates to a joint automatic audio visual driven facial animation system that in some example embodiments includes a full scale state of the art Large Vocabulary Continuous Speech Recognition (LVCSR) with a strong language model for speech recognition and obtained phoneme alignment from the word lattice.
-
Patent Agency Ranking
公开(公告)号：US10997787B2
公开(公告)日：2021-05-04
申请号：US17010256
申请日：2020-09-02
Applicant: Snap Inc.
Inventor： Liuhao Ge , Zhou Ren , Yuncheng Li , Zehao Xue , Yingying Wang
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for receiving a monocular image that includes a depiction of a hand and extracting features of the monocular image using a plurality of machine learning techniques. The program and method further include modeling, based on the extracted features, a pose of the hand depicted in the monocular image by adjusting skeletal joint positions of a three-dimensional (3D) hand mesh using a trained graph convolutional neural network (CNN); modeling, based on the extracted features, a shape of the hand in the monocular image by adjusting blend shape values of the 3D hand mesh representing surface features of the hand depicted in the monocular image using the trained graph CNN; and generating, for display, the 3D hand mesh adjusted to model the pose and shape of the hand depicted in the monocular image.
-
公开(公告)号：US20210074016A1
公开(公告)日：2021-03-11
申请号：US17015819
申请日：2020-09-09
Applicant: Snap Inc.
Inventor： Yuncheng Li , Jonathan M. Rodriguez, II , Zehao Xue , Yingying Wang
Abstract: Systems and methods herein describe using a neural network to identify a first set of joint location coordinates and a second set of joint location coordinates and identifying a three-dimensional hand pose based on both the first and second sets of joint location coordinates.
-
公开(公告)号：US20200242826A1
公开(公告)日：2020-07-30
申请号：US16849397
申请日：2020-04-15
Applicant: Snap Inc.
Abstract: Embodiments described herein relate to an augmented expression system to generate and cause display of a specially configured interface to present an augmented reality perspective. The augmented expression system receives image and video data of a user and tracks facial landmarks of the user based on the image and video data, in real-time to generate and present a 3-dimensional (3D) bitmoji of the user.
-
公开(公告)号：US20200184721A1
公开(公告)日：2020-06-11
申请号：US16210927
申请日：2018-12-05
Applicant: Snap Inc.
Inventor： Liuhao Ge , Zhou Ren , Yuncheng Li , Zehao Xue , Yingying Wang
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for receiving a monocular image that includes a depiction of a hand and extracting features of the monocular image using a plurality of machine learning techniques. The program and method further include modeling, based on the extracted features, a pose of the hand depicted in the monocular image by adjusting skeletal joint positions of a three-dimensional (3D) hand mesh using a trained graph convolutional neural network (CNN); modeling, based on the extracted features, a shape of the hand in the monocular image by adjusting blend shape values of the 3D hand mesh representing surface features of the hand depicted in the monocular image using the trained graph CNN; and generating, for display, the 3D hand mesh adjusted to model the pose and shape of the hand depicted in the monocular image.
-
公开(公告)号：US10579869B1
公开(公告)日：2020-03-03
申请号：US15653186
申请日：2017-07-18
Applicant: Snap Inc.
Inventor： Xuehan Xiong , Zehao Xue
Abstract: A machine learning scheme can be trained on a set of labeled training images of a subject in different poses, with different textures, and with different background environments. The label or marker data of the subject may be stored as metadata to a 3D model of the subject or rendered images of the subject. The machine learning scheme may be implemented as a supervised learning scheme that can automatically identify the labeled data to create a classification model. The classification model can classify a depicted subject in many different environments and arrangements (e.g., poses).
-
-
-
-
-
-
-
Search Results
38
records
(took 0.042 seconds)
