-
公开(公告)号:US12067663B2
公开(公告)日:2024-08-20
申请号:US18058157
申请日:2022-11-22
Applicant: Snap Inc.
Inventor: Bradley Kotsopoulos , Michael Kozakov , Yingying Wang , Nicholas Hendriks , Derek Spencer
IPC: G06T13/40 , G06F3/04845 , G06T13/80 , H04N21/239 , H04N21/262 , H04N21/44 , H04N21/81 , H04N21/84
CPC classification number: G06T13/40 , G06F3/04845 , G06T13/80 , H04N21/2393 , H04N21/26258 , H04N21/44 , H04N21/8146 , H04N21/84 , G06T2200/24
Abstract: Method for generating media content items on demand starts with a processor receiving an animation file including a first metadata based on an animation input. The animation file is associated with a media content identification. The processor generates puppets associated with frames in the animation file using the first metadata. The processor causes a puppet matching interface to be displayed on a client device. The puppet matching interface includes one of the puppets in a first pose. The processor receives a puppet posing input associated with a second pose from the client device. The processor causes the one of the puppets to be displayed in the second pose in the puppet matching interface by the client device. The processor can also generate a second metadata based on the puppet posing input. Other embodiments are disclosed herein.
-
公开(公告)号:US20230162423A1
公开(公告)日:2023-05-25
申请号:US18058157
申请日:2022-11-22
Applicant: Snap Inc.
Inventor: Bradley Kotsopoulos , Michael Kozakov , Yingying Wang , Nicholas Hendriks , Derek Spencer
IPC: G06T13/40 , G06F3/04845 , H04N21/239 , G06T13/80 , H04N21/84 , H04N21/262 , H04N21/44 , H04N21/81
CPC classification number: G06T13/40 , G06F3/04845 , H04N21/2393 , G06T13/80 , H04N21/84 , H04N21/26258 , H04N21/44 , H04N21/8146 , G06T2200/24
Abstract: Method for generating media content items on demand starts with a processor receiving an animation file including a first metadata based on an animation input. The animation file is associated with a media content identification. The processor generates puppets associated with frames in the animation file using the first metadata. The processor causes a puppet matching interface to be displayed on a client device. The puppet matching interface includes one of the puppets in a first pose. The processor receives a puppet posing input associated with a second pose from the client device. The processor causes the one of the puppets to be displayed in the second pose in the puppet matching interface by the client device. The processor can also generate a second metadata based on the puppet posing input. Other embodiments are disclosed herein.
-
公开(公告)号:US11468636B2
公开(公告)日:2022-10-11
申请号:US17222176
申请日:2021-04-05
Applicant: Snap Inc.
Inventor: Liuhao Ge , Zhou Ren , Yuncheng Li , Zehao Xue , Yingying Wang
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for receiving a monocular image that includes a depiction of a hand and extracting features of the monocular image using a plurality of machine learning techniques. The program and method further include modeling, based on the extracted features, a pose of the hand depicted in the monocular image by adjusting skeletal joint positions of a three-dimensional (3D) hand mesh using a trained graph convolutional neural network (CNN); modeling, based on the extracted features, a shape of the hand in the monocular image by adjusting blend shape values of the 3D hand mesh representing surface features of the hand depicted in the monocular image using the trained graph CNN; and generating, for display, the 3D hand mesh adjusted to model the pose and shape of the hand depicted in the monocular image.
-
公开(公告)号:US10796482B2
公开(公告)日:2020-10-06
申请号:US16210927
申请日:2018-12-05
Applicant: Snap Inc.
Inventor: Liuhao Ge , Zhou Ren , Yuncheng Li , Zehao Xue , Yingying Wang
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for receiving a monocular image that includes a depiction of a hand and extracting features of the monocular image using a plurality of machine learning techniques. The program and method further include modeling, based on the extracted features, a pose of the hand depicted in the monocular image by adjusting skeletal joint positions of a three-dimensional (3D) hand mesh using a trained graph convolutional neural network (CNN); modeling, based on the extracted features, a shape of the hand in the monocular image by adjusting blend shape values of the 3D hand mesh representing surface features of the hand depicted in the monocular image using the trained graph CNN; and generating, for display, the 3D hand mesh adjusted to model the pose and shape of the hand depicted in the monocular image.
-
公开(公告)号:US11734844B2
公开(公告)日:2023-08-22
申请号:US17823764
申请日:2022-08-31
Applicant: Snap Inc.
Inventor: Liuhao Ge , Zhou Ren , Yuncheng Li , Zehao Xue , Yingying Wang
CPC classification number: G06T7/50 , G06N3/045 , G06N3/08 , G06T7/75 , G06T17/20 , G06V10/774 , G06V10/82 , G06V40/107 , G06T2207/10004
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for receiving a monocular image that includes a depiction of a hand and extracting features of the monocular image using a plurality of machine learning techniques. The program and method further include modeling, based on the extracted features, a pose of the hand depicted in the monocular image by adjusting skeletal joint positions of a three-dimensional (3D) hand mesh using a trained graph convolutional neural network (CNN); modeling, based on the extracted features, a shape of the hand in the monocular image by adjusting blend shape values of the 3D hand mesh representing surface features of the hand depicted in the monocular image using the trained graph CNN; and generating, for display, the 3D hand mesh adjusted to model the pose and shape of the hand depicted in the monocular image.
-
公开(公告)号:US11551374B2
公开(公告)日:2023-01-10
申请号:US17015819
申请日:2020-09-09
Applicant: Snap Inc.
Inventor: Yuncheng Li , Jonathan M. Rodriguez, II , Zehao Xue , Yingying Wang
Abstract: Systems and methods herein describe using a neural network to identify a first set of joint location coordinates and a second set of joint location coordinates and identifying a three-dimensional hand pose based on both the first and second sets of joint location coordinates.
-
公开(公告)号:US20220254084A1
公开(公告)日:2022-08-11
申请号:US17724235
申请日:2022-04-19
Applicant: Snap Inc.
Inventor: Harrison Jesse Smith , Chen Cao , Yingying Wang
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for transforming a motion style of an avatar from a first style to a second style. The program and method include: retrieving, by a processor from a storage device, an avatar depicting motion in a first style; receiving user input selecting a second style; obtaining, based on the user input, a trained machine learning model that performs a non-linear transformation of motion from the first style to the second style; and applying the obtained trained machine learning model to the retrieved avatar to transform the avatar from depicting motion in the first style to depicting motion in the second style.
-
公开(公告)号:US10997787B2
公开(公告)日:2021-05-04
申请号:US17010256
申请日:2020-09-02
Applicant: Snap Inc.
Inventor: Liuhao Ge , Zhou Ren , Yuncheng Li , Zehao Xue , Yingying Wang
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for receiving a monocular image that includes a depiction of a hand and extracting features of the monocular image using a plurality of machine learning techniques. The program and method further include modeling, based on the extracted features, a pose of the hand depicted in the monocular image by adjusting skeletal joint positions of a three-dimensional (3D) hand mesh using a trained graph convolutional neural network (CNN); modeling, based on the extracted features, a shape of the hand in the monocular image by adjusting blend shape values of the 3D hand mesh representing surface features of the hand depicted in the monocular image using the trained graph CNN; and generating, for display, the 3D hand mesh adjusted to model the pose and shape of the hand depicted in the monocular image.
-
公开(公告)号:US20210074016A1
公开(公告)日:2021-03-11
申请号:US17015819
申请日:2020-09-09
Applicant: Snap Inc.
Inventor: Yuncheng Li , Jonathan M. Rodriguez, II , Zehao Xue , Yingying Wang
Abstract: Systems and methods herein describe using a neural network to identify a first set of joint location coordinates and a second set of joint location coordinates and identifying a three-dimensional hand pose based on both the first and second sets of joint location coordinates.
-
公开(公告)号:US20200184721A1
公开(公告)日:2020-06-11
申请号:US16210927
申请日:2018-12-05
Applicant: Snap Inc.
Inventor: Liuhao Ge , Zhou Ren , Yuncheng Li , Zehao Xue , Yingying Wang
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for receiving a monocular image that includes a depiction of a hand and extracting features of the monocular image using a plurality of machine learning techniques. The program and method further include modeling, based on the extracted features, a pose of the hand depicted in the monocular image by adjusting skeletal joint positions of a three-dimensional (3D) hand mesh using a trained graph convolutional neural network (CNN); modeling, based on the extracted features, a shape of the hand in the monocular image by adjusting blend shape values of the 3D hand mesh representing surface features of the hand depicted in the monocular image using the trained graph CNN; and generating, for display, the 3D hand mesh adjusted to model the pose and shape of the hand depicted in the monocular image.
-
-
-
-
-
-
-
-
-