公开(公告)号：US12254412B2

公开(公告)日：2025-03-18

申请号：US18096338

申请日：2023-01-12

Applicant: Snap Inc.

Inventor： Enxu Yan ,  Sergey Tulyakov ,  Aleksei Podkin ,  Aleksei Stoliar

IPC: G06N3/082 ,  G06F17/16 ,  G06N3/04 ,  G06T7/10

Abstract: A neural network pruning system can sparsely prune neural network models using an optimizer based approach that is agnostic to the model architecture being pruned. The neural network pruning system can prune by operating on the parameter vector of the full model and the gradient vector of the loss function with respect to the model parameters. The neural network pruning system can iteratively update parameters based on the gradients, while zeroing out as many parameters as possible based a preconfigured penalty.

公开(公告)号：US12125129B2

公开(公告)日：2024-10-22

申请号：US18136470

申请日：2023-04-19

Applicant: Snap Inc.

Inventor： Sergey Demyanov ,  Aleksei Podkin ,  Aliaksandr Siarohin ,  Aleksei Stoliar ,  Sergey Tulyakov

IPC: G06T13/00 ,  G06N3/045 ,  G06N3/08 ,  G06V40/16

CPC classification number: G06T13/00 ,  G06N3/045 ,  G06N3/08 ,  G06V40/171 ,  G06V40/174

Abstract: Systems and methods are disclosed for generating, a source image sequence using an image sensor of the computing device, the source image sequence comprising a plurality of source images depicting a head and face, identifying driving image sequence data to modify face image feature data in the source image sequence, generating, using an image transformation neural network, a modified source image sequence comprising a plurality of modified source images depicting modified versions of the head and face, and storing the modified source image sequence on the computing device.

公开(公告)号：US20230252704A1

公开(公告)日：2023-08-10

申请号：US18136470

申请日：2023-04-19

Applicant: Snap Inc.

Inventor： Sergey Demyanov ,  Aleksei Podkin ,  Aliaksandr Siarohin ,  Aleksei Stoliar ,  Sergey Tulyakov

IPC: G06T13/00 ,  G06N3/08 ,  G06N3/045 ,  G06V40/16

CPC classification number: G06T13/00 ,  G06N3/08 ,  G06N3/045 ,  G06V40/174 ,  G06V40/171

Abstract: Systems and methods are disclosed for generating, a source image sequence using an image sensor of the computing device, the source image sequence comprising a plurality of source images depicting a head and face, identifying driving image sequence data to modify face image feature data in the source image sequence, generating, using an image transformation neural network, a modified source image sequence comprising a plurality of modified source images depicting modified versions of the head and face, and storing the modified source image sequence on the computing device.

公开(公告)号：US20230146865A1

公开(公告)日：2023-05-11

申请号：US18096338

申请日：2023-01-12

Applicant: Snap Inc.

Inventor： Enxu Yan ,  Sergey Tulyakov ,  Aleksei Podkin ,  Aleksei Stoliar

IPC: G06N3/082 ,  G06F17/16 ,  G06N3/04 ,  G06T7/10

CPC classification number: G06N3/082 ,  G06F17/16 ,  G06N3/04 ,  G06T7/10 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: A neural network pruning system can sparsely prune neural network models using an optimizer based approach that is agnostic to the model architecture being pruned. The neural network pruning system can prune by operating on the parameter vector of the full model and the gradient vector of the loss function with respect to the model parameters. The neural network pruning system can iteratively update parameters based on the gradients, while zeroing out as many parameters as possible based a preconfigured penalty.42188

公开(公告)号：US11645798B1

公开(公告)日：2023-05-09

申请号：US17303537

申请日：2021-06-01

Applicant: Snap Inc.

Inventor： Sergey Demyanov ,  Aleksei Podkin ,  Aliaksandr Siarohin ,  Aleksei Stoliar ,  Sergey Tulyakov

IPC: G06T13/00 ,  G06N3/04 ,  G06N3/08 ,  G06V40/16

CPC classification number: G06T13/00 ,  G06N3/0454 ,  G06N3/08 ,  G06V40/171 ,  G06V40/174

Abstract: Systems and methods are disclosed for generating, a source image sequence using an image sensor of the computing device, the source image sequence comprising a plurality of source images depicting a head and face, identifying driving image sequence data to modify face image feature data in the source image sequence, generating, using an image transformation neural network, a modified source image sequence comprising a plurality of modified source images depicting modified versions of the head and face, and storing the modified source image sequence on the computing device.

公开(公告)号：US20250153754A1

公开(公告)日：2025-05-15

申请号：US19024189

申请日：2025-01-16

Applicant: Snap Inc.

Inventor： Sergey Demyanov ,  Yunqing Hu ,  Istvan Marton ,  Daniil Ostashev ,  Aleksei Podkin

IPC: B62B3/06 ,  A47B9/20 ,  A47B31/00 ,  B62B5/00 ,  B66F11/04

Abstract: Systems and embodiments herein describe an augmented reality (AR) object rendering system. The AR object rendering system receives an image, generates a set of noise parameters and a set of blur parameters for the image using a neural network trained on a paired dataset of images, identifies an AR object associated with the image, modifies the AR object using the set of noise parameters and the set of blur parameters, displays the modified augmented reality object within the image.

公开(公告)号：US12240515B2

公开(公告)日：2025-03-04

申请号：US18625568

申请日：2024-04-03

Applicant: Snap Inc.

Inventor： Sergey Demyanov ,  Yunqing Hu ,  Istvan Marton ,  Daniil Ostashev ,  Aleksei Podkin

IPC: B66F11/04 ,  A47B9/20 ,  A47B31/00 ,  B62B3/06 ,  B62B5/00

Abstract: Systems and embodiments herein describe an augmented reality (AR) object rendering system. The AR object rendering system receives an image, generates a set of noise parameters and a set of blur parameters for the image using a neural network trained on a paired dataset of images, identifies an AR object associated with the image, modifies the AR object using the set of noise parameters and the set of blur parameters, displays the modified augmented reality object within the image.

公开(公告)号：US12081794B2

公开(公告)日：2024-09-03

申请号：US18230511

申请日：2023-08-04

Applicant: Snap Inc.

Inventor： Sergey Demyanov ,  Andrew Cheng-min Lin ,  Walton Lin ,  Aleksei Podkin ,  Aleksei Stoliar ,  Sergey Tulyakov

IPC: H04N19/54 ,  G06N3/045 ,  H04L65/70 ,  H04N19/137 ,  H04N19/149 ,  H04N19/172

CPC classification number: H04N19/54 ,  G06N3/045 ,  H04L65/70 ,  H04N19/137 ,  H04N19/149 ,  H04N19/172

Abstract: Systems and methods herein describe a video compression system. The described systems and methods accesses a sequence of image frames from a first computing device, the sequence of image frames comprising a first image frame and a second image frame, detects a first set of keypoints for the first image frame, transmits the first image frame and the first set of keypoints to a second computing device, detects a second set of keypoints for the second image frame, transmits the second set of keypoints to the second computing device, causes an animated image to be displayed on the second computing device.

公开(公告)号：US20230379491A1

公开(公告)日：2023-11-23

申请号：US18230511

申请日：2023-08-04

Applicant: Snap Inc.

Inventor： Sergey Demyanov ,  Andrew Cheng-min Lin ,  Walton Lin ,  Aleksei Podkin ,  Aleksei Stoliar ,  Sergey Tulyakov

IPC: H04N19/54 ,  H04N19/137 ,  H04N19/149 ,  H04N19/172 ,  H04L65/70 ,  G06N3/045

CPC classification number: H04N19/54 ,  H04N19/137 ,  H04N19/149 ,  H04N19/172 ,  H04L65/70 ,  G06N3/045

Abstract: Systems and methods herein describe a video compression system. The described systems and methods accesses a sequence of image frames from a first computing device, the sequence of image frames comprising a first image frame and a second image frame, detects a first set of keypoints for the first image frame, transmits the first image frame and the first set of keypoints to a second computing device, detects a second set of keypoints for the second image frame, transmits the second set of keypoints to the second computing device, causes an animated image to be displayed on the second computing device.

公开(公告)号：US12299810B2

公开(公告)日：2025-05-13

申请号：US17846918

申请日：2022-06-22

Applicant: Snap Inc.

Inventor： Menglei Chai ,  Sergey Demyanov ,  Yunqing Hu ,  Istvan Marton ,  Daniil Ostashev ,  Aleksei Podkin

IPC: G06T15/50 ,  G06T15/80 ,  G06V10/774 ,  G06V10/82

Abstract: A method for applying lighting conditions to a virtual object in an augmented reality (AR) device is described. In one aspect, the method includes generating, using a camera of a mobile device, an image, accessing a virtual object corresponding to an object in the image, identifying lighting parameters of the virtual object based on a machine learning model that is pre-trained with a paired dataset, the paired dataset includes synthetic source data and synthetic target data, the synthetic source data includes environment maps and 3D scans of items depicted in the environment map, the synthetic target data includes a synthetic sphere image rendered in the same environment map, applying the lighting parameters to the virtual object, and displaying, in a display of the mobile device, the shaded virtual object as a layer to the image.