公开(公告)号：US10963748B1

公开(公告)日：2021-03-30

申请号：US16119956

申请日：2018-08-31

申请人： Snap Inc.

发明人： Sergey Tulyakov ,  Sergei Korolev ,  Aleksei Stoliar ,  Maksim Gusarov ,  Sergei Kotcur ,  Christopher Yale Crutchfield ,  Andrew Wan

IPC分类号： G06K9/62 ,  G06N3/08 ,  G06N3/04

摘要： A compact generative neural network can be distilled from a teacher generative neural network using a training network. The compact network can be trained on the input data and output data of the teacher network. The training network train the student network using a discrimination layer and one or more types of losses, such as perception loss and adversarial loss.

公开(公告)号：US20200098114A1

公开(公告)日：2020-03-26

申请号：US16698463

申请日：2019-11-27

申请人： Snap Inc.

发明人： Igor Kudriashov ,  Fedir Poliakov ,  Maksim Gusarov

IPC分类号： G06T7/20 ,  G06K9/00 ,  G06K9/46 ,  G06T11/00 ,  G06T3/40 ,  G06T5/00 ,  G06T7/11 ,  G06T7/136 ,  G06T7/73 ,  G06T7/90

摘要： Systems, devices, media, and methods are presented for segmenting an image of a video stream with a client device, identifying an area of interest, generating a modified area of interest within one or more image, identifying a first set of pixels and a second set of pixels, and modifying a color value for the first set of pixels.

公开(公告)号：US10515454B2

公开(公告)日：2019-12-24

申请号：US16232737

申请日：2018-12-26

申请人： Snap Inc.

发明人： Igor Kudriashov ,  Fedir Poliakov ,  Maksim Gusarov

IPC分类号： G06K9/00 ,  G06T7/20 ,  G06K9/46 ,  G06T11/00 ,  G06T3/40 ,  G06T5/00 ,  G06T7/11 ,  G06T7/136 ,  G06T7/73 ,  G06T7/90

摘要： Systems, devices, media, and methods are presented for segmenting an image of a video stream with a client device, identifying an area of interest, generating a modified area of interest within one or more image, identifying a first set of pixels and a second set of pixels, and modifying a color value for the first set of pixels.

公开(公告)号：US20190206061A1

公开(公告)日：2019-07-04

申请号：US16232737

申请日：2018-12-26

申请人： Snap Inc.

发明人： Igor Kudriashov ,  Fedir Poliakov ,  Maksim Gusarov

IPC分类号： G06T7/20 ,  G06K9/00 ,  G06T7/90 ,  G06K9/46 ,  G06T3/40 ,  G06T11/00 ,  G06T7/73 ,  G06T7/136 ,  G06T7/11 ,  G06T5/00

CPC分类号： G06T7/20 ,  G06K9/00248 ,  G06K9/00281 ,  G06K9/4642 ,  G06K9/4652 ,  G06K2009/4666 ,  G06T3/40 ,  G06T5/008 ,  G06T7/11 ,  G06T7/136 ,  G06T7/73 ,  G06T7/90 ,  G06T11/001 ,  G06T2207/10016 ,  G06T2207/30201

摘要： Systems, devices, media, and methods are presented for segmenting an image of a video stream with a client device, identifying an area of interest, generating a modified area of interest within one or more image, identifying a first set of pixels and a second set of pixels, and modifying a color value for the first set of pixels.

公开(公告)号：US10339365B2

公开(公告)日：2019-07-02

申请号：US15086749

申请日：2016-03-31

申请人： Snap Inc.

发明人： Maksim Gusarov ,  Igor Kudriashov ,  Valerii Filev ,  Sergei Kotcur

IPC分类号： G06K9/00 ,  G06T13/40

摘要： Systems, devices, media, and methods are presented for generating facial representations using image segmentation with a client device. The systems and methods receive an image depicting a face, detect at least a portion of the face within the image, and identify a set of facial landmarks within the portion of the face. The systems and methods determine one or more characteristics representing the portion of the face, in response to detecting the portion of the face. Based on the one or more characteristics and the set of facial landmarks, the systems and methods generate a representation of a face.

公开(公告)号：US20240355063A1

公开(公告)日：2024-10-24

申请号：US18304078

申请日：2023-04-20

申请人： Snap Inc.

发明人： Zhenpeng Zhou ,  Patrick Poirson ,  Maksim Gusarov ,  Chen Wang ,  Oleg Tovstyi

IPC分类号： G06T19/00 ,  G06T1/00 ,  G06V10/74 ,  H04N5/262

CPC分类号： G06T19/006 ,  G06T1/0021 ,  G06V10/761 ,  H04N5/2621

摘要： An input video item that includes a target visual augmentation is accessed. A machine learning model uses the input video item to generate an embedding. The embedding may comprise a vector representation of a visual effect of the target visual augmentation. The machine learning model is trained, in an unsupervised training phase, to minimize loss between training video representations generated within each of a plurality of training sets. Each training set comprises a plurality of different training video items that each include a predefined visual augmentation. Based on the generation of the embedding of the input video item, the target visual augmentation is mapped to an augmentation identifier.

公开(公告)号：US11631276B2

公开(公告)日：2023-04-18

申请号：US17303875

申请日：2021-06-09

申请人： Snap Inc.

发明人： Maksim Gusarov ,  Igor Kudriashov ,  Valerii Filev ,  Sergei Kotcur

IPC分类号： G06V40/16 ,  G06T13/40

摘要： Systems, devices, media, and methods are presented for generating facial representations using image segmentation with a client device. The systems and methods receive an image depicting a face, detect at least a portion of the face within the image, and identify a set of facial landmarks within the portion of the face. The systems and methods determine one or more characteristics representing the portion of the face, in response to detecting the portion of the face. Based on the one or more characteristics and the set of facial landmarks, the systems and methods generate a representation of a face.

公开(公告)号：US20210295018A1

公开(公告)日：2021-09-23

申请号：US17303875

申请日：2021-06-09

申请人： Snap Inc.

发明人： Maksim Gusarov ,  Igor Kudriashov ,  Valerii Filev ,  Sergei Kotcur

IPC分类号： G06K9/00 ,  G06T13/40

摘要： Systems, devices, media, and methods are presented for generating facial representations using image segmentation with a client device. The systems and methods receive an image depicting a face, detect at least a portion of the face within the image, and identify a set of facial landmarks within the portion of the face. The systems and methods determine one or more characteristics representing the portion of the face, in response to detecting the portion of the face. Based on the one or more characteristics and the set of facial landmarks, the systems and methods generate a representation of a face.

公开(公告)号：US20190266390A1

公开(公告)日：2019-08-29

申请号：US16409390

申请日：2019-05-10

申请人： Snap Inc.

发明人： Maksim Gusarov ,  Igor Kudriashov ,  Valerii Filev ,  Sergei Kotcur

IPC分类号： G06K9/00 ,  G06T13/40

摘要： Systems, devices, media, and methods are presented for generating facial representations using image segmentation with a client device. The systems and methods receive an image depicting a face, detect at least a portion of the face within the image, and identify a set of facial landmarks within the portion of the face. The systems and methods determine one or more characteristics representing the portion of the face, in response to detecting the portion of the face. Based on the one or more characteristics and the set of facial landmarks, the systems and methods generate a representation of a face.

公开(公告)号：US20230334327A1

公开(公告)日：2023-10-19

申请号：US18213145

申请日：2023-06-22

申请人： Snap Inc.

发明人： Sergey Tulyakov ,  Sergei Korolev ,  Aleksei Stoliar ,  Maksim Gusarov ,  Sergei Kotcur ,  Christopher Yale Crutchfield ,  Andrew Wan

IPC分类号： G06N3/088 ,  G06N3/08 ,  G06F18/21 ,  G06F18/214 ,  G06N3/045 ,  G06V10/764 ,  G06V10/774 ,  G06V10/778 ,  G06V10/82

CPC分类号： G06N3/088 ,  G06N3/08 ,  G06F18/2185 ,  G06F18/2148 ,  G06N3/045 ,  G06V10/764 ,  G06V10/7747 ,  G06V10/7788 ,  G06V10/82

摘要： A compact generative neural network can be distilled from a teacher generative neural network using a training network. The compact network can be trained on the input data and output data of the teacher network. The training network train the student network using a discrimination layer and one or more types of losses, such as perception loss and adversarial loss.