公开(公告)号：US20230056082A1

公开(公告)日：2023-02-23

申请号：US17980879

申请日：2022-11-04

Applicant: Snap Inc.

Inventor： Jaewook Chung ,  Wisam Dakka ,  Christopher Yale Crutchfield ,  Aymeric Damien ,  Emre Yamangil ,  Chunhui Zhu

IPC: G06T11/60 ,  G06N3/04 ,  G06V30/194

Abstract: Manipulating images using computationally expensive machine learning schemes can be implemented using server-generated models of the machine learning schemes that are transmitted to a client device for application. The schemes can include convolutional neural networks having a kernel comprising a plurality of low-rank matrices.

公开(公告)号：US20210311618A1

公开(公告)日：2021-10-07

申请号：US17354520

申请日：2021-06-22

Applicant: Snap Inc.

Inventor： Theresa Barton ,  Yanping Chen ,  Jaewook Chung ,  Christopher Yale Crutchfield ,  Aymeric Damien ,  Sergei Kotcur ,  Igor Kudriashov ,  Sergey Tulyakov ,  Andrew Wan ,  Emre Yamangil

IPC: G06F3/0484 ,  G06F3/0482 ,  H04N5/265 ,  G06K9/00 ,  G06T7/11 ,  H04N5/262

Abstract: A system of machine learning schemes can be configured to efficiently perform image processing tasks on a user device, such as a mobile phone. The system can selectively detect and transform individual regions within each frame of a live streaming video. The system can selectively partition and toggle image effects within the live streaming video.

公开(公告)号：US10740939B1

公开(公告)日：2020-08-11

申请号：US15833733

申请日：2017-12-06

Applicant: Snap Inc.

Inventor： Jaewook Chung ,  Wisam Dakka

IPC: G06T11/60 ,  G06N3/04 ,  G06K9/66 ,  G06F16/51

Abstract: Manipulating images using computationally expensive machine learning schemes can be implemented using server-generated models of the machine learning schemes that are transmitted to a client device for application. The schemes can include convolutional neural networks having a kernel comprising a plurality of low-rank matrices.

公开(公告)号：US10296638B1

公开(公告)日：2019-05-21

申请号：US15839454

申请日：2017-12-12

Applicant: Snap Inc.

Inventor： Xin Chen ,  Jaewook Chung ,  Yu Hu ,  Jinhua Jiang ,  Xing Mei ,  Kirk Ouimet ,  Ning Xu

IPC: G06F17/30

Abstract: Systems and methods provide for capturing a plurality of segments of an audio stream and, for each segment of the plurality of segments of the audio stream: performing feature extraction on an audio signal of the segment using a feature extraction machine learning model that analyzes the audio signal to generate a feature vector for the segment and generating a prediction value for the segment for whether there is music in the segment using the extracted feature vector and a music detector machine learning model. The systems and methods further provide for generating a probability value that there is music in the audio stream based on the prediction value for each of the plurality of segments and causing the audio stream to be identified based on determining that the probability value that there is music in the audio stream meets a predetermined threshold.

公开(公告)号：US12107914B2

公开(公告)日：2024-10-01

申请号：US18195813

申请日：2023-05-10

Applicant: Snap Inc.

Inventor： Jaewook Chung ,  Christopher Yale Crutchfield ,  Emre Yamangil

IPC: H04L67/04 ,  G06N3/08 ,  G06N20/00 ,  G06T5/00 ,  G06T5/40 ,  G06T5/92 ,  G06T7/90 ,  G06V10/774 ,  G06V10/82 ,  G06V40/16 ,  G06Q50/00

CPC classification number: H04L67/04 ,  G06N3/08 ,  G06N20/00 ,  G06T5/00 ,  G06T5/40 ,  G06T5/92 ,  G06T7/90 ,  G06V10/7753 ,  G06V10/82 ,  G06V40/161 ,  G06V40/175 ,  G06Q50/01 ,  G06T2207/10024 ,  G06T2207/20132

Abstract: A mobile device can implement a neural network-based style transfer scheme to modify an image in a first style to a second style. The style transfer scheme can be configured to detect an object in the image, apply an effect to the image, and blend the image using color space adjustments and blending schemes to generate a realistic result image. The style transfer scheme can further be configured to efficiently execute on the constrained device by removing operational layers based on resources available on the mobile device.

公开(公告)号：US20240320228A1

公开(公告)日：2024-09-26

申请号：US18733688

申请日：2024-06-04

Applicant: Snap Inc.

Inventor： Jaewook Chung ,  Wisam Dakka ,  Andrei Damian ,  Jiwoon Jeon ,  Ranveer Kunal ,  Andre Madeira ,  Michael Brian Murray ,  Emre Yamangil ,  Diwakar Punjani ,  Yantao Zheng

IPC: G06F16/2457 ,  G06Q50/00 ,  H04L67/50

CPC classification number: G06F16/24578 ,  H04L67/535 ,  G06Q50/01

Abstract: Disclosed are implementations for ranking a feed in a social network. In one aspect, a method of generating a feed includes identifying a group of users associated with a first user, identify notifications for the first user based on the group of users, determine one or more actions that may result from each of the identified notifications, rank the notifications based on the one or more determined actions; and display the notifications to the first user according to the ranking.

公开(公告)号：US11775158B2

公开(公告)日：2023-10-03

申请号：US17354520

申请日：2021-06-22

Applicant: Snap Inc.

Inventor： Theresa Barton ,  Yanping Chen ,  Jaewook Chung ,  Christopher Yale Crutchfield ,  Aymeric Damien ,  Sergei Kotcur ,  Igor Kudriashov ,  Sergey Tulyakov ,  Andrew Wan ,  Emre Yamangil

IPC: G06T7/11 ,  G06F3/04845 ,  G06F3/0482 ,  H04N5/265 ,  H04N5/262 ,  G06V20/40 ,  G06V40/16 ,  G06F3/04817

CPC classification number: G06F3/04845 ,  G06F3/0482 ,  G06T7/11 ,  G06V20/40 ,  G06V40/161 ,  H04N5/265 ,  H04N5/2628 ,  G06F3/04817 ,  G06T2207/10016 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20132 ,  G06T2207/30201

Abstract: A system of machine learning schemes can be configured to efficiently perform image processing tasks on a user device, such as a mobile phone. The system can selectively detect and transform individual regions within each frame of a live streaming video. The system can selectively partition and toggle image effects within the live streaming video.

公开(公告)号：US11683362B2

公开(公告)日：2023-06-20

申请号：US17123493

申请日：2020-12-16

Applicant: Snap Inc.

Inventor： Jaewook Chung ,  Christopher Yale Crutchfield ,  Emre Yamangil

IPC: H04L67/04 ,  G06T5/40 ,  G06T7/90 ,  G06T5/00 ,  G06N3/08 ,  G06N20/00 ,  G06V40/16 ,  G06V10/774 ,  G06V10/82 ,  G06Q50/00

CPC classification number: H04L67/04 ,  G06N3/08 ,  G06N20/00 ,  G06T5/001 ,  G06T5/009 ,  G06T5/40 ,  G06T7/90 ,  G06V10/7753 ,  G06V10/82 ,  G06V40/161 ,  G06V40/175 ,  G06Q50/01 ,  G06T2207/10024 ,  G06T2207/20132

Abstract: A mobile device can implement a neural network-based style transfer scheme to modify an image in a first style to a second style. The style transfer scheme can be configured to detect an object in the image, apply an effect to the image, and blend the image using color space adjustments and blending schemes to generate a realistic result image. The style transfer scheme can further be configured to efficiently execute on the constrained device by removing operational layers based on resources available on the mobile device.

公开(公告)号：US11611525B2

公开(公告)日：2023-03-21

申请号：US17493111

申请日：2021-10-04

Applicant: Snap Inc.

Inventor： Theresa Barton ,  Yanping Chen ,  Lucas Ou-Yang ,  Emre Yamangil ,  Keyang Zhang ,  Jiwoon Jeon ,  Jaewook Chung ,  Wisam Dakka ,  Xin Chen

IPC: H04L51/226 ,  G06F11/34 ,  G06F11/30 ,  H04L51/52 ,  H04L51/224

Abstract: Disclosed are methods and systems for ranking content. In one aspect, a method of ranking content for display includes identifying, via hardware processing circuitry, interactions by a single account with content pairs, each of the content in the content pairs included in a plurality of content, aggregating, via the hardware processing circuitry, the identified interactions across a plurality of accounts, associating, via the hardware processing circuitry, probabilities with each content in the plurality of content based on the aggregated interactions, ranking, via the hardware processing circuitry, the plurality of content based on the associated probabilities; and selecting, via the hardware processing circuitry, content ranked above a threshold for display.

公开(公告)号：US11087432B2

公开(公告)日：2021-08-10

申请号：US16864818

申请日：2020-05-01

Applicant: Snap Inc.

Inventor： Yanping Chen ,  Jaewook Chung ,  Wisam Dakka

IPC: G06T15/00 ,  G06T1/20 ,  G06N3/08 ,  G06N3/04 ,  G06N3/063 ,  G06T11/00

Abstract: A multistage neural network system can store neural networks as shader programs on GPU memory. Neural network weights can be stored as shader objects or textures on the GPU memory. The GPU can receive a number of neural network image processing tasks to perform on images captured by a client device. The GPU can execute the tasks per driver parameters and display results in real time or near real time on the client device.