公开(公告)号：US11527267B2

公开(公告)日：2022-12-13

申请号：US17303817

申请日：2021-06-08

Applicant: Snap Inc.

Inventor： Jia Li ,  Nathan Litke ,  Jose Jesus (Joseph) Paredes ,  Rahul Bhupendra Sheth ,  Daniel Szeto ,  Ning Xu ,  Jianchao Yang

IPC: H04N21/218 ,  H04N21/2343 ,  H04N21/431 ,  H04N21/44 ,  H04N21/4402 ,  H04N21/4728 ,  H04N21/63 ,  G11B27/10 ,  G11B27/031

Abstract: Systems and methods are described for determining a first media item related to an event, of a plurality of stored media items each comprising video content related to the event, that was captured in a device orientation corresponding to a first device orientation detected for the first computing device; providing, to the first computing device, the first media item to be displayed on the first computing device; in response to a detected change to a second device orientation for the first computing device, determining a second media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and providing, to the first computing device, the second media item to be displayed on the first computing device.

公开(公告)号：US11200459B1

公开(公告)日：2021-12-14

申请号：US16156882

申请日：2018-10-10

Applicant: Snap Inc.

Inventor： Jianchao Yang ,  Ning Xu ,  Jian Ren

IPC: G06K9/62 ,  H04L12/58

Abstract: Disclosed herein are arrangements that facilitate the transfer of knowledge from models for a source data-processing domain to models for a target data-processing domain. A convolutional neural network space for a source domain is factored into a first classification space and a first reconstruction space. The first classification space stores class information and the first reconstruction space stores domain-specific information. A convolutional neural network space for a target domain is factored into a second classification space and a second reconstruction space. The second classification space stores class information and the second reconstruction space stores domain-specific information. Distribution of the first classification space and the second classification space is aligned.

公开(公告)号：US11158351B1

公开(公告)日：2021-10-26

申请号：US16228120

申请日：2018-12-20

Applicant: Snap Inc.

Inventor： Zhou Ren ,  Yuncheng Li ,  Ning Xu ,  Enxu Yan ,  Tan Yu

IPC: G11B27/10 ,  H04N9/87 ,  G06K9/00

Abstract: Aspects of the present disclosure involve a system comprising a storage medium storing a program and method for receiving a video comprising a plurality of video segments; selecting a target action sequence that includes a sequence of action phases; receiving features of each of the video segments; computing, based on the received features, for each of the plurality of video segments, a plurality of action phase confidence scores indicating a likelihood that a given video segment includes a given action phase of the sequence of action phases; identifying a set of consecutive video segments of the plurality of video segments that corresponds to the target action sequence, wherein video segments in the set of consecutive video segments are arranged according to the sequence of action phases; and generating a display of the video that includes the set of consecutive video segments and skips other video segments in the video.

公开(公告)号：US20200294195A1

公开(公告)日：2020-09-17

申请号：US16888171

申请日：2020-05-29

Applicant: Snap Inc.

Inventor： Guohui Wang ,  Sumant Milind Hanumante ,  Ning Xu ,  Yuncheng Li

IPC: G06T3/40 ,  G06N3/063 ,  G06N3/04 ,  G06N3/08 ,  G06T11/60 ,  G06T1/20

Abstract: Remote distribution of multiple neural network models to various client devices over a network can be implemented by identifying a native neural network and remotely converting the native neural network to a target neural network based on a given client device operating environment. The native neural network can be configured for execution using efficient parameters, and the target neural network can use less efficient but more precise parameters.

公开(公告)号：US20200152238A1

公开(公告)日：2020-05-14

申请号：US16743563

申请日：2020-01-15

Applicant: Snap Inc.

Inventor： Jia Li ,  Nathan Litke ,  Jose Jesus (Joseph) Paredes ,  Rahul Bhupendra Sheth ,  Daniel Szeto ,  Ning Xu ,  Jianchao Yang

IPC: G11B27/10 ,  G11B27/031

Abstract: Systems and methods are described for determining a first media item related to an event, of a plurality of stored media items each comprising video content related to the event, that was captured in a device orientation corresponding to a first device orientation detected for the first computing device; providing, to the first computing device, the first media item to be displayed on the first computing device; in response to a detected change to a second device orientation for the first computing device, determining a second media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and providing, to the first computing device, the second media item to be displayed on the first computing device.

公开(公告)号：US10296638B1

公开(公告)日：2019-05-21

申请号：US15839454

申请日：2017-12-12

Applicant: Snap Inc.

Inventor： Xin Chen ,  Jaewook Chung ,  Yu Hu ,  Jinhua Jiang ,  Xing Mei ,  Kirk Ouimet ,  Ning Xu

IPC: G06F17/30

Abstract: Systems and methods provide for capturing a plurality of segments of an audio stream and, for each segment of the plurality of segments of the audio stream: performing feature extraction on an audio signal of the segment using a feature extraction machine learning model that analyzes the audio signal to generate a feature vector for the segment and generating a prediction value for the segment for whether there is music in the segment using the extracted feature vector and a music detector machine learning model. The systems and methods further provide for generating a probability value that there is music in the audio stream based on the prediction value for each of the plurality of segments and causing the audio stream to be identified based on determining that the probability value that there is music in the audio stream meets a predetermined threshold.

公开(公告)号：US10055895B2

公开(公告)日：2018-08-21

申请号：US15010847

申请日：2016-01-29

Applicant: Snap Inc.

Inventor： Jia Li ,  Linjie Luo ,  Rahul Sheth ,  Ning Xu ,  Jianchao Yang

IPC: G06T19/20 ,  G06T7/20 ,  G06T19/00 ,  H04L12/58 ,  G06T7/246

CPC classification number: G06T19/20 ,  G06T7/248 ,  G06T19/006 ,  G06T2207/20104 ,  H04L51/32

Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.

公开(公告)号：US20240282330A1

公开(公告)日：2024-08-22

申请号：US18649278

申请日：2024-04-29

Applicant: Snap Inc.

Inventor： Jinxi Guo ,  Jia Li ,  Ning Xu

IPC: G10L25/30 ,  G06F18/24 ,  G06N3/045 ,  G06V10/764 ,  G06V10/82 ,  G06V20/00 ,  H04S7/00

CPC classification number: G10L25/30 ,  G06F18/24 ,  G06N3/045 ,  G06V10/764 ,  G06V10/82 ,  G06V20/00 ,  H04S7/40

Abstract: An acoustic environment identification system is disclosed that can use neural networks to accurately identify environments. The acoustic environment identification system can use one or more convolutional neural networks to generate audio feature data. A recursive neural network can process the audio feature data to generate characterization data. The characterization data can be modified using a weighting system that weights signature data items. Classification neural networks can be used to generate a classification of an environment.

公开(公告)号：US20240127064A1

公开(公告)日：2024-04-18

申请号：US18543330

申请日：2023-12-18

Applicant: Snap Inc.

Inventor： Shibi He ,  Yanen Li ,  Ning Xu

IPC: G06N3/08 ,  G06F18/20 ,  G06F18/24 ,  G06N3/045

CPC classification number: G06N3/08 ,  G06F18/24 ,  G06F18/295 ,  G06N3/045

Abstract: A computer-implement method comprises: training a classifier with labeled data from a dataset; classifying, by the trained classifier, unlabeled data from the dataset; providing, by the classifier to a policy gradient, a reward signal for each data/query pair; transferring, by the classifier to a ranker, learning; training, by the policy gradient, the ranker; ranking data from the dataset based on a query; and retrieving data from the ranked data in response to the query.

公开(公告)号：US20240062335A1

公开(公告)日：2024-02-22

申请号：US18499866

申请日：2023-11-01

Applicant: Snap Inc.

Inventor： Guohui Wang ,  Sumant Milind Hanumante ,  Ning Xu ,  Yuncheng Li

IPC: G06T3/40 ,  G06N3/08 ,  G06N3/04 ,  G06T1/20 ,  G06T11/60 ,  G06N3/063

CPC classification number: G06T3/4046 ,  G06N3/08 ,  G06N3/04 ,  G06T1/20 ,  G06T11/60 ,  G06N3/063 ,  G06T2207/20081

Abstract: Remote distribution of multiple neural network models to various client devices over a network can be implemented by identifying a native neural network and remotely converting the native neural network to a target neural network based on a given client device operating environment. The native neural network can be configured for execution using efficient parameters, and the target neural network can use less efficient but more precise parameters.