公开(公告)号：US20210407548A1

公开(公告)日：2021-12-30

申请号：US17465001

申请日：2021-09-02

Applicant: Snap Inc.

Inventor： Zhou Ren ,  Yuncheng Li ,  Ning Xu ,  Enxu Yan ,  Tan Yu

IPC: G11B27/10 ,  G06K9/00 ,  H04N9/87

Abstract: Aspects of the present disclosure involve a system comprising a storage medium storing a program and method for receiving a video comprising a plurality of video segments; selecting a target action sequence that includes a sequence of action phases; receiving features of each of the video segments; computing, based on the received features, for each of the plurality of video segments, a plurality of action phase confidence scores indicating a likelihood that a given video segment includes a given action phase of the sequence of action phases; identifying a set of consecutive video segments of the plurality of video segments that corresponds to the target action sequence, wherein video segments in the set of consecutive video segments are arranged according to the sequence of action phases; and generating a display of the video that includes the set of consecutive video segments and skips other video segments in the video.

公开(公告)号：US20210295874A1

公开(公告)日：2021-09-23

申请号：US17303817

申请日：2021-06-08

Applicant: Snap Inc.

Inventor： Jia Li ,  Nathan Litke ,  Jose Jesus (Joseph) Paredes ,  Rahul Bhupendra Sheth ,  Daniel Szeto ,  Ning Xu ,  Jianchao Yang

IPC: G11B27/10 ,  G11B27/031

Abstract: Systems and methods are described for determining a first media item related to an event, of a plurality of stored media items each comprising video content related to the event, that was captured in a device orientation corresponding to a first device orientation detected for the first computing device; providing, to the first computing device, the first media item to be displayed on the first computing device; in response to a detected change to a second device orientation for the first computing device, determining a second media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and providing, to the first computing device, the second media item to be displayed on the first computing device.

公开(公告)号：US11122218B2

公开(公告)日：2021-09-14

申请号：US16722721

申请日：2019-12-20

Applicant: Snap Inc.

Inventor： Jia Li ,  Nathan Litke ,  Jose Jesus (Joseph) Paredes ,  Rahul Bhupendra Sheth ,  Daniel Szeto ,  Ning Xu ,  Jianchao Yang

IPC: H04N5/93 ,  H04N5/262 ,  G06K9/00 ,  G06K9/62

Abstract: Systems and methods are described for determining that the user interaction with a display of a computing device during display of a video comprising a sequence of frames indicates a region of interest in a current frame of the sequence of frames of the displayed video. For each frame of the sequence of frames after the current frame, the frame is cropped to generate a cropped frame comprising a portion of the frame including the region of interest in the frame, the cropped frame is enlarged based on a display size corresponding to an angle or orientation of the computing device during display of the video, and the enlarged cropped frame replaces the frame such that the enlarged cropped frame is displayed in the sequence of frames of the video on the display of the computing device instead of the frame.

公开(公告)号：US20200258248A1

公开(公告)日：2020-08-13

申请号：US16859468

申请日：2020-04-27

Applicant: Snap Inc.

Inventor： Kun Duan ,  Daniel Ron ,  Chongyang Ma ,  Ning Xu ,  Shenlong Wang ,  Sumant Milind Hanumante ,  Dhritiman Sagar

IPC: G06T7/536 ,  G06T11/60

Abstract: An active depth detection system can generate a depth map from an image and user interaction data, such as a pair of clicks. The active depth detection system can be implemented as a recurrent neural network that can receive the user interaction data as runtime inputs after training. The active depth detection system can store the generated depth map for further processing, such as image manipulation or real-world object detection.

公开(公告)号：US10157333B1

公开(公告)日：2018-12-18

申请号：US15247697

申请日：2016-08-25

Applicant: Snap Inc.

Inventor： Xiaoyu Wang ,  Ning Xu ,  Ning Zhang ,  Vitor R. Carvalho ,  Jia Li

IPC: G06K9/62 ,  G06T1/00 ,  G06N3/08 ,  G06F17/30

Abstract: Systems, methods, devices, media, and computer readable instructions are described for local image tagging in a resource constrained environment. One embodiment involves processing image data using a deep convolutional neural network (DCNN) comprising at least a first subgraph and a second subgraph, the first subgraph comprising at least a first layer and a second layer, processing, the image data using at least the first layer of the first subgraph to generate first intermediate output data; processing, by the mobile device, the first intermediate output data using at least the second layer of the first subgraph to generate first subgraph output data, and in response to a determination that each layer reliant on the first intermediate data have completed processing, deleting the first intermediate data from the mobile device. Additional embodiments involve convolving entire pixel resolutions of the image data against kernels in different layers if the DCNN.

公开(公告)号：US12174921B2

公开(公告)日：2024-12-24

申请号：US18244543

申请日：2023-09-11

Applicant: Snap Inc.

Inventor： Jianfei Yu ,  Luis Carlos Dos Santos Marujo ,  Venkata Satya Pradeep Karuturi ,  Leonardo Ribas Machado das Neves ,  Ning Xu ,  William Brendel

IPC: G06F40/30 ,  G06F18/2431 ,  G06F40/284 ,  G06N3/045 ,  G06N3/08 ,  G06N20/20 ,  G06F40/279 ,  G06F40/289 ,  G06F40/295 ,  G10L15/06 ,  G10L15/16 ,  G10L15/18 ,  G10L25/30

Abstract: Sentiment classification can be implemented by an entity-level multimodal sentiment classification neural network. The neural network can include left, right, and target entity subnetworks. The neural network can further include an image network that generates representation data that is combined and weighted with data output by the left, right, and target entity subnetworks to output a sentiment classification for an entity included in a network post.

公开(公告)号：US12033078B2

公开(公告)日：2024-07-09

申请号：US18230499

申请日：2023-08-04

Applicant: Snap Inc.

Inventor： Yuncheng Li ,  Zhou Ren ,  Ning Xu ,  Enxu Yan ,  Tan Yu

IPC: G06N3/08 ,  G06F18/214 ,  G06F18/2431 ,  G06T7/33 ,  G06T7/55 ,  G06V10/44 ,  G06V10/82 ,  G06V20/20 ,  G06V20/40 ,  G06V20/64

CPC classification number: G06N3/08 ,  G06F18/214 ,  G06F18/2431 ,  G06T7/344 ,  G06T7/55 ,  G06V10/454 ,  G06V10/82 ,  G06V20/20 ,  G06V20/41 ,  G06V20/64

Abstract: Systems and methods are disclosed for capturing multiple sequences of views of a three-dimensional object using a plurality of virtual cameras. The systems and methods generate aligned sequences from the multiple sequences based on an arrangement of the plurality of virtual cameras in relation to the three-dimensional object. Using a convolutional network, the systems and methods classify the three-dimensional object based on the aligned sequences and identify the three-dimensional object using the classification.

公开(公告)号：US11893489B2

公开(公告)日：2024-02-06

申请号：US17972459

申请日：2022-10-24

Applicant: Snap Inc.

Inventor： Shibi He ,  Yanen Li ,  Ning Xu

IPC: G06F18/24 ,  G06F18/20 ,  G06N3/08 ,  G06N3/045

CPC classification number: G06N3/08 ,  G06F18/24 ,  G06F18/295 ,  G06N3/045

Abstract: A computer-implement method comprises: training a classifier with labeled data from a dataset; classifying, by the trained classifier, unlabeled data from the dataset; providing, by the classifier to a policy gradient, a reward signal for each data/query pair; transferring, by the classifier to a ranker, learning; training, by the policy gradient, the ranker; ranking data from the dataset based on a query; and retrieving data from the ranked data in response to the query.

公开(公告)号：US11704893B2

公开(公告)日：2023-07-18

申请号：US17465001

申请日：2021-09-02

Applicant: Snap Inc.

Inventor： Zhou Ren ,  Yuncheng Li ,  Ning Xu ,  Enxu Yan ,  Tan Yu

IPC: G06V10/54 ,  G06V10/44 ,  G11B27/10 ,  H04N9/87 ,  G06V20/40 ,  G06V10/764 ,  G06V10/82

CPC classification number: G06V10/454 ,  G06V10/764 ,  G06V10/82 ,  G06V20/41 ,  G06V20/46 ,  G11B27/102 ,  H04N9/87

Abstract: Aspects of the present disclosure involve a system comprising a storage medium storing a program and method for receiving a video comprising a plurality of video segments; selecting a target action sequence that includes a sequence of action phases; receiving features of each of the video segments; computing, based on the received features, for each of the plurality of video segments, a plurality of action phase confidence scores indicating a likelihood that a given video segment includes a given action phase of the sequence of action phases; identifying a set of consecutive video segments of the plurality of video segments that corresponds to the target action sequence, wherein video segments in the set of consecutive video segments are arranged according to the sequence of action phases; and generating a display of the video that includes the set of consecutive video segments and skips other video segments in the video.

公开(公告)号：US20230063920A1

公开(公告)日：2023-03-02

申请号：US18049098

申请日：2022-10-24

Applicant: Snap Inc.

Inventor： Jianchao Yang ,  Yuke Zhu ,  Ning Xu ,  Kevin Dechau Tang ,  Jia Li

IPC: H04L51/10 ,  G06F16/22 ,  G06F16/51 ,  G06F16/583 ,  G06N20/00 ,  G06F16/9535 ,  G06F16/954 ,  G06F16/2457 ,  G06F16/951 ,  G06N3/04 ,  G06N3/08 ,  G06V20/00 ,  H04L51/52

Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system communicates at least a portion of a first content collection to a first client device, and receives a first selection communication in response, the first selection communication identifying a first piece of content of the first plurality of pieces of content. The server analyzes analyzing the first piece of content to identify a set of context values for the first piece of content, and accesses accessing a second content collection comprising pieces of content sharing at least a portion of the set of context values of the first piece of content. In various embodiments, different content values, image processing operations, and content selection operations are used to curate the content collections.