公开(公告)号：US20210021551A1

公开(公告)日：2021-01-21

申请号：US16918343

申请日：2020-07-01

Applicant: Snap Inc.

Inventor： Jianchao Yang ,  Yuke Zhu ,  Ning Xu ,  Kevin Dechau Tang ,  Jia Li

IPC: H04L12/58 ,  G06K9/00 ,  G06F16/22 ,  G06F16/51 ,  G06F16/583 ,  G06N20/00 ,  G06F16/9535 ,  G06F16/954 ,  G06F16/2457 ,  G06F16/951 ,  G06N3/04 ,  G06N3/08

Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system communicates at least a portion of a first content collection to a first client device, and receives a first selection communication in response, the first selection communication identifying a first piece of content of the first plurality of pieces of content. The server analyzes analyzing the first piece of content to identify a set of context values for the first piece of content, and accesses accessing a second content collection comprising pieces of content sharing at least a portion of the set of context values of the first piece of content. In various embodiments, different content values, image processing operations, and content selection operations are used to curate the content collections.

公开(公告)号：US20210014636A1

公开(公告)日：2021-01-14

申请号：US17034663

申请日：2020-09-28

Applicant: Snap Inc.

Inventor： Nicholas Richard Allen ,  Sheldon Chang ,  Maria Pavlovskaia ,  Amer Shahnawaz ,  Jianchao Yang

IPC: H04W4/021 ,  H04L12/58 ,  H04L29/08 ,  H04L12/18

Abstract: Systems and methods are provided for receiving, at a first computing device, a request from a user to activate a new media collection, sending, by the first computing device, the request to a server computer for activation of the new media collection, receiving, by the first computing device, confirmation that the new media collection was activated, receiving, at the first computing device, a plurality of content messages associated with the new media collection, receiving, at the first computing device, from the user, a selection of the plurality of content messages to be included in the new media collection, sending, to the server computer, an indication of the selection of the content messages to be included in the new media collection, wherein the server computer causes the selection of content messages to be included in the new media collection and displayed in response to a request from at least a second computing device to view the new media collection.

公开(公告)号：US20190268716A1

公开(公告)日：2019-08-29

申请号：US16293300

申请日：2019-03-05

Applicant: Snap Inc.

Inventor： Nicholas Richard Allen ,  Sheldon Chang ,  Maria Pavlovskaia ,  Amer Shahnawaz ,  Jianchao Yang

IPC: H04W4/021 ,  H04L12/18 ,  H04L12/58 ,  H04L29/08

Abstract: Systems and methods are provided for receiving, at a first computing device, a request from a user to activate a new media collection, sending, by the first computing device, the request to a server computer for activation of the new media collection, receiving, by the first computing device, confirmation that the new media collection was activated, receiving, at the first computing device, a plurality of content messages associated with the new media collection, receiving, at the first computing device, from the user, a selection of the plurality of content messages to be included in the new media collection, sending, to the server computer, an indication of the selection of the content messages to be included in the new media collection, wherein the server computer causes the selection of content messages to be included in the new media collection and displayed in response to a request from at least a second computing device to view the new media collection.

公开(公告)号：US10346723B2

公开(公告)日：2019-07-09

申请号：US15340675

申请日：2016-11-01

Applicant: SNAP INC.

Inventor： Wei Han ,  Jianchao Yang ,  Ning Zhang ,  Jia Li

IPC: G06K9/62 ,  G06K9/66 ,  G06K9/46 ,  G06K9/52 ,  G06T3/40 ,  G06N3/04 ,  G06N3/08

Abstract: Systems, devices, media, and methods are presented for identifying and categorically labeling objects within a set of images. The systems and methods receive an image depicting an object of interest, detect at least a portion of the object of interest within the image using a multilayer object model, determine context information, and identify the object of interest included in two or more bounding boxes.

公开(公告)号：US10285001B2

公开(公告)日：2019-05-07

申请号：US15054869

申请日：2016-02-26

Applicant: Snap, Inc.

Inventor： Nicholas Richard Allen ,  Sheldon Chang ,  Maria Pavlovskaia ,  Amer Shahnawaz ,  Jianchao Yang

IPC: H04L12/58 ,  H04W4/02 ,  H04L29/08 ,  H04W4/021 ,  H04L12/18

Abstract: Systems and methods are provided for receiving, at a first computing device, a request from a user to activate a new media collection, sending the request to a server computer for activation of the new media collection, receiving confirmation that the new media collection was activated, receiving a plurality of content messages associated with the new media collection, receiving from the user, a selection of the plurality of content messages to be included in the new media collection, sending, to the server computer, an indication of the selection of the content messages to be included in the new media collection, wherein the server computer causes the selection of content messages to be included in the new media collection and displayed in response to a request from at least a second computing device to view the new media collection.

公开(公告)号：US12075190B2

公开(公告)日：2024-08-27

申请号：US18221702

申请日：2023-07-13

Applicant: Snap Inc.

Inventor： Lidiia Bogdanovych ,  William Brendel ,  Samuel Edward Hare ,  Fedir Poliakov ,  Guohui Wang ,  Xuehan Xiong ,  Jianchao Yang ,  Linjie Yang

IPC: G06T7/11 ,  G06F18/214 ,  G06F18/24 ,  G06N3/04 ,  G06N3/08 ,  G06T7/194 ,  G06V10/82 ,  G06V30/19 ,  G06V30/242 ,  H04N7/14 ,  H04N5/445 ,  H04N5/76

CPC classification number: H04N7/147 ,  G06F18/214 ,  G06F18/24765 ,  G06N3/04 ,  G06N3/08 ,  G06T7/11 ,  G06T7/194 ,  G06V10/82 ,  G06V30/19173 ,  G06V30/242 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20024 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20221 ,  G06T2207/30201 ,  H04N5/44504 ,  H04N5/76 ,  H04N7/141

Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can be assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.

公开(公告)号：US11830209B2

公开(公告)日：2023-11-28

申请号：US17651524

申请日：2022-02-17

Applicant: Snap Inc.

Inventor： Travis Chen ,  Samuel Edward Hare ,  Yuncheng Li ,  Tony Mathew ,  Jonathan Solichin ,  Jianchao Yang ,  Ning Zhang

IPC: G06T7/50 ,  G06T19/20 ,  G06T7/20 ,  G06T19/00 ,  G06T7/73 ,  G06V10/20 ,  G06V20/20 ,  G06V20/40 ,  G06V10/764 ,  G06V20/64

CPC classification number: G06T7/50 ,  G06T7/20 ,  G06T7/73 ,  G06T19/006 ,  G06T19/20 ,  G06V10/255 ,  G06V10/764 ,  G06V20/20 ,  G06V20/40 ,  G06V20/64 ,  G06T2207/10016 ,  G06T2207/20084 ,  G06T2210/12 ,  G06T2219/2016

Abstract: Systems, devices, media, and methods are presented for object detection and inserting graphical elements into an image stream in response to detecting the object. The systems and methods detect an object of interest in received frames of a video stream. The systems and methods identify a bounding box for the object of interest and estimate a three-dimensional position of the object of interest based on a scale of the object of interest. The systems and methods generate one or more graphical elements having a size based on the scale of the object of interest and a position based on the three-dimensional position estimated for the object of interest. The one or more graphical elements are generated within the video stream to form a modified video stream. The systems and methods cause presentation of the modified video stream including the object of interest and the one or more graphical elements.

公开(公告)号：US11645834B2

公开(公告)日：2023-05-09

申请号：US16949856

申请日：2020-11-17

Applicant: Snap Inc.

Inventor： Wei Han ,  Jianchao Yang ,  Ning Zhang ,  Jia Li

IPC: G06K9/62 ,  G06K9/46 ,  G06K9/52 ,  G06K9/66 ,  G06T3/40 ,  G06V10/42 ,  G06V10/44 ,  G06V10/46 ,  G06V30/194 ,  G06N3/04 ,  G06N3/084

CPC classification number: G06K9/6267 ,  G06K9/627 ,  G06K9/6256 ,  G06T3/40 ,  G06V10/42 ,  G06V10/44 ,  G06V10/462 ,  G06V30/194 ,  G06N3/0454 ,  G06N3/084 ,  G06V10/454

Abstract: Systems, devices, media, and methods are presented for identifying and categorically labeling objects within a set of images. The systems and methods receive an image depicting an object of interest, detect at least a portion of the object of interest within the image using a multilayer object model, determine context information, and identify the object of interest included in two or more bounding boxes.

公开(公告)号：US11551059B1

公开(公告)日：2023-01-10

申请号：US16192457

申请日：2018-11-15

Applicant: Snap Inc.

Inventor： Linjie Yang ,  Jianchao Yang ,  Xuehan Xiong ,  Yanran Wang

IPC: G06T7/00 ,  G06N3/04 ,  G06N3/08 ,  G06T7/10 ,  G06F17/18 ,  H04L51/52

Abstract: A modulated segmentation system can use a modulator network to emphasize spatial prior data of an object to track the object across multiple images. The modulated segmentation system can use a segmentation network that receives spatial prior data as intermediate data that improves segmentation accuracy. The segmentation network can further receive visual guide information from a visual guide network to increase tracking accuracy via segmentation.

公开(公告)号：US11483268B2

公开(公告)日：2022-10-25

申请号：US16918343

申请日：2020-07-01

Applicant: Snap Inc.

Inventor： Jianchao Yang ,  Yuke Zhu ,  Ning Xu ,  Kevin Dechau Tang ,  Jia Li

IPC: G06F17/00 ,  H04L51/10 ,  G06F16/22 ,  G06F16/51 ,  G06F16/583 ,  G06N20/00 ,  G06F16/9535 ,  G06F16/954 ,  G06F16/2457 ,  G06F16/951 ,  G06N3/04 ,  G06N3/08 ,  G06V20/00 ,  H04L51/52 ,  G06T7/00 ,  H04L67/01 ,  H04L67/55

Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system communicates at least a portion of a first content collection to a first client device, and receives a first selection communication in response, the first selection communication identifying a first piece of content of the first plurality of pieces of content. The server analyzes analyzing the first piece of content to identify a set of context values for the first piece of content, and accesses accessing a second content collection comprising pieces of content sharing at least a portion of the set of context values of the first piece of content. In various embodiments, different content values, image processing operations, and content selection operations are used to curate the content collections.