公开(公告)号：US11836185B2

公开(公告)日：2023-12-05

申请号：US17381735

申请日：2021-07-21

Applicant: Snap Inc.

Inventor： Kirk Ouimet ,  Yunchao Gong

IPC: G06V20/20 ,  G06F16/58 ,  G06T11/60 ,  G06T7/55 ,  H04L51/08

CPC classification number: G06F16/58 ,  G06T7/55 ,  G06T11/60 ,  G06V20/20 ,  G06V2201/10 ,  H04L51/08

Abstract: A computing system receives, from a client device, image data describing an image captured by an optical sensor of the client device. The computing system compares the image to a set of reference images that include associated metadata describing a real-world feature depicted by the respective reference image. The computing system determines, based on the comparison, a subset of reference images that are similar to the image, and then determines, based on associated metadata of the subset of reference images, that the image captured by the optical sensor of the client device depicts a first real-world feature. The computing system selects a subset of media overlays related to the first real-world feature based on metadata associated with each media overlay that describes the respective media overlay. The computing system transmits the subset of media overlays to the client device.

公开(公告)号：US11106343B1

公开(公告)日：2021-08-31

申请号：US16659073

申请日：2019-10-21

Applicant: Snap Inc.

Inventor： Kun Duan ,  Yunchao Gong ,  Nan Hu

IPC: G06F3/048 ,  G06T11/00 ,  G06T11/20 ,  G06T7/11 ,  G09G5/00 ,  G06F3/0484 ,  G06T7/13

Abstract: Disclosed are systems, methods, and computer-readable storage media to perform an interactive image recolorization process. The method includes receiving user input including a stroke drawn on an image presented on a client device. The stroke comprises a user-specified color. The method further includes determining a region of interest in the image. The method further includes recolorizing the region of interest on the image based on the user-specified color and causing presentation of a result of the recolorization on the client device.

公开(公告)号：US10951562B2

公开(公告)日：2021-03-16

申请号：US15409064

申请日：2017-01-18

Applicant: Snap Inc.

Inventor： Yunchao Gong ,  Kirk Ouimet

IPC: G06F3/0481 ,  G06F30/20 ,  G06T11/60 ,  H04L12/58 ,  H04W4/14 ,  H04L29/08 ,  G06F3/14 ,  G06Q30/02 ,  G06Q50/00

Abstract: Among other things, embodiments of the present disclosure improve the functionality of electronic messaging and imaging software and systems by determining topics of electronic communications between users and generating customized media content items based on such topics. The media content can be generated for a variety of topics and shared with other users. For example, media content (e.g., images or video can be generated and displayed on a user's computing device, as well as transmitted to other users via electronic communications, such as short message service (SMS) or multimedia service (MMS) texts and emails.

公开(公告)号：US12106445B2

公开(公告)日：2024-10-01

申请号：US18316793

申请日：2023-05-12

Applicant: Snap Inc.

Inventor： Kun Duan ,  Yunchao Gong ,  Nan Hu

IPC: G06T3/40 ,  G06F3/04842 ,  G06F3/04845 ,  G06T5/77 ,  G06T11/60

CPC classification number: G06T3/40 ,  G06F3/04842 ,  G06F3/04845 ,  G06T5/77 ,  G06T11/60 ,  G06T2200/24

Abstract: The technical problem of removing an object depicted in a selected region of an image to create a natural-looking edited image is addressed by providing systems, methods, and computer-readable storage media to perform automatic image inpainting. The method includes replacing the selected region using a color mask. A color mask can be generated using a mean color of pixels from a portion of the image that is distinct from and outside of the selected region.

公开(公告)号：US20230368332A1

公开(公告)日：2023-11-16

申请号：US18316793

申请日：2023-05-12

Applicant: Snap Inc.

Inventor： Kun Duan ,  Yunchao Gong ,  Nan Hu

IPC: G06T3/40 ,  G06T11/60 ,  G06T5/00 ,  G06F3/04842 ,  G06F3/04845

CPC classification number: G06T3/40 ,  G06T11/60 ,  G06T5/005 ,  G06F3/04842 ,  G06F3/04845 ,  G06T2200/24

Abstract: The technical problem of removing an object depicted in a selected region of an image to create a natural-looking edited image is addressed by providing systems, methods, and computer-readable storage media to perform automatic image inpainting. The method includes replacing the selected region using a color mask. A color mask can be generated using a mean color of pixels from a portion of the image that is distinct from and outside of the selected region.

公开(公告)号：US20210350131A1

公开(公告)日：2021-11-11

申请号：US17381735

申请日：2021-07-21

Applicant: Snap Inc.

Inventor： Kirk Ouimet ,  Yunchao Gong

IPC: G06K9/00 ,  G06T7/55 ,  G06T11/60 ,  G06K9/64

Abstract: A computing system receives, from a client device, image data describing an image captured by an optical sensor of the client device. The computing system compares the image to a set of reference images that include associated metadata describing a real-world feature depicted by the respective reference image. The computing system determines, based on the comparison, a subset of reference images that are similar to the image, and then determines, based on associated metadata of the subset of reference images, that the image captured by the optical sensor of the client device depicts a first real-world feature. The computing system selects a subset of media overlays related to the first real-world feature based on metadata associated with each media overlay that describes the respective media overlay. The computing system transmits the subset of media overlays to the client device.

公开(公告)号：US20180205681A1

公开(公告)日：2018-07-19

申请号：US15409064

申请日：2017-01-18

Applicant: Snap Inc.

Inventor： Yunchao Gong ,  Kirk Ouimet

IPC: H04L12/58 ,  H04W4/14 ,  H04L29/08 ,  G06F3/0481 ,  G06T11/60 ,  G06F3/14

Abstract: Among other things, embodiments of the present disclosure improve the functionality of electronic messaging and imaging software and systems by determining topics of electronic communications between users and generating customized media content items based on such topics. The media content can be generated for a variety of topics and shared with other users. For example, media content (e.g., images or video can be generated and displayed on a user's computing device, as well as transmitted to other users via electronic communications, such as short message service (SMS) or multimedia service (MMS) texts and emails.

公开(公告)号：US20180164986A1

公开(公告)日：2018-06-14

申请号：US15374862

申请日：2016-12-09

Applicant: Snap Inc.

Inventor： Newar Husam Al Majid ,  Sheldon Chang ,  Yunchao Gong ,  Kirk Ouimet ,  Haibo Zhao

IPC: G06F3/0484 ,  H04L29/08 ,  H04L29/06 ,  H04L12/58 ,  G06T11/60 ,  G06T7/11

CPC classification number: G06F3/04845 ,  G06F3/04842 ,  G06F9/543 ,  G06F21/10 ,  G06Q10/101 ,  G06T7/11 ,  G06T11/60 ,  G06T2200/24 ,  G06T2207/20104 ,  H04L51/04 ,  H04L51/10 ,  H04L65/4007 ,  H04L67/02 ,  H04L67/42

Abstract: Among other things, embodiments of the present disclosure improve the functionality of electronic messaging and imaging software and systems by enabling users to generate customized media overlays that can he shared with other users. For example, media overlays can be generated by the system and displayed in conjunction with media content (e.g., images and/or video) generated by an image-capturing device (e.g., a digital camera). In some embodiments, existing media overlays may be used by users to create derivative media overlays. The system may track usage of media overlays and any derivatives created based thereon, and allow users to control the distribution and use of their overlays in future derivatives. In some embodiments, for example, a user can modify an overlay they created and cause the modification to propagate to all derivative overlays based on the user's overlay.

公开(公告)号：US11991130B2

公开(公告)日：2024-05-21

申请号：US17193636

申请日：2021-03-05

Applicant: Snap Inc.

Inventor： Yunchao Gong ,  Kirk Ouimet

IPC: G06F3/0481 ,  G06F3/14 ,  G06F30/20 ,  G06Q30/02 ,  G06Q30/0251 ,  G06Q50/00 ,  G06T11/60 ,  H04L12/58 ,  H04L51/046 ,  H04L51/10 ,  H04L51/222 ,  H04L67/306 ,  H04L67/52 ,  H04W4/14 ,  H04L51/52

CPC classification number: H04L51/10 ,  G06F3/1423 ,  G06F3/1454 ,  G06Q30/02 ,  G06Q30/0255 ,  G06Q30/0267 ,  G06Q50/01 ,  H04L51/046 ,  H04L51/222 ,  H04L67/306 ,  H04L67/52 ,  H04W4/14 ,  G09G2370/10 ,  G09G2370/16 ,  H04L51/52

Abstract: Among other things, embodiments of the present disclosure improve the functionality of electronic messaging and imaging software and systems by determining topics of electronic communications between users and generating customized media content items based on such topics. The media content can be generated for a variety of topics and shared with other users. For example, media content (e.g., images or video) can be generated and displayed on a user's computing device, as well as transmitted to other users via electronic communications, such as short message service (SMS) or multimedia service (MMS) texts and mails.

公开(公告)号：US11682105B2

公开(公告)日：2023-06-20

申请号：US17400436

申请日：2021-08-12

Applicant: Snap Inc.

Inventor： Kun Duan ,  Yunchao Gong ,  Nan Hu

IPC: G06T3/40 ,  G06T11/60 ,  G06T5/00 ,  G06F3/0484 ,  G06F3/04842 ,  G06F3/04845

CPC classification number: G06T3/40 ,  G06F3/04842 ,  G06F3/04845 ,  G06T5/005 ,  G06T11/60 ,  G06T2200/24

Abstract: The technical problem of removing an object depicted in a selected region of an image to create a natural-looking edited image is addressed by providing systems, methods, and computer-readable storage media to perform automatic image inpainting. The method includes replacing the selected region using a color mask. A color mask can be generated using a mean color of pixels from a portion of the image that is distinct from and outside of the selected region.