公开(公告)号：US11783556B2

公开(公告)日：2023-10-10

申请号：US18056099

申请日：2022-11-16

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/00 ,  G06F3/0482 ,  G06F3/0488 ,  G06T5/00 ,  G06F3/04815

CPC classification number: G06T19/006 ,  G06F3/0482 ,  G06F3/0488 ,  G06F3/04815 ,  G06T5/005 ,  G06T2207/10028

Abstract: The subject technology selects a set of augmented reality content generators from available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for applying a three-dimensional (3D) effect. The subject technology causes display of a carousel interface including selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator. The subject technology receives a selection of a first selectable graphical item from the selectable graphical items, the first selectable graphical item including a first augmented reality content generator for applying a first 3D effect. The subject technology applies, to first image data and first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.

公开(公告)号：US20230281930A1

公开(公告)日：2023-09-07

申请号：US18144058

申请日：2023-05-05

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: G06T19/00 ,  G06F3/04842 ,  G06T7/50 ,  H04L51/42

CPC classification number: G06T19/00 ,  G06F3/04842 ,  G06T7/50 ,  H04L51/42 ,  G06T2207/20084

Abstract: The subject technology generates depth data using a machine learning model based at least in part on captured image data from at least one camera of a client device. The subject technology applies, to the captured image data and the generated depth data, a 3D effect based at least in part on an augmented reality content generator. The subject technology generates a depth map using at least the depth data. The subject technology generates a packed depth map based at least in part on the depth map, the generating the packed depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels based at least in part on the raw depth map. The subject technology generates a segmentation mask based at least on the captured image data. The subject technology performs background inpainting and blurring of the captured image data using at least the segmentation mask to generate background inpainted image data.

公开(公告)号：US20230136013A1

公开(公告)日：2023-05-04

申请号：US17514314

申请日：2021-10-29

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Christie Marie Heikkinen ,  Pedram Javidpour ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06T13/40 ,  G06T13/80 ,  G06F3/0482 ,  G06T11/60 ,  H04L12/58

Abstract: Methods and systems are disclosed for performing operations for generating a custom sticker. The operations include receiving, by a messaging application implemented on a first device, an image. The operations include receiving, by the messaging application, input that selects a region of the image. The operations include generating, by the messaging application, a graphical element comprising the region of the image selected by the input. The operations include applying, by the messaging application, one or more visual effects to the graphical element. The operations include causing the graphical element to be animated according to a given animation pattern selected from a plurality of animation patterns to generate an animated custom graphic. The operations include sending the animated custom graphic with the one or more visual effects from the first device to a second device.

公开(公告)号：US20230073310A1

公开(公告)日：2023-03-09

申请号：US18056099

申请日：2022-11-16

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/00 ,  G06F3/0482 ,  G06F3/0488 ,  G06T5/00 ,  G06F3/04815

Abstract: The subject technology selects a set of augmented reality content generators from available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for applying a three-dimensional (3D) effect. The subject technology causes display of a carousel interface including selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator. The subject technology receives a selection of a first selectable graphical item from the selectable graphical items, the first selectable graphical item including a first augmented reality content generator for applying a first 3D effect. The subject technology applies, to first image data and first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.

公开(公告)号：US20230033146A1

公开(公告)日：2023-02-02

申请号：US17818274

申请日：2022-08-08

Applicant: Snap Inc.

Inventor： Celia Nicole Mourkogiannis ,  Kaveh Anvaripour ,  Andrew James McPhee ,  Daniel Moreno ,  Kyle Goodrich ,  Vincent Sung

IPC: G06T19/00 ,  H04N5/265 ,  G06T17/20 ,  H04L51/10 ,  H04L51/046

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for displaying augmented reality content. The program and method provide for receiving, from a first device associated with a first user, a first request to submit a media content item for viewing, the media content item corresponding to display of a first image, captured by the first device, with an augmented reality content item, the first request including an identifier of the augmented reality content item; storing the media content item together with the identifier of the augmented reality content item; providing, to a second device associated with a second user, the media content item; receiving, from the second device, a second request to identify the augmented reality content item; and providing, to the second device, the identifier of the augmented reality content item.

公开(公告)号：US20230005233A1

公开(公告)日：2023-01-05

申请号：US17878635

申请日：2022-08-01

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: G06T19/20 ,  G06N20/00 ,  G06F3/04842 ,  G06F3/04883 ,  G06T15/50 ,  G06T7/507 ,  G06V40/16

Abstract: The subject technology receives a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator for applying a 3D effect, the 3D effect including at least one beautification operation. The subject technology captures image data and depth data using a camera. The subject technology applies, to the image data and the depth data, the 3D effect including the at least one beautification operation based at least in part on the augmented reality content generator, the beautification operation being performed as part of applying the 3D effect. The subject technology generates a 3D message based at least in part on the applied 3D effect including the at least one beautification operation. The subject technology renders a view of the 3D message based at least in part on the applied 3D effect including the at least one beautification operation.

公开(公告)号：US20220374131A1

公开(公告)日：2022-11-24

申请号：US17448169

申请日：2021-09-20

Applicant: Snap Inc.

Inventor： Karen Stolzenberg ,  David Meisenholder ,  Mathieu Emmanuel Vignau ,  Joseph Timothy Fortier ,  Kaveh Anvaripour ,  Daniel Moreno ,  Kyle Goodrich ,  Ilteris Kaan Canberk ,  Shin Hwun Kang

IPC: G06F3/0481 ,  G06F3/0485 ,  G06F3/0488 ,  G02B27/01 ,  G06T19/00

Abstract: Disclosed is a method of receiving and processing navigation inputs executed by one or more processors in a head-worn device system including one or more display devices, one or more cameras and a generally vertically-arranged touchpad. The method comprises displaying a first carousel of AR effects icons, receiving a first horizontal input on the touchpad, rotating the first carousel of AR effects icons in response to first horizontal input, receiving a first touch input on the touchpad to select a particular AR effects icon that is in a selection position in the first carousel, displaying a scene viewed by the one or more cameras, the scene being enhanced with AR effects corresponding to the particular AR effects icon, receiving content capture user input, and in response to the content capture user input, capturing a new content item corresponding to the scene.

公开(公告)号：US11443491B2

公开(公告)日：2022-09-13

申请号：US17249092

申请日：2021-02-19

Applicant: Snap Inc.

Inventor： Samuel Edward Hare ,  Andrew James McPhee ,  Maxim Maximov Lazarov ,  Wentao Shang ,  Kyle Goodrich ,  Tony Mathew

IPC: G06T19/00 ,  G06T19/20 ,  H04L51/04 ,  H04N5/247 ,  H04N5/272

Abstract: Systems and methods are provided for capturing by a camera of a user device, a first image depicting a first environment of the user device; overlaying a first virtual object on a portion of the first image depicting the first environment; modifying a surface of the first virtual object using content captured by the user device; storing a second virtual object comprising the first virtual object with the modified surface; and generating for display the second virtual object on a portion of a second image depicting a second environment.

公开(公告)号：US11410401B2

公开(公告)日：2022-08-09

申请号：US17006471

申请日：2020-08-28

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: G06T19/20 ,  G06N20/00 ,  G06F3/04842 ,  G06F3/04883 ,  G06T15/50 ,  G06T7/507 ,  G06V40/16

Abstract: The subject technology receives a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator for applying a 3D effect, the 3D effect including at least one beautification operation. The subject technology captures image data and depth data using a camera. The subject technology applies, to the image data and the depth data, the 3D effect including the at least one beautification operation based at least in part on the augmented reality content generator, the beautification operation being performed as part of applying the 3D effect. The subject technology generates a 3D message based at least in part on the applied 3D effect including the at least one beautification operation. The subject technology renders a view of the 3D message based at least in part on the applied 3D effect including the at least one beautification operation.

公开(公告)号：US20220197393A1

公开(公告)日：2022-06-23

申请号：US17410787

申请日：2021-08-24

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06F3/01 ,  G06F3/0485 ,  G06F3/0484 ,  G06F3/0482 ,  G06F3/0481

Abstract: Systems and methods are provided for performing operations comprising: displaying one or more virtual objects on an eyewear device; detecting, by a camera of the eyewear device, a hand within view of the eyewear device; determining that a first finger of the hand is oriented along a same direction as the one or more virtual objects that are displayed; detecting movement of a second finger of the hand relative to the first finger; and controlling the display of the one or more virtual objects in response to detecting movement of the second finger to the first finger.