-
公开(公告)号:US20240028132A1
公开(公告)日:2024-01-25
申请号:US18375763
申请日:2023-10-02
Applicant: Snap Inc.
Inventor: Dylan Shane Eirinberg , Kyle Goodrich , Andrew James McPhee , Daniel Moreno
IPC: G06F3/01 , G06F3/0482 , G06T7/20 , G06F3/04815 , G06V40/10
CPC classification number: G06F3/017 , G06F3/011 , G06F3/0482 , G06T7/20 , G06F3/04815 , G06V40/107 , G06T2207/30241 , G06T2207/10016 , G06T2207/30196
Abstract: Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; identifying a finger of a hand of the user in the video feed; determining a direction within the video feed to which the finger is pointing; and accessing a first menu option based on the direction within the video feed to which the finger is pointing.
-
公开(公告)号:US20230410450A1
公开(公告)日:2023-12-21
申请号:US18240380
申请日:2023-08-31
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: G06T19/20 , G06N20/00 , G06F3/04842 , G06F3/04883 , G06T15/50 , G06T7/507 , G06V40/16
CPC classification number: G06T19/20 , G06N20/00 , G06F3/04842 , G06F3/04883 , G06T15/50 , G06T7/507 , G06V40/171 , G06T2219/2012 , G06T2219/2024
Abstract: The subject technology applies, to image data and depth data, a 3D effect including at least one beautification operation based on an augmented reality content generator, the 3D effect including a beautification operation, the beautification operation comprising modifying image data, the image data including a region corresponding to a representation of a face, the beautification operation comprising using a machine learning model for at least one of smoothing blemishes or preserving facial skin texture. The subject technology generates a depth map using at least the depth data. The subject technology generates a segmentation mask based at least on the image data. The subject technology performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect including the at least one beautification operation.
-
公开(公告)号:US20230410442A1
公开(公告)日:2023-12-21
申请号:US18240373
申请日:2023-08-31
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06F3/0482 , G06F3/0488 , G06T5/00 , G06F3/04815
CPC classification number: G06T19/006 , G06F3/0482 , G06F3/0488 , G06T5/005 , G06F3/04815 , G06T2207/10028
Abstract: The subject technology generates a segmentation mask based on first image data. The subject technology applies the segmentation mask on first depth data to reduce a set of artifacts in a depth map based on the first depth data. The subject technology generates a packed depth map based at least in part on the depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels. The subject technology applies, to the first image data and the first depth data, a first augmented reality content generator corresponding to a selected first selectable graphical item, the first image data and the first depth data being captured with a camera. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.
-
公开(公告)号:US20230386157A1
公开(公告)日:2023-11-30
申请号:US18450193
申请日:2023-08-15
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: G06T19/00 , G06T7/194 , G06T7/50 , H04L67/131
CPC classification number: G06T19/006 , G06T7/194 , G06T7/50 , H04L67/131 , G06T2207/30201 , G06T2207/10028
Abstract: The subject technology applies a three-dimensional (3D) effect to image data and depth data based at least in part on an augmented reality content generator. The subject technology generates a segmentation mask based at least on the image data. The subject technology performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a packed depth map based at least in part on the a depth map of the depth data. The subject technology generates, using the processor, a message including information related to the applied 3D effect, the image data, and the depth data.
-
公开(公告)号:US11783556B2
公开(公告)日:2023-10-10
申请号:US18056099
申请日:2022-11-16
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06F3/0482 , G06F3/0488 , G06T5/00 , G06F3/04815
CPC classification number: G06T19/006 , G06F3/0482 , G06F3/0488 , G06F3/04815 , G06T5/005 , G06T2207/10028
Abstract: The subject technology selects a set of augmented reality content generators from available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for applying a three-dimensional (3D) effect. The subject technology causes display of a carousel interface including selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator. The subject technology receives a selection of a first selectable graphical item from the selectable graphical items, the first selectable graphical item including a first augmented reality content generator for applying a first 3D effect. The subject technology applies, to first image data and first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.
-
公开(公告)号:US20230281930A1
公开(公告)日:2023-09-07
申请号:US18144058
申请日:2023-05-05
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: G06T19/00 , G06F3/04842 , G06T7/50 , H04L51/42
CPC classification number: G06T19/00 , G06F3/04842 , G06T7/50 , H04L51/42 , G06T2207/20084
Abstract: The subject technology generates depth data using a machine learning model based at least in part on captured image data from at least one camera of a client device. The subject technology applies, to the captured image data and the generated depth data, a 3D effect based at least in part on an augmented reality content generator. The subject technology generates a depth map using at least the depth data. The subject technology generates a packed depth map based at least in part on the depth map, the generating the packed depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels based at least in part on the raw depth map. The subject technology generates a segmentation mask based at least on the captured image data. The subject technology performs background inpainting and blurring of the captured image data using at least the segmentation mask to generate background inpainted image data.
-
公开(公告)号:US20230136013A1
公开(公告)日:2023-05-04
申请号:US17514314
申请日:2021-10-29
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Christie Marie Heikkinen , Pedram Javidpour , Andrew James McPhee , Daniel Moreno
IPC: G06T13/40 , G06T13/80 , G06F3/0482 , G06T11/60 , H04L12/58
Abstract: Methods and systems are disclosed for performing operations for generating a custom sticker. The operations include receiving, by a messaging application implemented on a first device, an image. The operations include receiving, by the messaging application, input that selects a region of the image. The operations include generating, by the messaging application, a graphical element comprising the region of the image selected by the input. The operations include applying, by the messaging application, one or more visual effects to the graphical element. The operations include causing the graphical element to be animated according to a given animation pattern selected from a plurality of animation patterns to generate an animated custom graphic. The operations include sending the animated custom graphic with the one or more visual effects from the first device to a second device.
-
公开(公告)号:US20230073310A1
公开(公告)日:2023-03-09
申请号:US18056099
申请日:2022-11-16
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06F3/0482 , G06F3/0488 , G06T5/00 , G06F3/04815
Abstract: The subject technology selects a set of augmented reality content generators from available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for applying a three-dimensional (3D) effect. The subject technology causes display of a carousel interface including selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator. The subject technology receives a selection of a first selectable graphical item from the selectable graphical items, the first selectable graphical item including a first augmented reality content generator for applying a first 3D effect. The subject technology applies, to first image data and first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.
-
公开(公告)号:US20230033146A1
公开(公告)日:2023-02-02
申请号:US17818274
申请日:2022-08-08
Applicant: Snap Inc.
Inventor: Celia Nicole Mourkogiannis , Kaveh Anvaripour , Andrew James McPhee , Daniel Moreno , Kyle Goodrich , Vincent Sung
IPC: G06T19/00 , H04N5/265 , G06T17/20 , H04L51/10 , H04L51/046
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for displaying augmented reality content. The program and method provide for receiving, from a first device associated with a first user, a first request to submit a media content item for viewing, the media content item corresponding to display of a first image, captured by the first device, with an augmented reality content item, the first request including an identifier of the augmented reality content item; storing the media content item together with the identifier of the augmented reality content item; providing, to a second device associated with a second user, the media content item; receiving, from the second device, a second request to identify the augmented reality content item; and providing, to the second device, the identifier of the augmented reality content item.
-
公开(公告)号:US20230005233A1
公开(公告)日:2023-01-05
申请号:US17878635
申请日:2022-08-01
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: G06T19/20 , G06N20/00 , G06F3/04842 , G06F3/04883 , G06T15/50 , G06T7/507 , G06V40/16
Abstract: The subject technology receives a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator for applying a 3D effect, the 3D effect including at least one beautification operation. The subject technology captures image data and depth data using a camera. The subject technology applies, to the image data and the depth data, the 3D effect including the at least one beautification operation based at least in part on the augmented reality content generator, the beautification operation being performed as part of applying the 3D effect. The subject technology generates a 3D message based at least in part on the applied 3D effect including the at least one beautification operation. The subject technology renders a view of the 3D message based at least in part on the applied 3D effect including the at least one beautification operation.
-
-
-
-
-
-
-
-
-