-
公开(公告)号:US11030813B2
公开(公告)日:2021-06-08
申请号:US16242708
申请日:2019-01-08
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Andrew James McPhee , Tony Mathew
IPC: G06T19/00 , G06T7/70 , H04N9/87 , G11B27/036 , G06F3/0481 , G06F3/0484 , G06F3/0488
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering a three-dimensional virtual object in a video clip. The method and system include capturing, using a camera-enabled device, video content of a real-world scene and movement information collected by the camera-enabled device during capture of the video content. The captured video and movement information are stored. The stored captured video content is processed to identify a real-world object in the scene. An interactive augmented reality display is generated that: adds a virtual object to the stored video content to create augmented video content comprising the real-world scene and the virtual object; and adjusts, during playback of the augmented video content, an on-screen position of the virtual object within the augmented video content based at least in part on the stored movement information.
-
公开(公告)号:US20210065464A1
公开(公告)日:2021-03-04
申请号:US17006471
申请日:2020-08-28
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: G06T19/20 , G06N20/00 , G06F3/0484 , G06F3/0488 , G06T7/507 , G06T15/50 , G06K9/00
Abstract: The subject technology receives a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator for applying a 3D effect, the 3D effect including at least one beautification operation. The subject technology captures image data and depth data using a camera. The subject technology applies, to the image data and the depth data, the 3D effect including the at least one beautification operation based at least in part on the augmented reality content generator, the beautification operation being performed as part of applying the 3D effect. The subject technology generates a 3D message based at least in part on the applied 3D effect including the at least one beautification operation. The subject technology renders a view of the 3D message based at least in part on the applied 3D effect including the at least one beautification operation.
-
公开(公告)号:US20210065454A1
公开(公告)日:2021-03-04
申请号:US17006438
申请日:2020-08-28
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
Abstract: The subject technology receives image data and depth data. The subject technology selects an augmented reality content generator corresponding to a three-dimensional (3D) effect. The subject technology applies the 3D effect to the image data and the depth data based at least in part on the selected augmented reality content generator. The subject technology generates, using a processor, a message including information related to the applied 3D effect, the image data, and the depth data.
-
公开(公告)号:US10901714B1
公开(公告)日:2021-01-26
申请号:US16535935
申请日:2019-08-08
Applicant: Snap Inc.
Inventor: Guohui Wang , Fenglei Tian , Samuel Edward Hare , Sumant Hanumante , Tony Mathew
Abstract: Among other things, embodiments of the present disclosure improve the functionality of computer software and systems by facilitating the automatic performance optimization of a software application based on the particular platform upon which the application runs. In some embodiments, the system can automatically choose a set of parameters or methods at run-time from a design space with pre-selected optimization methods and parameters (e.g., algorithms, software libraries, and/or hardware accelerators) for a specific task.
-
公开(公告)号:US20250078427A1
公开(公告)日:2025-03-06
申请号:US18950395
申请日:2024-11-18
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lavarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06F3/01 , G06F3/04847 , G06F3/04883 , G06T19/20 , H04L51/10
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by one or more processors that implement a messaging application, a video feed from a camera of a user device; detecting, by the messaging application, a face in the video feed; in response to detecting the face in the video feed, retrieving a three-dimensional (3D) caption; modifying the video feed to include the 3D caption at a position in 3D space of the video feed proximate to the face; and displaying a modified video feed that includes the face and the 3D caption.
-
公开(公告)号:US12231609B2
公开(公告)日:2025-02-18
申请号:US18489688
申请日:2023-10-18
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: H04N13/128 , G06T7/571 , G06T7/593 , G06T19/00 , H04L67/131 , H04N13/00 , H04N13/111 , H04N13/239
Abstract: The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology applies, to image data and depth data, the 3D effect based at least in part on the augmented reality content generator, the applying the 3D effect. The subject technology generates a depth map using at least the depth data, generates a segmentation mask based at least on the image data, and performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect.
-
公开(公告)号:US12175613B2
公开(公告)日:2024-12-24
申请号:US18375693
申请日:2023-10-02
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06F3/01 , G06F3/04847 , G06F3/04883 , G06T19/20 , H04L51/10
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by one or more processors that implement a messaging application, a video feed from a camera of a user device; detecting, by the messaging application, a face in the video feed; in response to detecting the face in the video feed, retrieving a three-dimensional (3D) caption; modifying the video feed to include the 3D caption at a position in 3D space of the video feed proximate to the face; and displaying a modified video feed that includes the face and the 3D caption.
-
公开(公告)号:US12106441B2
公开(公告)日:2024-10-01
申请号:US18073280
申请日:2022-12-01
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
CPC classification number: G06T19/006 , G06T15/00
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for rendering three-dimensional captions (3D) in real-world environments depicted in image content. An editing interface is displayed on a client device. The editing interface includes an input component displayed with a view of a camera feed. A first input comprising one or more text characters is received. In response to receiving the first input, a two-dimensional (2D) representation of the one or more text characters is displayed. In response to detecting a second input, a preview interface is displayed. Within the preview interface, a 3D caption based on the one or more text characters is rendered at a position in a 3D space captured within the camera feed. A message is generated that includes the 3D caption rendered at the position in the 3D space captured within the camera feed.
-
公开(公告)号:US20240161425A1
公开(公告)日:2024-05-16
申请号:US18419163
申请日:2024-01-22
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maximov Lazarov , Tony Mathew , Andrew Andrew McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06F3/01 , G06F3/04883 , G06T15/80 , G06T19/20
CPC classification number: G06T19/006 , G06F3/012 , G06F3/04883 , G06T15/80 , G06T19/20 , G06T2219/2004
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, a video feed from a camera of a user device that depicts a face; receiving a request to add a 3D caption to the video feed; identifying a graphical element that is associated with context of the 3D caption; and displaying the 3D caption and the identified graphical element in the video feed at a position in 3D space of the video feed proximate to the face depicted in the video feed.
-
公开(公告)号:US20230410450A1
公开(公告)日:2023-12-21
申请号:US18240380
申请日:2023-08-31
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: G06T19/20 , G06N20/00 , G06F3/04842 , G06F3/04883 , G06T15/50 , G06T7/507 , G06V40/16
CPC classification number: G06T19/20 , G06N20/00 , G06F3/04842 , G06F3/04883 , G06T15/50 , G06T7/507 , G06V40/171 , G06T2219/2012 , G06T2219/2024
Abstract: The subject technology applies, to image data and depth data, a 3D effect including at least one beautification operation based on an augmented reality content generator, the 3D effect including a beautification operation, the beautification operation comprising modifying image data, the image data including a region corresponding to a representation of a face, the beautification operation comprising using a machine learning model for at least one of smoothing blemishes or preserving facial skin texture. The subject technology generates a depth map using at least the depth data. The subject technology generates a segmentation mask based at least on the image data. The subject technology performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect including the at least one beautification operation.
-
-
-
-
-
-
-
-
-