公开(公告)号：US20200020158A1

公开(公告)日：2020-01-16

申请号：US16579463

申请日：2019-09-23

Applicant: Snap Inc.

Inventor： Andrew James McPhee ,  Samual Edward Hare ,  Peicheng Yu ,  Robert Cornelius Murply ,  Dhritiman Sagar

IPC: G06T19/00 ,  G06T15/20 ,  G06F11/08 ,  G06F3/01 ,  A63F13/211

Abstract: A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6DoF) and 3DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6DoF and 3DoF thereby providing the user with an uninterrupted experience.

公开(公告)号：US12231609B2

公开(公告)日：2025-02-18

申请号：US18489688

申请日：2023-10-18

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: H04N13/128 ,  G06T7/571 ,  G06T7/593 ,  G06T19/00 ,  H04L67/131 ,  H04N13/00 ,  H04N13/111 ,  H04N13/239

Abstract: The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology applies, to image data and depth data, the 3D effect based at least in part on the augmented reality content generator, the applying the 3D effect. The subject technology generates a depth map using at least the depth data, generates a segmentation mask based at least on the image data, and performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect.

公开(公告)号：US12039648B2

公开(公告)日：2024-07-16

申请号：US18234226

申请日：2023-08-15

Applicant: Snap Inc.

Inventor： Ebony James Charlton ,  Sumant Hanumante ,  Zhou Ren ,  Dhritiman Sagar

IPC: G06F18/24 ,  G06F18/22 ,  G06N20/00 ,  G06T11/60 ,  G06V10/764 ,  G06V10/82 ,  G06V20/00 ,  G06V20/20 ,  G06V20/70 ,  H04L51/222 ,  H04W4/021 ,  H04W4/029 ,  H04W4/21 ,  H04W4/33 ,  H04L51/52 ,  H04W88/02

CPC classification number: G06T11/60 ,  G06F18/22 ,  G06F18/24 ,  G06V10/764 ,  G06V10/82 ,  G06V20/20 ,  G06V20/35 ,  G06V20/36 ,  G06V20/38 ,  G06V20/70 ,  H04L51/222 ,  H04W4/021 ,  H04W4/029 ,  H04W4/21 ,  H04W4/33 ,  H04L51/52 ,  H04W88/02

Abstract: A venue system of a client device can submit a location request to a server, which returns multiple venues that are near the client device. The client device can use one or more machine learning schemes (e.g., convolutional neural networks) to determine that the client device is located in one of specific venues of the possible venues. The venue system can further select imagery for presentation based on the venue selection. The presentation may be published as ephemeral message on a network platform.

公开(公告)号：US11961196B2

公开(公告)日：2024-04-16

申请号：US18123028

申请日：2023-03-17

Applicant: Snap Inc.

Inventor： Ebony James Charlton ,  Jokubas Dargis ,  Eitan Pilipski ,  Dhritiman Sagar ,  Victor Shaburov

IPC: G06T19/00 ,  A63F13/213 ,  A63F13/428 ,  G06T15/00 ,  H04W4/02 ,  H04W4/021 ,  G06F16/95

CPC classification number: G06T19/006 ,  A63F13/213 ,  A63F13/428 ,  G06T19/003 ,  H04W4/02 ,  H04W4/021 ,  G06F16/95 ,  G06T15/00

Abstract: A context based augmented reality system can be used to display augmented reality elements over a live video feed on a client device. The augmented reality elements can be selected based on a number of context inputs generated by the client device. The context inputs can include location data of the client device and location data of nearby physical places that have preconfigured augmented elements. The preconfigured augmented elements can be preconfigured to exhibit a design scheme of the corresponding physical place.

公开(公告)号：US20230410450A1

公开(公告)日：2023-12-21

申请号：US18240380

申请日：2023-08-31

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: G06T19/20 ,  G06N20/00 ,  G06F3/04842 ,  G06F3/04883 ,  G06T15/50 ,  G06T7/507 ,  G06V40/16

CPC classification number: G06T19/20 ,  G06N20/00 ,  G06F3/04842 ,  G06F3/04883 ,  G06T15/50 ,  G06T7/507 ,  G06V40/171 ,  G06T2219/2012 ,  G06T2219/2024

Abstract: The subject technology applies, to image data and depth data, a 3D effect including at least one beautification operation based on an augmented reality content generator, the 3D effect including a beautification operation, the beautification operation comprising modifying image data, the image data including a region corresponding to a representation of a face, the beautification operation comprising using a machine learning model for at least one of smoothing blemishes or preserving facial skin texture. The subject technology generates a depth map using at least the depth data. The subject technology generates a segmentation mask based at least on the image data. The subject technology performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect including the at least one beautification operation.

公开(公告)号：US20230386157A1

公开(公告)日：2023-11-30

申请号：US18450193

申请日：2023-08-15

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: G06T19/00 ,  G06T7/194 ,  G06T7/50 ,  H04L67/131

CPC classification number: G06T19/006 ,  G06T7/194 ,  G06T7/50 ,  H04L67/131 ,  G06T2207/30201 ,  G06T2207/10028

Abstract: The subject technology applies a three-dimensional (3D) effect to image data and depth data based at least in part on an augmented reality content generator. The subject technology generates a segmentation mask based at least on the image data. The subject technology performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a packed depth map based at least in part on the a depth map of the depth data. The subject technology generates, using the processor, a message including information related to the applied 3D effect, the image data, and the depth data.

公开(公告)号：US20230290027A1

公开(公告)日：2023-09-14

申请号：US18320710

申请日：2023-05-19

Applicant: Snap Inc.

Inventor： Ebony James Charlton ,  Dhritiman Sagar ,  Daniel Vincent Grippi

IPC: G06T11/60 ,  H04W4/021 ,  G06F3/04817

CPC classification number: G06T11/60 ,  H04W4/021 ,  G06F3/04817 ,  G01S19/13

Abstract: A content display system can control which content and how the content is displayed based on viewing parameters, such as a map zoom level, and physical distance parameters, e.g., a geo-fence distance and an icon visibility distance. Different combinations of input (e.g., zoom level and physical distances) yield a myriad of pre-set content displays on the client device, thereby allowing a creator of an icon to finely tune how content displayed otherwise accessed.

公开(公告)号：US20230281930A1

公开(公告)日：2023-09-07

申请号：US18144058

申请日：2023-05-05

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: G06T19/00 ,  G06F3/04842 ,  G06T7/50 ,  H04L51/42

CPC classification number: G06T19/00 ,  G06F3/04842 ,  G06T7/50 ,  H04L51/42 ,  G06T2207/20084

Abstract: The subject technology generates depth data using a machine learning model based at least in part on captured image data from at least one camera of a client device. The subject technology applies, to the captured image data and the generated depth data, a 3D effect based at least in part on an augmented reality content generator. The subject technology generates a depth map using at least the depth data. The subject technology generates a packed depth map based at least in part on the depth map, the generating the packed depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels based at least in part on the raw depth map. The subject technology generates a segmentation mask based at least on the captured image data. The subject technology performs background inpainting and blurring of the captured image data using at least the segmentation mask to generate background inpainted image data.

公开(公告)号：US20230005233A1

公开(公告)日：2023-01-05

申请号：US17878635

申请日：2022-08-01

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: G06T19/20 ,  G06N20/00 ,  G06F3/04842 ,  G06F3/04883 ,  G06T15/50 ,  G06T7/507 ,  G06V40/16

Abstract: The subject technology receives a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator for applying a 3D effect, the 3D effect including at least one beautification operation. The subject technology captures image data and depth data using a camera. The subject technology applies, to the image data and the depth data, the 3D effect including the at least one beautification operation based at least in part on the augmented reality content generator, the beautification operation being performed as part of applying the 3D effect. The subject technology generates a 3D message based at least in part on the applied 3D effect including the at least one beautification operation. The subject technology renders a view of the 3D message based at least in part on the applied 3D effect including the at least one beautification operation.

公开(公告)号：US20220373796A1

公开(公告)日：2022-11-24

申请号：US17744880

申请日：2022-05-16

Applicant: Snap Inc.

Inventor： David Meisenholder ,  Dhritiman Sagar ,  Ilteris Canberk ,  Justin Wilder ,  Sumant Milind Hanumante ,  James Powderly

IPC: G02B27/01 ,  G06T19/00 ,  G06F3/01

Abstract: Augmented reality experiences of a user wearing an electronic eyewear device are captured by at least one camera on a frame of the electronic eyewear device, the at least one camera having a field of view that is larger than a field of view of a display of the electronic eyewear device. An augmented reality feature or object is applied to the captured scene. A photo or video of the augmented reality scene is captured and a first portion of the captured photo or video is displayed in the display. The display is adjusted to display a second portion of the captured photo or video with the augmented reality features as the user moves the user's head to view the second portion of the captured photo or video. The captured photo or video may be transferred to another device for viewing the larger field of view augmented reality image.