-
公开(公告)号:US20180253901A1
公开(公告)日:2018-09-06
申请号:US15654429
申请日:2017-07-19
Applicant: Snap Inc
Inventor: Ebony James Charlton , Jokubas Dargis , Eitan Pilipski , Dhritiman Sagar , Victor Shaburov
IPC: G06T19/00 , A63F13/213 , A63F13/428 , H04W4/04
Abstract: A context based augmented reality system can be used to display augmented reality elements over a live video feed on a client device. The augmented reality elements can be selected based on a number of context inputs generated by the client device. The context inputs can include location data of the client device and location data of nearby physical places that have preconfigured augmented elements. The preconfigured augmented elements can be preconfigured to exhibit a design scheme of the corresponding physical place.
-
公开(公告)号:US09980100B1
公开(公告)日:2018-05-22
申请号:US15692990
申请日:2017-08-31
Applicant: Snap Inc.
Inventor: Ebony James Charlton , Sumant Hanumante , Zhou Ren , Dhritiman Sagar
CPC classification number: H04W4/043 , G06K9/00671 , G06K9/00691 , G06K9/00697 , G06K9/6215 , G06K9/6267 , G06T11/60 , H04L51/20 , H04L51/32 , H04W88/02
Abstract: A venue system of a client device can submit a location request to a server, which returns multiple venues that are near the client device. The client device can use one or more machine learning schemes (e.g., convolutional neural networks) to determine that the client device is located in one of specific venues of the possible venues. The venue system can further select imagery for presentation based on the venue selection. The presentation may be published as ephemeral message on a network platform.
-
公开(公告)号:US12094063B2
公开(公告)日:2024-09-17
申请号:US17932019
申请日:2022-09-14
Applicant: Snap Inc.
Inventor: Andrew James McPhee , Samuel Edward Hare , Peicheng Yu , Robert Cornelius Murphy , Dhritiman Sagar
IPC: G06T19/00 , A63F13/211 , G06F3/01 , G06F3/03 , G06F3/0346 , G06F3/038 , G06F11/08 , G06T7/246 , G06T15/20
CPC classification number: G06T19/003 , A63F13/211 , G06F3/011 , G06F3/0304 , G06F3/0346 , G06F3/038 , G06F11/08 , G06T7/246 , G06T15/20 , G06T19/006 , G06F2203/0381 , G06F2203/0382
Abstract: A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6 DoF) and 3 DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6 DoF and 3 DoF thereby providing the user with an uninterrupted experience.
-
公开(公告)号:US11961189B2
公开(公告)日:2024-04-16
申请号:US18144058
申请日:2023-05-05
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: G06T19/00 , G06F3/0482 , G06F3/04842 , G06T7/50 , H04L51/42
CPC classification number: G06T19/00 , G06F3/04842 , G06T7/50 , H04L51/42 , G06T2207/20084
Abstract: The subject technology generates depth data using a machine learning model based at least in part on captured image data from at least one camera of a client device. The subject technology applies, to the captured image data and the generated depth data, a 3D effect based at least in part on an augmented reality content generator. The subject technology generates a depth map using at least the depth data. The subject technology generates a packed depth map based at least in part on the depth map, the generating the packed depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels based at least in part on the raw depth map. The subject technology generates a segmentation mask based at least on the captured image data. The subject technology performs background inpainting and blurring of the captured image data using at least the segmentation mask to generate background inpainted image data.
-
公开(公告)号:US20240048678A1
公开(公告)日:2024-02-08
申请号:US18489688
申请日:2023-10-18
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: H04N13/128 , G06T19/00 , H04N13/239 , G06T7/593 , G06T7/571 , H04N13/111 , H04L67/131
CPC classification number: H04N13/128 , G06T19/006 , H04N13/239 , G06T7/593 , G06T7/571 , H04N13/111 , H04L67/131 , H04N2013/0081
Abstract: The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology applies, to image data and depth data, the 3D effect based at least in part on the augmented reality content generator, the applying the 3D effect. The subject technology generates a depth map using at least the depth data, generates a segmentation mask based at least on the image data, and performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect.
-
公开(公告)号:US11803992B2
公开(公告)日:2023-10-31
申请号:US17354356
申请日:2021-06-22
Applicant: Snap Inc.
Inventor: Ebony James Charlton , Sumant Hanumante , Zhou Ren , Dhritiman Sagar
IPC: H04W4/02 , G06T11/60 , H04W4/029 , H04W4/021 , H04W4/21 , G06V20/20 , G06V20/00 , H04L51/222 , G06F18/22 , G06F18/24 , G06V10/764 , G06V10/82 , G06V20/70 , H04W4/33 , H04W88/02 , H04L51/52
CPC classification number: G06T11/60 , G06F18/22 , G06F18/24 , G06V10/764 , G06V10/82 , G06V20/20 , G06V20/35 , G06V20/36 , G06V20/38 , G06V20/70 , H04L51/222 , H04W4/021 , H04W4/029 , H04W4/21 , H04W4/33 , H04L51/52 , H04W88/02
Abstract: A venue system of a client device can submit a location request to a server, which returns multiple venues that are near the client device. The client device can use one or more machine learning schemes (e.g., convolutional neural networks) to determine that the client device is located in one of specific venues of the possible venues. The venue system can further select imagery for presentation based on the venue selection. The presentation may be published as ephemeral message on a network platform.
-
公开(公告)号:US11741679B2
公开(公告)日:2023-08-29
申请号:US17953525
申请日:2022-09-27
Applicant: Snap Inc.
Inventor: Ilteris Canberk , Sumant Hanumante , Dhritiman Sagar , Stanislav Minakov
CPC classification number: G06T19/006 , G06F3/167 , G06T7/73
Abstract: Augmented reality (AR) and virtual reality (VR) environment enhancement using an eyewear device. The eyewear device includes an image capture system, a display system, and a position detection system. The image capture system and position detection system identify feature points within a point cloud that represents captured images of an environment. The display system presents image overlays to a user including enhancement graphics positioned at the feature points within the environment.
-
公开(公告)号:US11715223B2
公开(公告)日:2023-08-01
申请号:US17589459
申请日:2022-01-31
Applicant: Snap Inc.
Inventor: Kun Duan , Daniel Ron , Chongyang Ma , Ning Xu , Shenlong Wang , Sumant Milind Hanumante , Dhritiman Sagar
CPC classification number: G06T7/536 , G06T11/60 , G06T2207/10028 , G06T2207/20081 , G06T2207/20084
Abstract: An active depth detection system can generate a depth map from an image and user interaction data, such as a pair of clicks. The active depth detection system can be implemented as a recurrent neural network that can receive the user interaction data as runtime inputs after training. The active depth detection system can store the generated depth map for further processing, such as image manipulation or real-world object detection.
-
公开(公告)号:US11670057B2
公开(公告)日:2023-06-06
申请号:US17321706
申请日:2021-05-17
Applicant: Snap Inc.
Inventor: Ebony James Charlton , Jokubas Dargis , Eitan Pilipski , Dhritiman Sagar , Victor Shaburov
IPC: G06T19/00 , A63F13/213 , A63F13/428 , H04W4/021 , H04W4/02 , G06T15/00 , G06F16/95
CPC classification number: G06T19/006 , A63F13/213 , A63F13/428 , G06T19/003 , H04W4/02 , H04W4/021 , G06F16/95 , G06T15/00
Abstract: A context based augmented reality system can be used to display augmented reality elements over a live video feed on a client device. The augmented reality elements can be selected based on a number of context inputs generated by the client device. The context inputs can include location data of the client device and location data of nearby physical places that have preconfigured augmented elements. The preconfigured augmented elements can be preconfigured to exhibit a design scheme of the corresponding physical place.
-
公开(公告)号:US11631222B2
公开(公告)日:2023-04-18
申请号:US17321706
申请日:2021-05-17
Applicant: Snap Inc.
Inventor: Ebony James Charlton , Jokubas Dargis , Eitan Pilipski , Dhritiman Sagar , Victor Shaburov
IPC: G06T19/00 , A63F13/213 , A63F13/428 , H04W4/021 , H04W4/02 , G06T15/00 , G06F16/95
Abstract: A context based augmented reality system can be used to display augmented reality elements over a live video feed on a client device. The augmented reality elements can be selected based on a number of context inputs generated by the client device. The context inputs can include location data of the client device and location data of nearby physical places that have preconfigured augmented elements. The preconfigured augmented elements can be preconfigured to exhibit a design scheme of the corresponding physical place.
-
-
-
-
-
-
-
-
-