-
公开(公告)号:US20230386112A1
公开(公告)日:2023-11-30
申请号:US18234226
申请日:2023-08-15
Applicant: Snap Inc.
Inventor: Ebony James Charlton , Sumant Hanumante , Zhou Ren , Dhritiman Sagar
IPC: G06T11/60 , H04W4/029 , H04W4/021 , H04W4/21 , G06V20/20 , G06V20/00 , H04L51/222 , G06F18/22 , G06F18/24 , G06V10/764 , G06V10/82 , G06V20/70 , H04W4/33
CPC classification number: G06T11/60 , H04W4/029 , H04W4/021 , H04W4/21 , G06V20/20 , G06V20/36 , G06V20/38 , H04L51/222 , G06F18/22 , G06F18/24 , G06V10/764 , G06V10/82 , G06V20/70 , G06V20/35 , H04W4/33 , H04W88/02
Abstract: A venue system of a client device can submit a location request to a server, which returns multiple venues that are near the client device. The client device can use one or more machine learning schemes (e.g., convolutional neural networks) to determine that the client device is located in one of specific venues of the possible venues. The venue system can further select imagery for presentation based on the venue selection. The presentation may be published as ephemeral message on a network platform.
-
公开(公告)号:US11825065B2
公开(公告)日:2023-11-21
申请号:US17950761
申请日:2022-09-22
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: H04N13/128 , G06T19/00 , H04N13/239 , G06T7/593 , G06T7/571 , H04N13/111 , H04L67/131 , H04N13/00
CPC classification number: H04N13/128 , G06T7/571 , G06T7/593 , G06T19/006 , H04L67/131 , H04N13/111 , H04N13/239 , G06T2200/24 , G06T2207/30201 , H04N2013/0081
Abstract: The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology applies, to image data and depth data, the 3D effect based at least in part on the augmented reality content generator, the applying the 3D effect. The subject technology generates a depth map using at least the depth data, generates a segmentation mask based at least on the image data, and performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect.
-
公开(公告)号:US20230343046A1
公开(公告)日:2023-10-26
申请号:US18216784
申请日:2023-06-30
Applicant: Snap Inc.
Inventor: Ilteris Canberk , Sumant Milind Hanumante , Stanislav Minakov , Dhritiman Sagar
CPC classification number: G06T19/006 , G06T7/73 , G06F3/167
Abstract: Augmented reality (AR) and virtual reality (VR) environment enhancement using an eyewear device. The eyewear device includes an image capture system, a display system, and a position detection system. The image capture system and position detection system identify feature points within a point cloud that represents captured images of an environment. The display system presents image overlays to a user including enhancement graphics positioned at the feature points within the environment.
-
公开(公告)号:US11776233B2
公开(公告)日:2023-10-03
申请号:US17878635
申请日:2022-08-01
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: G06T19/20 , G06N20/00 , G06F3/04842 , G06F3/04883 , G06T15/50 , G06T7/507 , G06V40/16
CPC classification number: G06T19/20 , G06F3/04842 , G06F3/04883 , G06N20/00 , G06T7/507 , G06T15/50 , G06V40/171 , G06T2219/2012 , G06T2219/2024
Abstract: The subject technology receives a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator for applying a 3D effect, the 3D effect including at least one beautification operation. The subject technology captures image data and depth data using a camera. The subject technology applies, to the image data and the depth data, the 3D effect including the at least one beautification operation based at least in part on the augmented reality content generator, the beautification operation being performed as part of applying the 3D effect. The subject technology generates a 3D message based at least in part on the applied 3D effect including the at least one beautification operation. The subject technology renders a view of the 3D message based at least in part on the applied 3D effect including the at least one beautification operation.
-
公开(公告)号:US11750682B2
公开(公告)日:2023-09-05
申请号:US17582998
申请日:2022-01-24
Applicant: Snap Inc.
Inventor: Michael Ronald Cieslak , Jiayao Yu , Kai Chen , Farnaz Azmoodeh , Michael David Marr , Jun Huang , Zahra Ferdowsi , Dhritiman Sagar
CPC classification number: H04L67/01 , G06F3/1204 , G06N3/045 , H04L51/04 , H04N21/4126 , H04W8/22
Abstract: An example method comprises: receiving, at a server from a first client device, a request for access to a client feature on the first client device; determining, by the server, an applicable rule for the access request, the applicable rule having a plurality of nodes; determining, by the server, device capabilities needed for the determined rule; determining, by the server, nodes that can be executed and nodes that cannot be executed, based on the device capabilities, the nodes that can be executed including device hardware capabilities and the nodes that cannot be executed including real-time device capabilities; executing, by the server nodes that can be executed to reach a partial decision for the applicable rule; pruning the applicable rule to remove executed nodes and generate a pruned rule that includes nodes that cannot be executed; transmitting the pruned rule and partial decision to the first client device.
-
公开(公告)号:US11748957B2
公开(公告)日:2023-09-05
申请号:US17525612
申请日:2021-11-12
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: G06T19/00 , G06T7/194 , G06T7/50 , H04L67/131
CPC classification number: G06T19/006 , G06T7/194 , G06T7/50 , H04L67/131 , G06T2207/10028 , G06T2207/30201
Abstract: The subject technology receives image data and depth data. The subject technology selects an augmented reality content generator corresponding to a three-dimensional (3D) effect. The subject technology applies the 3D effect to the image data and the depth data based at least in part on the selected augmented reality content generator. The subject technology generates, using a processor, a message including information related to the applied 3D effect, the image data, and the depth data.
-
公开(公告)号:US20230222745A1
公开(公告)日:2023-07-13
申请号:US18123028
申请日:2023-03-17
Applicant: Snap Inc.
Inventor: Ebony James Charlton , Jokubas Dargis , Eitan Pilipski , Dhritiman Sagar , Victor Shaburov
IPC: G06T19/00 , A63F13/213 , A63F13/428 , H04W4/02 , H04W4/021 , G06T15/00 , G06F16/95
CPC classification number: G06T19/006 , A63F13/213 , A63F13/428 , G06T19/003 , H04W4/02 , H04W4/021 , G06T15/00 , G06F16/95
Abstract: A context based augmented reality system can be used to display augmented reality elements over a live video feed on a client device. The augmented reality elements can be selected based on a number of context inputs generated by the client device. The context inputs can include location data of the client device and location data of nearby physical places that have preconfigured augmented elements. The preconfigured augmented elements can be preconfigured to exhibit a design scheme of the corresponding physical place.
-
公开(公告)号:US11676342B2
公开(公告)日:2023-06-13
申请号:US17952051
申请日:2022-09-23
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: G06T19/00 , G06F3/04842 , G06T7/50 , H04L51/42
CPC classification number: G06T19/00 , G06F3/04842 , G06T7/50 , H04L51/42 , G06T2207/20084
Abstract: The subject technology generates depth data using a machine learning model based at least in part on captured image data from at least one camera of a client device. The subject technology applies, to the captured image data and the generated depth data, a 3D effect based at least in part on an augmented reality content generator. The subject technology generates a depth map using at least the depth data. The subject technology generates a packed depth map based at least in part on the depth map, the generating the packed depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels based at least in part on the raw depth map. The subject technology generates a segmentation mask based at least on the captured image data. The subject technology performs background inpainting and blurring of the captured image data using at least the segmentation mask to generate background inpainted image data.
-
公开(公告)号:US20230005223A1
公开(公告)日:2023-01-05
申请号:US17932019
申请日:2022-09-14
Applicant: Snap Inc.
Inventor: Andrew James McPhee , Samuel Edward Hare , Peicheng Yu , Robert Cornelius Murphy , Dhritiman Sagar
IPC: G06T19/00 , G06F11/08 , G06F3/01 , G06F3/0346 , G06F3/03 , G06T7/246 , A63F13/211 , G06F3/038 , G06T15/20
Abstract: A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6DoF) and 3DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6DoF and 3DoF thereby providing the user with an uninterrupted experience.
-
公开(公告)号:US11290576B2
公开(公告)日:2022-03-29
申请号:US16803025
申请日:2020-02-27
Applicant: Snap Inc.
Inventor: Michael Ronald Cieslak , Jiayao Yu , Kai Chen , Farnaz Azmoodeh , Michael David Marr , Jun Huang , Zahra Ferdowsi , Dhritiman Sagar
Abstract: An example method comprises: receiving, at a server from a first client device, a request for access to a client feature on the first client device; determining, by the server, an applicable rule for the access request, the applicable rule having a plurality of nodes; determining, by the server, device capabilities needed for the determined rule; determining, by the server, nodes that can be executed and nodes that cannot be executed, based on the device capabilities, the nodes that can be executed including device hardware capabilities and the nodes that cannot be executed including real-time device capabilities; executing, by the server nodes that can be executed to reach a partial decision for the applicable rule; pruning the applicable rule to remove executed nodes and generate a pruned rule that includes nodes that cannot be executed; transmitting the pruned rule and partial decision to the first client device.
-
-
-
-
-
-
-
-
-