-
公开(公告)号:US12079931B2
公开(公告)日:2024-09-03
申请号:US17856720
申请日:2022-07-01
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M Rodriguez, II , Rahul Bhupendra Sheth , Jia Li , Xutao Lv
CPC classification number: G06T17/00 , G06T19/006 , G06T2210/56
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. Point cloud data describing an environment is then accessed. A two-dimensional surface of an image of an environment is captured, and a portion of the image is matched to a portion of key points in the point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.
-
公开(公告)号:US20230237706A1
公开(公告)日:2023-07-27
申请号:US18128128
申请日:2023-03-29
Applicant: Snap Inc.
Inventor: Drake Austin Rehfeld , Rahul Bhupendra Sheth , Ning Zhang
Abstract: Disclosed are methods for encoding information in a graphic image. The information may be encoded so as to have a visual appearance that adopts a particular style, so that the encoded information is visually pleasing in the environment in which it is displayed. An encoder and decoder are trained during an integrated training process, where the encoder is tuned to minimize a loss when its encoded images are decoded. Similarly, the decoder is also trained to minimize loss when decoding the encoded images. Both the encoder and decoder may utilize a convolutional neural network in some aspects to analyze data and/or images. Once data is encoded, a style from a sample image is transferred to the encoded data. When decoding, the decoder may largely ignore the style aspects of the encoded data and decode based on a content portion of the data.
-
公开(公告)号:US11321896B2
公开(公告)日:2022-05-03
申请号:US16949874
申请日:2020-11-18
Applicant: Snap Inc.
Inventor: Rahul Bhupendra Sheth , Maoning Guo , William Eastcott
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for rendering an avatar. A first avatar having a first level of detail is stored in a database, the first avatar including a first plurality of components. A level of detail of each of the first plurality of components is reduced separately from each other. A second plurality of components comprising the reduced level of detail of each of the first plurality of components is stored. A request is received for the first avatar in a second level of detail that comprises a lower level of detail than the first level of detail. In response to receiving the request, the second plurality of components is assembled to generate a second avatar having the second level of detail.
-
公开(公告)号:US20210256736A1
公开(公告)日:2021-08-19
申请号:US17302361
申请日:2021-04-30
Applicant: Snap Inc. Prefix
Inventor: Drake Austin Rehfeld , Rahul Bhupendra Sheth , Ning Zhang
Abstract: Disclosed are methods for encoding information in a graphic image. The information may be encoded so as to have a visual appearance that adopts a particular style, so that the encoded information is visually pleasing in the environment in which it is displayed. An encoder and decoder are trained during an integrated training process, where the encoder is tuned to minimize a loss when its encoded images are decoded. Similarly, the decoder is also trained to minimize loss when decoding the encoded images. Both the encoder and decoder may utilize a convolutional neural network in some aspects to analyze data and/or images. Once data is encoded, a style from a sample image is transferred to the encoded data. When decoding, the decoder may largely ignore the style aspects of the encoded data and decode based on a content portion of the data.
-
公开(公告)号:US10748347B1
公开(公告)日:2020-08-18
申请号:US16045431
申请日:2018-07-25
Applicant: Snap Inc.
Inventor: Jia Li , Linjie Luo , Rahul Bhupendra Sheth , Ning Xu , Jianchao Yang
Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.
-
公开(公告)号:US10102680B2
公开(公告)日:2018-10-16
申请号:US15830965
申请日:2017-12-04
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M Rodriguez, II , Rahul Bhupendra Sheth , Jia Li , Xutao Lv
IPC: G06T19/00 , G06T7/20 , G06T13/80 , G06F3/0481 , G06T19/20 , G06T7/73 , G06F3/01 , G06K9/00 , G06K9/78 , G06T7/246
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.
-
公开(公告)号:US11831937B2
公开(公告)日:2023-11-28
申请号:US17653389
申请日:2022-03-03
Applicant: Snap Inc.
Inventor: Bradley Kotsopoulos , Eli Semory , Rahul Bhupendra Sheth
IPC: H04N21/262 , G06T1/20 , H04N21/234 , H04N21/258 , H04N21/239 , H04N21/235 , G06F16/43 , G06F16/23 , H04N21/84 , H04N21/4788
CPC classification number: H04N21/26258 , G06F16/2379 , G06F16/43 , G06T1/20 , H04N21/234 , H04N21/235 , H04N21/2393 , H04N21/25891 , H04N21/84 , G06T2200/16 , G06T2200/24 , H04N21/4788
Abstract: A content controller system to render frames on demand comprises a rendering server system that includes a plurality of graphics processing units (GPUs). The GPUs in the rendering server system render a set of media content item segments using a media content identification and a main user identification. Rendering the set of media content item segments includes retrieving metadata from a metadata database associated with the media content identification, rendering the set of media content item segments using the metadata, generating a main user avatar based on the main user identification, and incorporating the main user avatar into the set of media content item segments. The rendering server system then uploads the set of media content item segments to a segment database; and updates segment states in a segment state database to indicate that the set of media content item segments are available. Other embodiments are disclosed herein.
-
公开(公告)号:US11769307B2
公开(公告)日:2023-09-26
申请号:US17728553
申请日:2022-04-25
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M. Rodriguez, II , Rahul Bhupendra Sheth , Jia Li , Xutao Lv
IPC: G06T19/00 , G06T7/73 , G06V20/10 , G06V20/20 , G06F3/01 , G06F3/04815 , G06T7/20 , G06T13/80 , G06T19/20 , G06T7/246
CPC classification number: G06T19/006 , G06F3/012 , G06F3/04815 , G06T7/20 , G06T7/246 , G06T7/73 , G06T13/80 , G06T19/20 , G06V20/10 , G06V20/20 , G06T2200/04 , G06T2207/30244 , G06T2219/2004 , G06V2201/07
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.
-
公开(公告)号:US20230088471A1
公开(公告)日:2023-03-23
申请号:US17653389
申请日:2022-03-03
Applicant: Snap Inc.
Inventor: Bradley Kotsopoulos , Eli Semory , Rahul Bhupendra Sheth
IPC: H04N21/262 , G06T1/20 , H04N21/234 , H04N21/258 , H04N21/239 , H04N21/235 , G06F16/43 , G06F16/23 , H04N21/84
Abstract: A content controller system to render frames on demand comprises a rendering server system that includes a plurality of graphics processing units (GPUs). The GPUs in the rendering server system render a set of media content item segments using a media content identification and a main user identification. Rendering the set of media content item segments includes retrieving metadata from a metadata database associated with the media content identification, rendering the set of media content item segments using the metadata, generating a main user avatar based on the main user identification, and incorporating the main user avatar into the set of media content item segments. The rendering server system then uploads the set of media content item segments to a segment database; and updates segment states in a segment state database to indicate that the set of media content item segments are available. Other embodiments are disclosed herein.
-
公开(公告)号:US11557324B2
公开(公告)日:2023-01-17
申请号:US17303817
申请日:2021-06-08
Applicant: Snap Inc.
Inventor: Jia Li , Nathan Litke , Jose Jesus (Joseph) Paredes , Rahul Bhupendra Sheth , Daniel Szeto , Ning Xu , Jianchao Yang
IPC: H04N21/218 , H04N21/2343 , H04N21/431 , H04N21/44 , H04N21/4402 , H04N21/4728 , H04N21/63 , G11B27/10 , G11B27/031
Abstract: Systems and methods are described for determining a first media item related to an event, of a plurality of stored media items each comprising video content related to the event, that was captured in a device orientation corresponding to a first device orientation detected for the first computing device; providing, to the first computing device, the first media item to be displayed on the first computing device; in response to a detected change to a second device orientation for the first computing device, determining a second media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and providing, to the first computing device, the second media item to be displayed on the first computing device.
-
-
-
-
-
-
-
-
-