-
公开(公告)号:US20190279046A1
公开(公告)日:2019-09-12
申请号:US16424404
申请日:2019-05-28
Applicant: Snap Inc.
Inventor: Wei Han , Jianchao Yang , Ning Zhang , Jia Li
Abstract: Systems, devices, media, and methods are presented for identifying and categorically labeling objects within a set of images. The systems and methods receive an image depicting an object of interest, detect at least a portion of the object of interest within the image using a multilayer object model, determine context information, and identify the object of interest included in two or more bounding boxes.
-
公开(公告)号:US10055895B2
公开(公告)日:2018-08-21
申请号:US15010847
申请日:2016-01-29
Applicant: Snap Inc.
Inventor: Jia Li , Linjie Luo , Rahul Sheth , Ning Xu , Jianchao Yang
CPC classification number: G06T19/20 , G06T7/248 , G06T19/006 , G06T2207/20104 , H04L51/32
Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.
-
公开(公告)号:US20180121762A1
公开(公告)日:2018-05-03
申请号:US15340675
申请日:2016-11-01
Applicant: SNAP INC.
Inventor: Wei Han , Jianchao Yang , Ning Zhang , Jia Li
CPC classification number: G06K9/6267 , G06K9/4604 , G06K9/4628 , G06K9/4671 , G06K9/52 , G06K9/6256 , G06K9/627 , G06K9/66 , G06N3/0454 , G06N3/084 , G06T3/40
Abstract: Systems, devices, media, and methods are presented for identifying and categorically labeling objects within a set of images. The systems and methods receive an image depicting an object of interest, detect at least a portion of the object of interest within the image using a multilayer object model, determine context information, and identify the object of interest included in two or more bounding boxes.
-
公开(公告)号:US20180089904A1
公开(公告)日:2018-03-29
申请号:US15830965
申请日:2017-12-04
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M. Rodriguez, II , Rahul Bhupendra Sheth , Jia Li , Xutao Lv
IPC: G06T19/00 , G06T7/20 , G06T13/80 , G06F3/0481 , G06T19/20 , G06T7/73 , G06F3/01 , G06K9/00 , G06K9/78 , G06T7/246
CPC classification number: G06T19/006 , G06F3/012 , G06F3/04815 , G06K9/00624 , G06K9/00664 , G06K9/00671 , G06K9/78 , G06K2209/21 , G06T7/20 , G06T7/246 , G06T7/73 , G06T13/80 , G06T19/20 , G06T2200/04 , G06T2207/30244 , G06T2219/2004
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.
-
公开(公告)号:US12057136B2
公开(公告)日:2024-08-06
申请号:US18071865
申请日:2022-11-30
Applicant: Snap Inc.
CPC classification number: G10L25/30 , G06F18/24 , G06N3/045 , G06V10/764 , G06V10/82 , G06V20/00 , H04S7/40
Abstract: An acoustic environment identification system is disclosed that can use neural networks to accurately identify environments. The acoustic environment identification system can use one or more convolutional neural networks to generate audio feature data. A recursive neural network can process the audio feature data to generate characterization data. The characterization data can be modified using a weighting system that weights signature data items. Classification neural networks can be used to generate a classification of an environment.
-
公开(公告)号:US11861854B2
公开(公告)日:2024-01-02
申请号:US17825994
申请日:2022-05-26
Applicant: Snap Inc.
Inventor: Shenlong Wang , Linjie Luo , Ning Zhang , Jia Li
CPC classification number: G06T7/248 , G06T7/33 , G06V10/454 , G06V10/764 , G06V10/82 , G06T7/40 , G06T2207/20084
Abstract: Dense feature scale detection can be implemented using multiple convolutional neural networks trained on scale data to more accurately and efficiently match pixels between images. An input image can be used to generate multiple scaled images. The multiple scaled images are input into a feature net, which outputs feature data for the multiple scaled images. An attention net is used to generate an attention map from the input image. The attention map assigns emphasis as a soft distribution to different scales based on texture analysis. The feature data and the attention data can be combined through a multiplication process and then summed to generate dense features for comparison.
-
公开(公告)号:US20230419512A1
公开(公告)日:2023-12-28
申请号:US18367034
申请日:2023-09-12
Applicant: Snap Inc.
Inventor: Shenlong Wang , Linjie Luo , Ning Zhang , Jia Li
IPC: G06T7/246 , G06T7/33 , G06V10/764 , G06V10/82 , G06V10/44
CPC classification number: G06T7/248 , G06T7/33 , G06V10/764 , G06V10/82 , G06V10/454 , G06T2207/20084 , G06T7/40
Abstract: Dense feature scale detection can be implemented using multiple convolutional neural networks trained on scale data to more accurately and efficiently match pixels between images. An input image can be used to generate multiple scaled images. The multiple scaled images are input into a feature net, which outputs feature data for the multiple scaled images. An attention net is used to generate an attention map from the input image. The attention map assigns emphasis as a soft distribution to different scales based on texture analysis. The feature data and the attention data can be combined through a multiplication process and then summed to generate dense features for comparison.
-
公开(公告)号:US11727660B2
公开(公告)日:2023-08-15
申请号:US17722955
申请日:2022-04-18
Applicant: Snap Inc.
Inventor: Jia Li , Linjie Luo , Rahul Bhupendra Sheth , Ning Xu , Jianchao Yang
CPC classification number: G06T19/20 , G06T7/248 , G06T19/006 , H04L51/52 , G06T2207/20104
Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.
-
公开(公告)号:US20220358738A1
公开(公告)日:2022-11-10
申请号:US17722955
申请日:2022-04-18
Applicant: Snap Inc.
Inventor: Jia Li , Linjie Luo , Rahul Bhupendra Sheth , Ning Xu , Jianchao Yang
Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.
-
公开(公告)号:US11088977B1
公开(公告)日:2021-08-10
申请号:US16505694
申请日:2019-07-08
Applicant: Snap Inc.
Inventor: Jianchao Yang , Yuke Zhu , Ning Xu , Kevin Dechau Tang , Jia Li
Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a content message from a first content source, and analyzes the content message to determine one or more quality scores and one or more content values associated with the content message. The server computer system analyzes the content message with a plurality of content collections of the database to identify a match between at least one of the one or more content values and a topic associated with at least a first content collection of the one or more content collections and automatically adds the content message to the first content collection based at least in part on the match. In various embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.
-
-
-
-
-
-
-
-
-