-
公开(公告)号:US11315331B2
公开(公告)日:2022-04-26
申请号:US16913503
申请日:2020-06-26
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M Rodriguez, II , Rahul Sheth , Jia Li , Xutao Lv
IPC: G06T19/00 , G06T7/73 , G06F3/01 , G06F3/04815 , G06K9/00 , G06K9/78 , G06T7/20 , G06T13/80 , G06T19/20 , G06T7/246
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.
-
公开(公告)号:US20220038402A1
公开(公告)日:2022-02-03
申请号:US17372981
申请日:2021-07-12
Applicant: Snap Inc.
Inventor: Jianchao Yang , Yuke Zhu , Ning Xu , Kevin Dechau Tang , Jia Li
IPC: H04L12/58 , G06K9/00 , G06F16/22 , G06F16/51 , G06F16/583 , G06N20/00 , G06F16/9535 , G06F16/954 , G06F16/2457 , G06F16/951 , G06N3/04 , G06N3/08
Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a plurality of content communications from a plurality of client devices, each content communication comprising an associated piece of content and a corresponding metadata. Each content communication is processed to determine associated context values for each piece of content, each associated context value comprising at least one content value generated by machine vision processing of the associated piece of content. A first content collection is automatically generated based on context values, and a set of user accounts are associated with the collection. An identifier associated with the first content collection is published to user devices associated with user accounts. In various additional embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.
-
公开(公告)号:US20220027405A1
公开(公告)日:2022-01-27
申请号:US17397354
申请日:2021-08-09
Applicant: Snap Inc.
Inventor: Jianchao Yang , Yuke Zhu , Ning Xu , Kevin Dechau Tang , Jia Li
Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a content message from a first content source, and analyzes the content message to determine one or more quality scores and one or more content values associated with the content message. The server computer system analyzes the content message with a plurality of content collections of the database to identify a match between at least one of the one or more content values and a topic associated with at least a first content collection of the one or more content collections and automatically adds the content message to the first content collection based at least in part on the match. In various embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.
-
公开(公告)号:US10748347B1
公开(公告)日:2020-08-18
申请号:US16045431
申请日:2018-07-25
Applicant: Snap Inc.
Inventor: Jia Li , Linjie Luo , Rahul Bhupendra Sheth , Ning Xu , Jianchao Yang
Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.
-
公开(公告)号:US10733255B1
公开(公告)日:2020-08-04
申请号:US15251976
申请日:2016-08-30
Applicant: Snap, Inc.
Inventor: Jianchao Yang , Yuke Zhu , Ning Xu , Kevin Dechau Tang , Jia Li
IPC: G06F17/00 , G06F16/954 , G06N3/08 , G06N3/04 , G06F16/51 , G06F16/951 , G06F16/2457 , H04L29/06 , H04L12/58
Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system communicates at least a portion of a first content collection to a first client device, and receives a first selection communication in response, the first selection communication identifying a first piece of content of the first plurality of pieces of content. The server analyzes analyzing the first piece of content to identify a set of context values for the first piece of content, and accesses accessing a second content collection comprising pieces of content sharing at least a portion of the set of context values of the first piece of content. In various embodiments, different content values, image processing operations, and content selection operations are used to curate the content collections.
-
公开(公告)号:US10467274B1
公开(公告)日:2019-11-05
申请号:US15808617
申请日:2017-11-09
Applicant: Snap Inc.
Inventor: Zhou Ren , Xiaoyu Wang , Ning Zhang , Xutao Lv , Jia Li
Abstract: An image captioning system and method is provided for generating a caption for an image. The image captioning system utilizes a policy network and a value network to generate the caption. The policy network serves as a local guidance and the value network serves as a global and lookahead guidance.
-
公开(公告)号:US20190295326A1
公开(公告)日:2019-09-26
申请号:US16438226
申请日:2019-06-11
Applicant: Snap Inc
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M. Rodriguez, II , Rahul Sheth , Jia Li , Xutao Lv
IPC: G06T19/00 , G06T7/20 , G06T7/73 , G06F3/0481 , G06F3/01 , G06K9/00 , G06K9/78 , G06T13/80 , G06T19/20 , G06T7/246
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.
-
公开(公告)号:US10387514B1
公开(公告)日:2019-08-20
申请号:US15251983
申请日:2016-08-30
Applicant: Snap Inc.
Inventor: Jianchao Yang , Yuke Zhu , Ning Xu , Kevin Dechau Tang , Jia Li
IPC: G06N20/00 , H04L12/58 , H04L29/06 , H04L29/08 , G06F16/954 , G06F16/9535
Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a plurality of content communications from a plurality of client devices, each content communication comprising an associated piece of content and a corresponding metadata. Each content communication is processed to determine associated context values for each piece of content, each associated context value comprising at least one content value generated by machine vision processing of the associated piece of content. A first content collection is automatically generated based on context values, and a set of user accounts are associated with the collection. An identifier associated with the first content collection is published to user devices associated with user accounts. In various additional embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.
-
公开(公告)号:US10102680B2
公开(公告)日:2018-10-16
申请号:US15830965
申请日:2017-12-04
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M Rodriguez, II , Rahul Bhupendra Sheth , Jia Li , Xutao Lv
IPC: G06T19/00 , G06T7/20 , G06T13/80 , G06F3/0481 , G06T19/20 , G06T7/73 , G06F3/01 , G06K9/00 , G06K9/78 , G06T7/246
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.
-
公开(公告)号:US09984499B1
公开(公告)日:2018-05-29
申请号:US14953913
申请日:2015-11-30
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M Rodriguez, II , Rahul Sheth , Jia Li , Xutao Lv
CPC classification number: G06T17/00 , G06T19/006 , G06T2210/56
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A 3D point cloud data describing an environment is then accessed. A first image of an environment is captured, and a portion of the image is matched to a portion of key points in the 3D point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the 3D point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.
-
-
-
-
-
-
-
-
-