公开(公告)号：US11380051B2

公开(公告)日：2022-07-05

申请号：US17248833

申请日：2021-02-10

Applicant: Snap Inc.

Inventor： Nathan Jurgenson ,  Linjie Luo ,  Jonathan M Rodriguez, II ,  Rahul Sheth ,  Jia Li ,  Xutao Lv

IPC: G06T17/00 ,  G06T19/00

Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. Point cloud data describing an environment is then accessed. A two-dimensional surface of an image of an environment is captured, and a portion of the image is matched to a portion of key points in the point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.

公开(公告)号：US11315331B2

公开(公告)日：2022-04-26

申请号：US16913503

申请日：2020-06-26

Applicant: Snap Inc.

Inventor： Nathan Jurgenson ,  Linjie Luo ,  Jonathan M Rodriguez, II ,  Rahul Sheth ,  Jia Li ,  Xutao Lv

IPC: G06T19/00 ,  G06T7/73 ,  G06F3/01 ,  G06F3/04815 ,  G06K9/00 ,  G06K9/78 ,  G06T7/20 ,  G06T13/80 ,  G06T19/20 ,  G06T7/246

Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.

公开(公告)号：US10949648B1

公开(公告)日：2021-03-16

申请号：US16170997

申请日：2018-10-25

Applicant: Snap Inc.

Inventor： Chen Cao ,  Menglei Chai ,  Linjie Luo ,  Oliver Woodford

IPC: G06K9/00 ,  G06T13/40 ,  G06T7/73

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for accessing a set of images depicting at least a portion of a face. A set of facial regions of the face is identified, each facial region of the set of facial regions intersecting another facial region with at least one common vertex which is a member of a set of facial vertices. For each facial region of the set of facial regions, a weight formed from a set of region coefficients is generated. Based on the set of facial regions and the weight of each facial region of the set of facial regions, the face is tracked across the set of images.

公开(公告)号：US10748347B1

公开(公告)日：2020-08-18

申请号：US16045431

申请日：2018-07-25

Applicant: Snap Inc.

Inventor： Jia Li ,  Linjie Luo ,  Rahul Bhupendra Sheth ,  Ning Xu ,  Jianchao Yang

IPC: G06T19/20 ,  G06T7/246 ,  G06T19/00 ,  H04L12/58

Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.

公开(公告)号：US20190295326A1

公开(公告)日：2019-09-26

申请号：US16438226

申请日：2019-06-11

Applicant: Snap Inc

Inventor： Nathan Jurgenson ,  Linjie Luo ,  Jonathan M. Rodriguez, II ,  Rahul Sheth ,  Jia Li ,  Xutao Lv

IPC: G06T19/00 ,  G06T7/20 ,  G06T7/73 ,  G06F3/0481 ,  G06F3/01 ,  G06K9/00 ,  G06K9/78 ,  G06T13/80 ,  G06T19/20 ,  G06T7/246

Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.

公开(公告)号：US10102680B2

公开(公告)日：2018-10-16

申请号：US15830965

申请日：2017-12-04

Applicant: Snap Inc.

Inventor： Nathan Jurgenson ,  Linjie Luo ,  Jonathan M Rodriguez, II ,  Rahul Bhupendra Sheth ,  Jia Li ,  Xutao Lv

IPC: G06T19/00 ,  G06T7/20 ,  G06T13/80 ,  G06F3/0481 ,  G06T19/20 ,  G06T7/73 ,  G06F3/01 ,  G06K9/00 ,  G06K9/78 ,  G06T7/246

Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.

公开(公告)号：US09984499B1

公开(公告)日：2018-05-29

申请号：US14953913

申请日：2015-11-30

Applicant: Snap Inc.

Inventor： Nathan Jurgenson ,  Linjie Luo ,  Jonathan M Rodriguez, II ,  Rahul Sheth ,  Jia Li ,  Xutao Lv

IPC: G09G5/00 ,  G06T17/00 ,  G06T19/00

CPC classification number: G06T17/00 ,  G06T19/006 ,  G06T2210/56

Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A 3D point cloud data describing an environment is then accessed. A first image of an environment is captured, and a portion of the image is matched to a portion of key points in the 3D point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the 3D point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.