-
公开(公告)号:US20210165998A1
公开(公告)日:2021-06-03
申请号:US17248908
申请日:2021-02-12
Applicant: Snap Inc.
Inventor: Chen Cao , Menglei Chai , Linjie Luo , Oliver Woodford
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for accessing a set of images depicting at least a portion of a face. A set of facial regions of the face is identified, each facial region of the set of facial regions intersecting another facial region with at least one common vertex that is a member of a set of facial vertices. For each facial region of the set of facial regions, a weight formed from a set of region coefficients is generated. Based on the set of facial regions and the weight of each facial region of the set of facial regions, the face is tracked across the set of images.
-
公开(公告)号:US10997783B2
公开(公告)日:2021-05-04
申请号:US16824297
申请日:2020-03-19
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M Rodriguez, II , Rahul Sheth , Jia Li , Xutao Lv
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. Point cloud data describing an environment is then accessed. A two-dimensional surface of an image of an environment is captured, and a portion of the image is matched to a portion of key points in the point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.
-
公开(公告)号:US10861170B1
公开(公告)日:2020-12-08
申请号:US16206684
申请日:2018-11-30
Applicant: Snap Inc.
Inventor: Yuncheng Li , Linjie Luo , Xuecheng Nie , Ning Zhang
Abstract: Systems, devices, media and methods are presented for a human pose tracking framework. The human pose tracking framework may identify a message with video frames, generate, using a composite convolutional neural network, joint data representing joint locations of a human depicted in the video frames, the generating of the joint data by the composite convolutional neural network done by a deep convolutional neural network operating on one portion of the video frames, a shallow convolutional neural network operating on a another portion of the video frames, and tracking the joint locations using a one-shot learner neural network that is trained to track the joint locations based on a concatenation of feature maps and a convolutional pose machine. The human pose tracking framework may store, the joint locations, and cause presentation of a rendition of the joint locations on a user interface of a client device.
-
公开(公告)号:US20200327738A1
公开(公告)日:2020-10-15
申请号:US16913503
申请日:2020-06-26
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M. Rodriguez, II , Rahul Sheth , Jia Li , Xutao Lv
IPC: G06T19/00 , G06T7/73 , G06F3/01 , G06F3/0481 , G06K9/00 , G06K9/78 , G06T7/20 , G06T13/80 , G06T19/20 , G06T7/246
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.
-
公开(公告)号:US10366543B1
公开(公告)日:2019-07-30
申请号:US16136849
申请日:2018-09-20
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M Rodriguez, II , Rahul Sheth , Jia Li , Xutao Lv
IPC: G06T19/00 , G06K9/00 , G06T7/73 , G06F3/0481 , G06F3/01 , G06T7/246 , G06T19/20 , G06T13/80 , G06K9/78 , G06T7/20
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.
-
公开(公告)号:US09836890B2
公开(公告)日:2017-12-05
申请号:US15591887
申请日:2017-05-10
Applicant: SNAP INC.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M Rodriguez, II , Rahul Sheth , Jia Li , Xutao Lv
IPC: G06T19/00 , G06T7/73 , G06F3/01 , G06K9/00 , G06K9/78 , G06T7/246 , G06T19/20 , G06T13/80 , G06T7/20 , G06F3/0481
CPC classification number: G06T19/006 , G06F3/012 , G06F3/04815 , G06K9/00624 , G06K9/00664 , G06K9/00671 , G06K9/78 , G06K2209/21 , G06T7/20 , G06T7/246 , G06T7/73 , G06T13/80 , G06T19/20 , G06T2200/04 , G06T2207/30244 , G06T2219/2004
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.
-
公开(公告)号:US20250168488A1
公开(公告)日:2025-05-22
申请号:US19029202
申请日:2025-01-17
Applicant: Snap Inc.
Inventor: Linjie Luo , Chongyang Ma , Zehao Xue
Abstract: A dolly zoom effect can be applied to one or more images captured via a resource-constrained device (e.g., a mobile smartphone) by manipulating the size of a target feature while the background in the one or more images changes due to physical movement of the resource-constrained device. The target feature can be detected using facial recognition or shape detection techniques. The target feature can be resized before the size is manipulated as the background changes (e.g., changes perspective).
-
公开(公告)号:US12079931B2
公开(公告)日:2024-09-03
申请号:US17856720
申请日:2022-07-01
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M Rodriguez, II , Rahul Bhupendra Sheth , Jia Li , Xutao Lv
CPC classification number: G06T17/00 , G06T19/006 , G06T2210/56
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. Point cloud data describing an environment is then accessed. A two-dimensional surface of an image of an environment is captured, and a portion of the image is matched to a portion of key points in the point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.
-
公开(公告)号:US20230394681A1
公开(公告)日:2023-12-07
申请号:US18235563
申请日:2023-08-18
Applicant: Snap Inc.
Inventor: Chen Cao , Menglei Chai , Linjie Luo , Oliver Woodford
IPC: G06T7/246 , G06T13/40 , G06T7/73 , G06V40/16 , G06V10/774
CPC classification number: G06T7/251 , G06T13/40 , G06T7/73 , G06V40/161 , G06V10/774 , G06V40/165 , G06V40/176 , G06V10/62
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for accessing a set of images depicting at least a portion of a face. A set of facial regions of the face is identified, each facial region of the set of facial regions intersecting another facial region with at least one common vertex that is a member of a set of facial vertices. For each facial region of the set of facial regions, a weight formed from a set of region coefficients is generated. Based on the set of facial regions and the weight of each facial region of the set of facial regions, the face is tracked across the set of images.
-
公开(公告)号:US11769259B2
公开(公告)日:2023-09-26
申请号:US17248908
申请日:2021-02-12
Applicant: Snap Inc.
Inventor: Chen Cao , Menglei Chai , Linjie Luo , Oliver Woodford
CPC classification number: G06T7/251 , G06T7/73 , G06T13/40 , G06V10/774 , G06V40/161 , G06V40/165 , G06V40/176 , G06V10/62
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for accessing a set of images depicting at least a portion of a face. A set of facial regions of the face is identified, each facial region of the set of facial regions intersecting another facial region with at least one common vertex that is a member of a set of facial vertices. For each facial region of the set of facial regions, a weight formed from a set of region coefficients is generated. Based on the set of facial regions and the weight of each facial region of the set of facial regions, the face is tracked across the set of images.
-
-
-
-
-
-
-
-
-