-
公开(公告)号:US12141922B2
公开(公告)日:2024-11-12
申请号:US18216327
申请日:2023-06-29
Applicant: Snap Inc.
Inventor: Chen Cao , Menglei Chai , Linjie Luo , Soumyadip Sengupta
Abstract: A shape generation system can generate a three-dimensional (3D) model of an object from a two-dimensional (2D) image of the object by projecting vectors onto light cones created from the 2D image. The projected vectors can be used to more accurately create the 3D model of the object based on image element (e.g., pixel) values of the image.
-
公开(公告)号:US11861854B2
公开(公告)日:2024-01-02
申请号:US17825994
申请日:2022-05-26
Applicant: Snap Inc.
Inventor: Shenlong Wang , Linjie Luo , Ning Zhang , Jia Li
CPC classification number: G06T7/248 , G06T7/33 , G06V10/454 , G06V10/764 , G06V10/82 , G06T7/40 , G06T2207/20084
Abstract: Dense feature scale detection can be implemented using multiple convolutional neural networks trained on scale data to more accurately and efficiently match pixels between images. An input image can be used to generate multiple scaled images. The multiple scaled images are input into a feature net, which outputs feature data for the multiple scaled images. An attention net is used to generate an attention map from the input image. The attention map assigns emphasis as a soft distribution to different scales based on texture analysis. The feature data and the attention data can be combined through a multiplication process and then summed to generate dense features for comparison.
-
公开(公告)号:US20230419512A1
公开(公告)日:2023-12-28
申请号:US18367034
申请日:2023-09-12
Applicant: Snap Inc.
Inventor: Shenlong Wang , Linjie Luo , Ning Zhang , Jia Li
IPC: G06T7/246 , G06T7/33 , G06V10/764 , G06V10/82 , G06V10/44
CPC classification number: G06T7/248 , G06T7/33 , G06V10/764 , G06V10/82 , G06V10/454 , G06T2207/20084 , G06T7/40
Abstract: Dense feature scale detection can be implemented using multiple convolutional neural networks trained on scale data to more accurately and efficiently match pixels between images. An input image can be used to generate multiple scaled images. The multiple scaled images are input into a feature net, which outputs feature data for the multiple scaled images. An attention net is used to generate an attention map from the input image. The attention map assigns emphasis as a soft distribution to different scales based on texture analysis. The feature data and the attention data can be combined through a multiplication process and then summed to generate dense features for comparison.
-
公开(公告)号:US11727660B2
公开(公告)日:2023-08-15
申请号:US17722955
申请日:2022-04-18
Applicant: Snap Inc.
Inventor: Jia Li , Linjie Luo , Rahul Bhupendra Sheth , Ning Xu , Jianchao Yang
CPC classification number: G06T19/20 , G06T7/248 , G06T19/006 , H04L51/52 , G06T2207/20104
Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.
-
公开(公告)号:US20220368824A1
公开(公告)日:2022-11-17
申请号:US17816223
申请日:2022-07-29
Applicant: Snap Inc.
Inventor: Linjie Luo , Chongyang Ma , Zehao Xue
Abstract: A dolly zoom effect can be applied to one or more images captured via a resource-constrained device (e.g., a mobile smartphone) by manipulating the size of a target feature while the background in the one or more images changes due to physical movement of the resource-constrained device. The target feature can be detected using facial recognition or shape detection techniques. The target feature can be resized before the size is manipulated as the background changes (e.g., changes perspective).
-
公开(公告)号:US20220358738A1
公开(公告)日:2022-11-10
申请号:US17722955
申请日:2022-04-18
Applicant: Snap Inc.
Inventor: Jia Li , Linjie Luo , Rahul Bhupendra Sheth , Ning Xu , Jianchao Yang
Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.
-
公开(公告)号:US11418704B2
公开(公告)日:2022-08-16
申请号:US16933314
申请日:2020-07-20
Applicant: Snap Inc.
Inventor: Linjie Luo , Chongyang Ma , Zehao Xue
Abstract: A dolly zoom effect can be applied to one or more images captured via a resource-constrained device (e.g., a mobile smartphone) by manipulating the size of a target feature while the background in the one or more images changes due to physical movement of the resource-constrained device. The target feature can be detected using facial recognition or shape detection techniques. The target feature can be resized before the size is manipulated as the background changes (e.g., changes perspective).
-
公开(公告)号:US11074675B2
公开(公告)日:2021-07-27
申请号:US16051083
申请日:2018-07-31
Applicant: Snap Inc.
Inventor: Chen Cao , Wen Zhang , Menglei Chai , Linjie Luo
Abstract: Systems, devices, media, and methods are presented for generating texture models for objects within a video stream. The systems and methods access a set of images as the set of images are being captured at a computing device. The systems and methods determine, within a portion of the set of images, an area of interest containing an eye and extract an iris area from the area of interest. The systems and methods segment a sclera area within the area of interest and generate a texture for the eye based on the iris area and the sclera area.
-
公开(公告)号:US20210037179A1
公开(公告)日:2021-02-04
申请号:US16933314
申请日:2020-07-20
Applicant: Snap Inc.
Inventor: Linjie Luo , Chongyang Ma , Zehao Xue
Abstract: A dolly zoom effect can be applied to one or more images captured via a resource-constrained device (e.g., a mobile smartphone) by manipulating the size of a target feature while the background in the one or more images changes due to physical movement of the resource-constrained device. The target feature can be detected using facial recognition or shape detection techniques. The target feature can be resized before the size is manipulated as the background changes (e.g., changes perspective).
-
公开(公告)号:US20200219312A1
公开(公告)日:2020-07-09
申请号:US16824297
申请日:2020-03-19
Applicant: Snap Inc.
Inventor: Nathan Jurgenson , Linjie Luo , Jonathan M. Rodriguez, II , Rahul Sheth , Jia Li , Xutao Lv
Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. Point cloud data describing an environment is then accessed. A two-dimensional surface of an image of an environment is captured, and a portion of the image is matched to a portion of key points in the point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.
-
-
-
-
-
-
-
-
-