Systems and methods for simulatenous localization and mapping

    公开(公告)号:US10984547B2

    公开(公告)日:2021-04-20

    申请号:US16532131

    申请日:2019-08-05

    Applicant: Snap Inc.

    Abstract: Various embodiments provide systems, methods, devices, and instructions for performing simultaneous localization and mapping (SLAM) that involve initializing a SLAM process using images from as few as two different poses of a camera within a physical environment. Some embodiments may achieve this by disregarding errors in matching corresponding features depicted in image frames captured by an image sensor of a mobile computing device, and by updating the SLAM process in a way that causes the minimization process to converge to global minima rather than fall into a local minimum.

    Dynamic adjustment of exposure and iso to limit motion blur

    公开(公告)号:US11765457B2

    公开(公告)日:2023-09-19

    申请号:US17522642

    申请日:2021-11-09

    Applicant: Snap Inc.

    CPC classification number: H04N23/6811 H04N23/684 H04N23/6812 G06T19/006

    Abstract: A method for limiting motion blur in a visual tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor for the first image, determining a motion of the optical sensor for the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and adjusting the camera operating parameters of the optical sensor based on the motion blur level.

    DYNAMIC ADJUSTMENT OF EXPOSURE AND ISO TO LIMIT MOTION BLUR

    公开(公告)号:US20220377239A1

    公开(公告)日:2022-11-24

    申请号:US17522642

    申请日:2021-11-09

    Applicant: Snap Inc.

    Abstract: A method for limiting motion blur in a visual tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor for the first image, determining a motion of the optical sensor for the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and adjusting the camera operating parameters of the optical sensor based on the motion blur level.

    METHOD OF PLANE TRACKING
    6.
    发明申请

    公开(公告)号:US20200294186A1

    公开(公告)日:2020-09-17

    申请号:US16881924

    申请日:2020-05-22

    Applicant: Snap Inc.

    Inventor: Ozi Egri Eyal Zak

    Abstract: A method of plane tracking comprising: capturing by a camera a reference frame of a given plane from a first angle; capturing by the camera a destination frame of the given plane from a second angle different than the first angle; defining coordinates of matching points in the reference frame and the destination frame; calculating, using the first and second angles, first and second respective rotation transformations to a simulated plane parallel to the given plane; applying an affine transformation between the reference frame coordinate on the simulated plane and the destination frame coordinate on the simulated plane; and applying a projective transformation on the simulated plane destination frame coordinate to calculate the destination frame coordinate.

    Distance estimation using multi-camera device

    公开(公告)号:US10691967B2

    公开(公告)日:2020-06-23

    申请号:US16591292

    申请日:2019-10-02

    Applicant: Snap Inc.

    Inventor: Eyal Zak Ozi Egri

    Abstract: A method and apparatus for measuring a distance to an object, be a device (100) having at least two cameras (104, 106), is described. One or more first images including the object are acquired by a first camera of the device and one or more first reference images are acquired by a second camera of the device, while the device is in a first position. One or more second images including the object and one or more second reference images are acquired by cameras of the device, while the device is in a second position, different from the first position. Based on the first and second reference images, information on the displacement of at least one camera of the device between the first and second position are determined. The distance from the device to the object is calculated based on the first and second images including the object and the determined information on the displacement of the at least one camera.

    Method of plane tracking
    10.
    发明授权

    公开(公告)号:US11954817B2

    公开(公告)日:2024-04-09

    申请号:US18318472

    申请日:2023-05-16

    Applicant: Snap Inc.

    Inventor: Ozi Egri Eyal Zak

    CPC classification number: G06T3/0006 G06T7/246 G06T7/33 G06T7/74

    Abstract: A method of plane tracking comprising: capturing by a camera a reference frame of a given plane from a first angle; capturing by the camera a destination frame of the given plane from a second angle different than the first angle; defining coordinates of matching points in the reference frame and the destination frame; calculating, using the first and second angles, first and second respective rotation transformations to a simulated plane parallel to the given plane; applying an affine transformation between the reference frame coordinate on the simulated plane and the destination frame coordinate on the simulated plane; and applying a projective transformation on the simulated plane destination frame coordinate to calculate the destination frame coordinate.

Patent Agency Ranking