DEPTH-FROM-STEREO BENDING CORRECTION USING VISUAL INERTIAL ODOMETRY FEATURES

    公开(公告)号:US20240029302A1

    公开(公告)日:2024-01-25

    申请号:US18373554

    申请日:2023-09-27

    Applicant: Snap Inc.

    CPC classification number: G06T7/74 G06T7/593 G06T7/33 G06T19/006 H04N13/239

    Abstract: A method for correcting a bending of a flexible device is described. In one aspect, the method includes accessing feature data of a first stereo frame that is generated by stereo optical sensors of the flexible device, the feature data generated based on a visual-inertial odometry (VIO) system of the flexible device, accessing depth map data of the first stereo frame, the depth map data generated based on a depth map system of the flexible device, estimating a pitch-roll bias and a yaw bias based on the features data and the depth map data of the first stereo frame, and generating a second stereo frame after the first stereo frame, the second stereo frame based on the pitch-roll bias and the yaw bias of the first stereo frame.

    ARTISTIC EFFECTS FOR IMAGES AND VIDEOS
    13.
    发明公开

    公开(公告)号:US20230412779A1

    公开(公告)日:2023-12-21

    申请号:US18229535

    申请日:2023-08-02

    Applicant: Snap Inc.

    Inventor: Sagi Katz

    Abstract: A photo filter (e.g., artistic) light field effect system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the photo filter light field effect system to apply a photo filter selection to: (i) a left raw image or a left processed image to create a left photo filter image, and (ii) a right raw image or a right processed image to create a right photo filter image. The photo filter light field effect system generates, a photo filter light field effect image with an appearance of a spatial rotation or movement, by blending together the left photo filter image and the right photo filter image based on a left image disparity map and a right image disparity map.

    Multi-dimensional rendering
    15.
    发明授权

    公开(公告)号:US11589024B2

    公开(公告)日:2023-02-21

    申请号:US17346354

    申请日:2021-06-14

    Applicant: Snap Inc.

    Inventor: Sagi Katz

    Abstract: A photo filter (e.g., multi-dimensional) light field effect system includes an eyewear device having a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the system to create an image in each of a least two dimensions and create a multi-dimensional light field effect image with an appearance of a spatial rotation or movement and transitional change, by blending together a left photo filter image and a right photo filter image in each dimension and blending the blended images from all dimensions.

    BENDING ESTIMATION AS A BIOMETRIC SIGNAL

    公开(公告)号:US20220374505A1

    公开(公告)日:2022-11-24

    申请号:US17489394

    申请日:2021-09-29

    Applicant: Snap Inc.

    Inventor: Sagi Katz

    Abstract: A method for generating reference biometric data based on a bending of a flexible device is described. In one aspect, a method includes forming training data includes bending estimates of a flexible device worn by a first user, training a model based on the training data, and generating reference biometric data for the first user based on the model.

    Creating shockwaves in three-dimensional depth videos and images

    公开(公告)号:US10776899B2

    公开(公告)日:2020-09-15

    申请号:US16558777

    申请日:2019-09-03

    Applicant: Snap Inc.

    Inventor: Sagi Katz Eyal Zak

    Abstract: A virtual shockwave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual shockwave creation system to generate, for each of multiple initial depth images, a respective shockwave image by applying a transformation function to the initial three-dimensional coordinates. The virtual shockwave creation system creates a warped shockwave video including a sequence of the generated warped shockwave images. The virtual shockwave creation system presents, via an image display, the warped shockwave video.

    Depth sculpturing of three-dimensional depth images utilizing two-dimensional input selection

    公开(公告)号:US10764556B2

    公开(公告)日:2020-09-01

    申请号:US16561127

    申请日:2019-09-05

    Applicant: Snap Inc.

    Inventor: Sagi Katz

    Abstract: A depth sculpturing system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. The depth sculpturing system further includes a user input device. Execution of programming by a processor configures the depth sculpturing system to perform functions to track, via the user input device, motion of a two-dimensional input selection from an initial touch point to a final touch point. The depth sculpturing system determines a rotation matrix between an initial ray and a final ray that project to the initial touch point and the final touch point, correspondingly. The depth sculpturing system generates a depth sculptured image by applying the rotation matrix to vertices of an initial depth image. The depth sculpturing system presents, via an image display, the depth sculptured image.

    Depth-from-stereo bending correction using visual inertial odometry features

    公开(公告)号:US12260588B2

    公开(公告)日:2025-03-25

    申请号:US18373554

    申请日:2023-09-27

    Applicant: Snap Inc.

    Abstract: A method for correcting a bending of a flexible device is described. In one aspect, the method includes accessing feature data of a first stereo frame that is generated by stereo optical sensors of the flexible device, the feature data generated based on a visual-inertial odometry (VIO) system of the flexible device, accessing depth map data of the first stereo frame, the depth map data generated based on a depth map system of the flexible device, estimating a pitch-roll bias and a yaw bias based on the features data and the depth map data of the first stereo frame, and generating a second stereo frame after the first stereo frame, the second stereo frame based on the pitch-roll bias and the yaw bias of the first stereo frame.

    Augmented reality guided depth estimation

    公开(公告)号:US12229977B2

    公开(公告)日:2025-02-18

    申请号:US17529527

    申请日:2021-11-18

    Applicant: Snap Inc.

    Abstract: A method for AR-guided depth estimation is described. The method includes identifying a virtual object rendered in a first frame that is generated based on a first pose of an augmented reality (AR) device, determining a second pose of the AR device, the second pose following the first pose, identifying an augmentation area in the second frame based on the virtual object rendered in the first frame, and the second pose, determining depth information for the augmentation area in the second frame, and rendering the virtual object in the second frame based on the depth information.

Patent Agency Ranking