POLARIZED SEMI-GLOBAL MATCHING
    1.
    发明公开

    公开(公告)号:US20240221344A1

    公开(公告)日:2024-07-04

    申请号:US18395090

    申请日:2023-12-22

    摘要: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for detection of pixel correspondences in stereo imaging through the use of polarization data. One of the methods include: obtaining a first image from a first viewpoint of a stereo pair and a second image from a second viewpoint of the stereo pair; obtaining an angle of linear polarization (AOLP) map and a degree of linear polarization (DOLP) map having a field of view overlapping the first image and the second image; computing a surface normal map based on the AOLP map and the DOLP map; and detecting corresponding pixels between the first image and the second image by computing a disparity map that minimizes an energy function comprising a pixel matching cost term and a polarized smoothness regularization term computed based on pixels in a local neighborhood and based on the surface normal map.

    IN-HAND POSE REFINEMENT FOR PICK AND PLACE AUTOMATION

    公开(公告)号:US20230071384A1

    公开(公告)日:2023-03-09

    申请号:US17471063

    申请日:2021-09-09

    IPC分类号: B25J19/02 B25J13/08 G06T7/00

    摘要: A method of tracking a pose of an object includes determining an initial pose of the object at a first position, receiving position data and velocity data corresponding to movement of the object to a second position by a moving device, determining an expected pose of the object at the second position based on the position and velocity data and the initial pose, receiving second image data corresponding to the object at the second position from a camera, and determining a refined pose of the object at the second position based on the second image data and the expected pose.

    Systems and methods for characterizing object pose detection and measurement systems

    公开(公告)号:US11580667B2

    公开(公告)日:2023-02-14

    申请号:US17529042

    申请日:2021-11-17

    摘要: A method for characterizing a pose estimation system includes: receiving, from a pose estimation system, first poses of an arrangement of objects in a first scene; receiving, from the pose estimation system, second poses of the arrangement of objects in a second scene, the second scene being a rigid transformation of the arrangement of objects of the first scene with respect to the pose estimation system; computing a coarse scene transformation between the first scene and the second scene; matching corresponding poses between the first poses and the second poses; computing a refined scene transformation between the first scene and the second scene based on coarse scene transformation, the first poses, and the second poses; transforming the first poses based on the refined scene transformation to compute transformed first poses; and computing an average rotation error and an average translation error of the pose estimation system based on differences between the transformed first poses and the second poses.

    Systems and methods for synthesizing data for training statistical models on different imaging modalities including polarized images

    公开(公告)号:US11797863B2

    公开(公告)日:2023-10-24

    申请号:US17294976

    申请日:2021-01-04

    摘要: A method of generating synthetic images of virtual scenes includes: placing, by a synthetic data generator implemented by a processor and memory, three-dimensional (3-D) models of objects in a 3-D virtual scene; adding, by the synthetic data generator, lighting to the 3-D virtual scene, the lighting including one or more illumination sources; applying, by the synthetic data generator, imaging modality-specific materials to the 3-D models of objects in the 3-D virtual scene in accordance with a selected multimodal imaging modality, each of the imaging modality-specific materials including an empirical model; setting a scene background in accordance with the selected multimodal imaging modality; and rendering, by the synthetic data generator, a two-dimensional image of the 3-D virtual scene based on the selected multimodal imaging modality to generate a synthetic image in accordance with the selected multimodal imaging modality.

    Systems and methods for camera exposure control

    公开(公告)号:US11683594B2

    公开(公告)日:2023-06-20

    申请号:US17672357

    申请日:2022-02-15

    IPC分类号: H04N23/75 H04N23/743

    CPC分类号: H04N23/75 H04N23/743

    摘要: Systems and methods for adjusting an exposure parameter of an imaging device are disclosed. A first exposure level of the imaging device is identified, and a first image of a scene is captured via the imaging device at the first exposure level. The first image of the scene comprises a plurality of polarization images corresponding to different degrees and angles of polarization. Each of the polarization images comprise a plurality of color channels. A gradient for the first image is computed based on the plurality of the polarization images, and a second exposure level is computed based on the gradient. A second image of the scene is captured based on the second exposure level, where the gradient of the second image is greater than a gradient for the first image.