Disparity image stitching and visualization method based on multiple pairs of binocular cameras

    公开(公告)号:US11350073B2

    公开(公告)日:2022-05-31

    申请号:US17283119

    申请日:2020-03-05

    摘要: The present invention discloses a disparity image stitching and visualization method based on multiple pairs of binocular cameras. A calibration algorithm is used to solve the positional relationship between binocular cameras, and the prior information is used to solve a homography matrix between images; internal parameters and external parameters of the cameras are used to perform camera coordinate system transformation of depth images; the graph cut algorithm has high time complexity and depends on the number of nodes in a graph; the present invention divides the images into layers, and solutions are obtained layer by layer and iterated; then the homography matrix is used to perform image coordinate system transformation of the depth images, and a stitching seam is synthesized to realize seamless panoramic depth image stitching; and finally, depth information of a disparity image is superimposed on a visible light image.

    Bi-level optimization-based infrared and visible light fusion method

    公开(公告)号:US11830222B2

    公开(公告)日:2023-11-28

    申请号:US17282662

    申请日:2020-03-05

    摘要: The present invention proposes a bi-level optimization-based infrared and visible light fusion method, adopts a pair of infrared camera and visible light camera to acquire images, and relates to the construction of a bi-level paradigm infrared and visible light image fusion algorithm, which is an infrared and visible light fusion algorithm using mathematical modeling. Binocular cameras and NVIDIA TX2 are used to construct a high-performance computing platform and to construct a high-performance solving algorithm to obtain a high-quality infrared and visible light fusion image. The system is easy to construct, and the input data can be acquired by using stereo binocular infrared and visible light cameras respectively; the program is simple and easy to implement; and the fusion image is divided into an image domain and a gradient domain for fusion by means of mathematical modeling according to different imaging principles of infrared and visible light cameras.

    Method for constructing grid map by using binocular stereo camera

    公开(公告)号:US11315318B2

    公开(公告)日:2022-04-26

    申请号:US17278583

    申请日:2020-03-05

    IPC分类号: G06T17/05 H04N13/239

    摘要: The present invention discloses a method for constructing a grid map by using a binocular stereo camera. A high-performance computing platform is constructed by using a binocular camera and a GPU, and a high-performance solving algorithm is constructed to obtain a high-quality grid map containing three-dimensional information. The system in the present invention is easy to construct, so the input data may be collected by using the binocular stereo camera; the program is simple and easy to implement. According to the present invention, the grid height is calculated by using spatial prior information and statistical knowledge, so that a three-dimensional result is more robust; and according to the present invention, the adaptive threshold of grids is solved by using spatial geometry, filtering and screening of the grids are completed, and thus the generalization ability and robustness of the algorithm are improved.

    Method for estimating high-quality depth maps based on depth prediction and enhancement subnetworks

    公开(公告)号:US11238602B2

    公开(公告)日:2022-02-01

    申请号:US16649322

    申请日:2019-01-07

    IPC分类号: G06K9/00 G06T7/55

    摘要: The present invention provides a method for estimating high-quality depth map based on depth prediction and enhancement sub-networks, belonging to the technical field of image processing and computer vision. This method constructs depth prediction subnetwork to predict depth information from color image and uses depth enhancement subnetwork to obtain high-quality depth map by recovering the low-resolution depth map. It is easy to construct the system, and can obtain the high-quality depth map from the corresponding color image directly by the well-trained end to end network. The algorithm is easy to be implemented. It uses high-frequency component of color image to help to recover the lost depth boundaries information caused by down-sampling operators in depth prediction sub-network, and finally obtains high-quality and high-resolution depth maps. It uses spatial pyramid pooling structure to increase the accuracy of depth map prediction for multi-scale objects in the scene.

    Method for fully automatically detecting chessboard corner points

    公开(公告)号:US12094152B2

    公开(公告)日:2024-09-17

    申请号:US17442937

    申请日:2020-03-05

    IPC分类号: G06T7/70 G06T7/90

    CPC分类号: G06T7/70 G06T7/90

    摘要: The present invention discloses a method for fully automatically detecting chessboard corner points, and belongs to the field of image processing and computer vision. Full automatic detection of chessboard corner points is completed by setting one or a plurality of marks with colors or certain shapes on a chessboard to mark an initial position, shooting an image and conducting corresponding processing, using a homography matrix H calculated by initial pixel coordinates of a unit grid in a pixel coordinate system and manually set world coordinates in a world coordinate system to expand outwards, and finally spreading to the whole chessboard region. The method has the advantages of simple procedure and easy implementation; the principle of expanding outwards by a homography matrix is used, so that the running speed of the algorithm is fast; and the corner points obtained by a robustness enhancement algorithm is more accurate, so that the situation of inaccurate corner point detection in the condition of complex illumination is avoided.