MONOCULAR IMAGE DEPTH ESTIMATION WITH ATTENTION

    公开(公告)号:US20240303841A1

    公开(公告)日:2024-09-12

    申请号:US18538869

    申请日:2023-12-13

    CPC classification number: G06T7/50 G06T7/246 G06T11/60 G06V10/44 G06V10/62

    Abstract: Disclosed are systems and techniques for capturing images (e.g., using a monocular image sensor) and detecting depth information. According to some aspects, a computing system or device can generate a feature representation of a current image and update accumulated feature information for storage in a memory based on a feature representation of a previous image and optical flow information of the previous image. The accumulated feature information can include accumulated image feature information associated with a plurality of previous images and accumulated optical flow information associated of the plurality of previous images. The computing system or device can obtain information associated with relative motion of the current image based on the accumulated feature information and the feature representation of the current image. The computing system or device can estimate depth information for the current image based on the information associated with the relative motion and the accumulated feature information.

    UNIFIED SIMULTANEOUS OPTICAL FLOW AND DEPTH ESTIMATION

    公开(公告)号:US20250095182A1

    公开(公告)日:2025-03-20

    申请号:US18468656

    申请日:2023-09-15

    Abstract: Techniques and systems are provided for image processing. For instance, a process can include correlating a first set of features from a first viewpoint with a second set of features from a second viewpoint at a first time period to generate a first disparity cost volume; correlating a third set of features from the first viewpoint at a second time period with the first set of features to generate a first optical flow cost volume; gating the first disparity cost volume to generate first intermediate disparity information; gating the first optical flow cost volume to generate first intermediate optical flow information; correlating the first set of features, the second set of features, and the first intermediate optical flow information to generate disparity information for output; and correlating the third set of features, the first set of features, and the first intermediate disparity information to generate optical flow information for output.

Patent Agency Ranking