公开(公告)号：US10147167B2

公开(公告)日：2018-12-04

申请号：US15350214

申请日：2016-11-14

Applicant: Heptagon Micro Optics Pte. Ltd.

Inventor： Florin Cutu ,  James Eilertsen

IPC: G06K9/32 ,  G06T3/40 ,  H04N5/208 ,  H04N9/64 ,  G06T5/50 ,  H04N5/349 ,  H04N9/04

Abstract: Generating a super-resolved reconstructed image includes acquiring a multitude of monochromatic images of a scene and extracting high-frequency band luma components from the acquired images. A high-resolution luma image is generated using the high-frequency components and motion data for the acquired images. The high-resolution luma image is combined with an up-sampled color image, generated from the acquired images, to generate a super-resolved reconstructed color image of the scene.

公开(公告)号：US20180240247A1

公开(公告)日：2018-08-23

申请号：US15752682

申请日：2016-08-19

Applicant: Heptagon Micro Optics Pte. Ltd.

Inventor： Florin Cutu

IPC: G06T7/593 ,  G06T5/00 ,  H04N13/243

CPC classification number: G06T7/593 ,  G06T5/002 ,  G06T2207/10012 ,  H04N13/243 ,  H04N13/254 ,  H04N13/257 ,  H04N2013/0081

Abstract: This disclosure describes systems and techniques for generating a disparity map having reduced over-smoothing. To achieve the reduction in over-smoothing that might otherwise occur, a third image is captured in addition to stereo reference and search images. Information from the third image, which may be of the same or different type as the stereo images (e.g., RGB, grey-scale, infra-red (IR)) and which may have the same or different resolution as the stereo images, can help better define the object edges.

公开(公告)号：US20180252894A1

公开(公告)日：2018-09-06

申请号：US15758455

申请日：2016-09-13

Applicant: Heptagon Micro Optics Pte. Ltd.

Inventor： Christian Tang-Jespersen ,  Michael Kiy ,  Miguel Bruno Vaello Paños ,  Florin Cutu ,  James Patrick Long ,  Hartmut Rudmann

IPC: G02B7/28 ,  H04N5/225 ,  G03B13/36 ,  G01S17/10 ,  H04N5/232

CPC classification number: G02B7/28 ,  G01S17/10 ,  G01S17/102 ,  G01S17/32 ,  G02B7/32 ,  G02B7/40 ,  G03B13/20 ,  G03B13/36 ,  H04N5/2256 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23293

Abstract: The present disclosure describes imaging techniques and devices having improved autofocus capabilities. The imaging techniques can include actively illuminating a scene and determining distances over the entire scene and so that a respective distance to each object or point in the scene can be determined. Thus, distances to all objects in a scene (within a particular range) at any given instant can be stored. A preview of the image can be displayed so as to allow a user to select a region of the scene of interest. In response to the user's selection, the imager's optical assembly can be adjusted automatically, for example, to a position that corresponds to optimal image capture of objects at the particular distance of the selected region of the scene.

公开(公告)号：US20170148139A1

公开(公告)日：2017-05-25

申请号：US15350214

申请日：2016-11-14

Applicant: Heptagon Micro Optics Pte. Ltd.

Inventor： Florin Cutu ,  James Eilertsen

IPC: G06T3/40 ,  G06T5/00 ,  H04N9/78 ,  G06T7/20 ,  G06T11/60 ,  H04N5/232 ,  G06T7/40 ,  G06T5/20

CPC classification number: G06T3/4061 ,  G06T5/50 ,  G06T2207/10024 ,  G06T2207/20221 ,  H04N5/208 ,  H04N5/349 ,  H04N9/045 ,  H04N9/646

Abstract: Generating a super-resolved reconstructed image includes acquiring a multitude of monochromatic images of a scene and extracting high-frequency band luma components from the acquired images. A high-resolution luma image is generated using the high-frequency components and motion data for the acquired images. The high-resolution luma image is combined with an up-sampled color image, generated from the acquired images, to generate a super-resolved reconstructed color image of the scene.

公开(公告)号：US20190012789A1

公开(公告)日：2019-01-10

申请号：US15745146

申请日：2016-07-13

Applicant: Heptagon Micro Optics Pte. Ltd.

Inventor： Florin Cutu

IPC: G06T7/11 ,  G06K9/62 ,  G06K9/46 ,  G06T7/187

Abstract: First and second stereo images are acquired. The first image is partitioned into multiple segments, wherein each segment consists of image elements that share one or more characteristics in common. A segmentation map is generated in which each of the image elements is associated with a corresponding one of the segments to which it belongs. A respective disparity value is determined for each of the segments with respect to a corresponding portion of the second image, and the disparity value determined for each particular segment is assigned to at least one image element that belongs to that segment. A disparity map indicative of the assigned disparity values can then be generated. Generating the disparity map in this manner can, in some instance, help reduce edge and/or feature thickening.

公开(公告)号：US20180213201A1

公开(公告)日：2018-07-26

申请号：US15745150

申请日：2016-07-13

Applicant: Heptagon Micro Optics Pte. Ltd.

Inventor： Chi Zhang ,  Alireza Yasan ,  Xin Liu ,  Florin Cutu ,  Dmitry Ryuma

IPC: H04N13/00 ,  G06T7/00 ,  G06K9/62

CPC classification number: H04N13/128 ,  G06K9/6212 ,  G06T7/97 ,  G06T2207/10012 ,  H04N2013/0081

Abstract: Providing a disparity map includes acquiring first and second stereo images, binarizing the first stereo image to obtain a binarized image, and applying a block matching technique to the first and second stereo images to obtain an initial disparity map in which individual image elements are assigned a respective initial disparity value. For each respective image element, an updated disparity value that represents a product of the initial disparity value assigned to the image element and a value associated with the image element in the binarized image is obtained. An updated disparity map can be generated and represents the updated disparity values of the image elements.

公开(公告)号：US09992472B1

公开(公告)日：2018-06-05

申请号：US15625176

申请日：2017-06-16

Applicant: Heptagon Micro Optics Pte. Ltd.

Inventor： Florin Cutu

IPC: H04N13/00 ,  H04N13/02

CPC classification number: H04N13/106 ,  H04N13/207 ,  H04N13/246 ,  H04N13/254

Abstract: The disclosure describes optoelectronic devices for collecting three-dimensional data without determining disparity. The approach permits significant flexibility relative to state-of-the-art approaches for collecting three-dimensional data. For example, the illuminations (e.g., patterns) generated by the disclosed devices need not exhibit the same degree of complexity or randomness of illuminations generally required by structured-light approaches. Further, the devices described in the present disclosure exhibit, in some instances, optimal resolution over a wide distance range. An optoelectronic device described herein is operable to generate an illumination comprising a plurality of high-intensity features that exhibit a distance-dependent alteration when imaged by an imager incorporated into the optoelectronic device.

公开(公告)号：US20180124327A1

公开(公告)日：2018-05-03

申请号：US15121459

申请日：2015-02-23

Applicant: Heptagon Micro Optics Pte. Ltd.

Inventor： Jukka Alasirnio ,  Tobias Senn ,  Ohad Meitav ,  Moshe Doron ,  Alireza Yasan ,  Mario Cesana ,  Florin Cutu ,  Hartmut Rudmann ,  Markus Rossi ,  Peter Roentgen ,  Daniel Perez Calero ,  Bassam Hallal ,  Jens Geiger

IPC: H04N5/247 ,  H04N5/225 ,  H04N5/33 ,  G02B13/00

Abstract: Image sensor modules include primary high-resolution imagers and secondary imagers. For example, an image sensor module may include a semiconductor chip including photosensitive regions defining, respectively, a primary camera and a secondary camera. The image sensor module may include an optical assembly that does not substantially obstruct the field-of-view of the secondary camera. Some modules include multiple secondary cameras that have a field-of-view at least as large as the field-of-view of the primary camera. Various features are described to facilitate acquisition of signals that can be used to calculate depth information.

公开(公告)号：US20180225866A1

公开(公告)日：2018-08-09

申请号：US15749825

申请日：2016-08-04

Applicant: Heptagon Micro Optics Pte. Ltd.

Inventor： Chi Zhang ,  Xin Liu ,  Florin Cutu

IPC: G06T17/00

Abstract: Presenting a merged, fused three-dimensional point cloud includes acquiring multiple sets of images of a scene from different vantage points, each set of images including respective stereo matched images and a color image. For each respective set of images, a disparity map based on the plurality of stereo images is obtained, data from the color image is fused onto the disparity map so as to generate a fused disparity map, and a three-dimensional fused point cloud is created from the fused disparity map. The respective three-dimensional fused point clouds is merged together so as to obtain a merged, fused three-dimensional point cloud. The techniques can be advantageous even under the constraints of sparseness and low-depth resolution, and are suitable, in some cases, for real-time or near real-time applications in which computing time needs to be reduced.

公开(公告)号：US20180204329A1

公开(公告)日：2018-07-19

申请号：US15743948

申请日：2016-07-08

Applicant: Heptagon Micro Optics Pte. Ltd.

Inventor： Florin Cutu ,  Alireza Yasan ,  Xin Liu

IPC: G06T7/174 ,  G06T7/593 ,  G06T5/00 ,  G06T5/50 ,  G06T7/90 ,  G06T7/557

CPC classification number: G06T7/174 ,  G06T5/001 ,  G06T5/007 ,  G06T5/50 ,  G06T7/557 ,  G06T7/593 ,  G06T7/90 ,  G06T2200/04 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/10048 ,  G06T2207/20216

Abstract: Techniques are described for generating a distance map (e.g., a map of disparity, depth or other distance values) for image elements (e.g., pixels) of an image capture device. The distance map is generated based on an initial distance map (obtained, e.g., using a block or code matching algorithm) and a segmentation map (obtained using a segmentation algorithm). In some instances, the resulting distance map can be less sparse than the initial distance map, can contain more accurate distance values, and can be sufficiently fast for real-time or near real-time applications. The resulting distance map can be converted, for example, to a color-coded distance map of a scene that is presented on a display device.