Multi-camera on a chip and camera module design

    公开(公告)号:US11696003B2

    公开(公告)日:2023-07-04

    申请号:US17527155

    申请日:2021-11-15

    CPC classification number: H04N23/45 H04N23/55 H04N23/80

    Abstract: A camera system includes two or more sensor arrays and an optical path. The sensor arrays are on the same sensor chip. Each sensor array includes the same field of view (FOV) as each other sensor array. The optical path includes a main lens and a metalens that are shared by each sensor array, and a microlens associated with each sensor array. The metalens splits incident light into different spectrums of light and directs each respective spectrum to a corresponding sensor array. The different spectrums of light include at least two of visible light, near infrared light, shortwave infrared and longwave infrared, and at least one sensor array includes single-photon avalanche diodes. The image processor that provides image processing, object recognition and object tracking and/or image fusion functionality may be on the same sensor chip as the sensor arrays.

    CMOS image sensor for 2D imaging and depth measurement with ambient light rejection

    公开(公告)号:US11378390B2

    公开(公告)日:2022-07-05

    申请号:US17076799

    申请日:2020-10-21

    Abstract: Using the same image sensor to capture both a two-dimensional (2D) image of a three-dimensional (3D) object and 3D depth measurements for the object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor generates a multi-bit output in the 2D mode and a binary output in the 3D mode to generate timestamps. Strong ambient light is rejected by switching the image sensor to a 3D logarithmic mode from a 3D linear mode.

    Neural processing accelerator
    44.
    发明授权

    公开(公告)号:US11360930B2

    公开(公告)日:2022-06-14

    申请号:US15916189

    申请日:2018-03-08

    Abstract: A system for calculating. A scratch memory is connected to a plurality of configurable processing elements by a communication fabric including a plurality of configurable nodes. The scratch memory sends out a plurality of streams of data words. Each data word is either a configuration word used to set the configuration of a node or of a processing element, or a data word carrying an operand or a result of a calculation. Each processing element performs operations according to its current configuration and returns the results to the communication fabric, which conveys them back to the scratch memory.

    High contrast structured light patterns for QIS sensors

    公开(公告)号:US11262192B2

    公开(公告)日:2022-03-01

    申请号:US16003014

    申请日:2018-06-07

    Abstract: A structured-light pattern for a structured-light system includes a base light pattern that includes a row of a plurality of sub-patterns extending in a first direction. Each sub-pattern is adjacent to at least one other sub-pattern, and each sub-pattern is different from each other sub-pattern. Each sub-pattern includes a first number of portions in a sub-row and a second number of portions in a sub-column. Each sub-row extends in the first direction and each sub-column extends in a second direction that is substantially orthogonal to the first direction. Each portion may be a first-type portion or a second-type portion. A size of a first-type portion is larger in the first direction and in the second direction than a size of a second-type portion in the first direction and in the second direction. In one embodiment, a first-type portion is a black portion and the second-type portion is a white portion.

    High contrast structured light patterns for QIS sensors

    公开(公告)号:US11187524B2

    公开(公告)日:2021-11-30

    申请号:US16003014

    申请日:2018-06-07

    Abstract: A structured-light pattern for a structured-light system includes a base light pattern that includes a row of a plurality of sub-patterns extending in a first direction. Each sub-pattern is adjacent to at least one other sub-pattern, and each sub-pattern is different from each other sub-pattern. Each sub-pattern includes a first number of portions in a sub-row and a second number of portions in a sub-column. Each sub-row extends in the first direction and each sub-column extends in a second direction that is substantially orthogonal to the first direction. Each portion may be a first-type portion or a second-type portion. A size of a first-type portion is larger in the first direction and in the second direction than a size of a second-type portion in the first direction and in the second direction. In one embodiment, a first-type portion is a black portion and the second-type portion is a white portion.

    OPTICAL DEVICE FOR A THERMAL SENSOR AND A HYBRID THERMAL SENSOR

    公开(公告)号:US20210337140A1

    公开(公告)日:2021-10-28

    申请号:US16906917

    申请日:2020-06-19

    Abstract: An imaging device includes: a sensor to detect a first target spectrum, the first target spectrum corresponding to a thermal imaging region of an infrared (IR) spectrum; and an optical device to transmit external light to the sensor, the optical device including: a substrate; and a plurality of nanostructures on the substrate, and to collimate at least the first target spectrum in the external light on the sensor. The plurality of nanostructures are spaced apart from each other, and at least one of the plurality of nanostructures has a different geometric size from that of another.

    CMOS image sensor for RGB imaging and depth measurement with laser sheet scan

    公开(公告)号:US11131542B2

    公开(公告)日:2021-09-28

    申请号:US16988593

    申请日:2020-08-07

    Abstract: An imaging unit includes a light source and a pixel array. The light source projects a line of light that is scanned in a first direction across a field of view of the light source. The line of light oriented in a second direction that is substantially perpendicular to the first direction. The pixel array is arranged in at least one row of pixels that extends in a direction that is substantially parallel to the second direction. At least one pixel in a row is capable of generating two-dimensional color information of an object in the field of view based on a first light reflected from the object and is capable of generating three-dimensional (3D) depth information of the object based on the line of light reflecting from the object. The 3D-depth information includes time-of-flight information.

    Apparatus for and method of range sensor based on direct time-of-flight and triangulation

    公开(公告)号:US10942261B2

    公开(公告)日:2021-03-09

    申请号:US14992671

    申请日:2016-01-11

    Abstract: A range sensor and a method thereof. The range sensor includes a light source configured to project a sheet of light at an angle within a field of view (FOV); an image sensor offset from the light source; collection optics; and a controller connected to the light source, the image sensor, and the collection optics, and configured to determine a range of a distant object based on direct time-of-flight and determine a range of a near object based on triangulation. The method includes projecting, by a light source, a sheet of light at an angle within an FOV; offsetting an image sensor from the light source; collecting, by collection optics, the sheet of light reflected off objects; and determining, by a controller connected to the light source, the image sensor, and the collection optics, a range of a distant object based on direct time-of-flight and a range of a near object based on triangulation simultaneously.

Patent Agency Ranking