SPAD-based photon detectors with multi-phase sampling TDCs

    公开(公告)号:US12199197B2

    公开(公告)日:2025-01-14

    申请号:US17944738

    申请日:2022-09-14

    Applicant: Apple Inc.

    Abstract: A method of building a moving average histogram of photon times of arrival includes, for each time interval in first and second subsets of time intervals, latching a time reference corresponding to a time of receipt of an avalanche timing output signal of a single-photon avalanche diode (SPAD), and advancing a count stored at a memory address corresponding to the latched time reference. The memory address corresponds to a range of time references. The method further includes reading and clearing a first set of counts after the first subset of time intervals; phase-shifting the sequence of time references with respect to a set of memory addresses after the first subset of time intervals; reading and clearing a second set of counts after the second subset of time intervals; and building the moving average histogram using at least the first and second sets of counts.

    Calibration of a depth sensing array using color image data

    公开(公告)号:US11914078B2

    公开(公告)日:2024-02-27

    申请号:US17268963

    申请日:2019-09-02

    Applicant: APPLE INC.

    CPC classification number: G01S7/497 G01S17/86 G01S17/89

    Abstract: Imaging apparatus (22) includes a radiation source (40), which emits pulsed beams (42) of optical radiation toward a target scene (24). An array (52) of sensing elements (78) output signals indicative of respective times of incidence of photons in a first image of the target scene that is formed on the array of sensing elements. An image sensor (64) captures a second image of the target scene in registration with the first image. Processing and control circuitry (56, 58) identifies, responsively to the signals, areas of the array on which the pulses of optical radiation reflected from corresponding regions of the target scene are incident, and processes the signals from the sensing elements in the identified areas in order measure depth coordinates of the corresponding regions of the target scene based on the times of incidence, while identifying, responsively to the second image, one or more of the regions of the target scene as no-depth regions.

    Dynamic image re-timing
    3.
    发明授权

    公开(公告)号:US11200650B1

    公开(公告)日:2021-12-14

    申请号:US16578991

    申请日:2019-09-23

    Applicant: Apple Inc.

    Abstract: Techniques for the modification of at least part of a target image (e.g., scene objects within the target image), e.g., to make the target image appear that it was captured at a different time (e.g., a different time of day, different time of year) are disclosed. This “dynamic re-timing” of the target image may be achieved by finding one or more source images including the same (or similar) scene depicted in the target image (but, e.g., captured at different times), extracting stylistic elements from the source image(s), and then modifying at least part of the target image in a realistic fashion (e.g., not altering the geometry of objects in the target image), based on one or more extracted stylistic elements from the source image(s). Three-dimensional modeling of scene objects may allow a more realistic-looking transfer of the extracted stylistic elements onto scene objects in the target image to be achieved.

    Calibration of a depth sensing array using color image data

    公开(公告)号:US20210208262A1

    公开(公告)日:2021-07-08

    申请号:US17268963

    申请日:2019-09-02

    Applicant: APPLE INC.

    Abstract: Imaging apparatus (22) includes a radiation source (40), which emits pulsed beams (42) of optical radiation toward a target scene (24). An array (52) of sensing elements (78) output signals indicative of respective times of incidence of photons in a first image of the target scene that is formed on the array of sensing elements. An image sensor (64) captures a second image of the target scene in registration with the first image. Processing and control circuitry (56, 58) identifies, responsively to the signals, areas of the array on which the pulses of optical radiation reflected from corresponding regions of the target scene are incident, and processes the signals from the sensing elements in the identified areas in order measure depth coordinates of the corresponding regions of the target scene based on the times of incidence, while identifying, responsively to the second image, one or more of the regions of the target scene as no-depth regions.

    Detection of close-range specular targets

    公开(公告)号:US20240406552A1

    公开(公告)日:2024-12-05

    申请号:US18325150

    申请日:2023-05-30

    Applicant: Apple Inc.

    Abstract: Imaging apparatus includes a camera, which includes an autofocus mechanism. A range sensor includes a transmitter, which includes multiple emitters configured to transmit optical pulses at different angles toward the scene, and a receiver, to receive and sense respective times of flight of the optical pulses that are reflected from the scene. A photodetector outputs a signal indicative of an intensity of reflections from the scene. Control circuitry drives the emitters in alternation to transmit the optical pulses, estimates a range to a target in the scene responsively to the times of flight sensed by the receiver, detects a difference in the signal output by the photodetector in response to the pulses transmitted by different ones of the emitters, and sets the autofocus mechanism responsively to the estimated range as long as the detected difference is no greater than a predefined threshold difference.

    Close-range measurement of time of flight using parallax shift

    公开(公告)号:US11681028B2

    公开(公告)日:2023-06-20

    申请号:US17512708

    申请日:2021-10-28

    Applicant: APPLE INC.

    Inventor: Moshe Laifenfeld

    CPC classification number: G01S7/4865 G01S17/10 H01L31/02027 H01L31/107

    Abstract: An optical sensing device includes a light source, which emits one or more beams of light pulses toward a target scene at respective angles about a transmit axis of the light source. A first array of single-photon detectors output electrical pulses in response to photons that are incident thereon. A second array of counters count the electrical pulses output during respective count periods by respective sets of one or more of the single-photon detectors. Light collection optics form an image of the target scene on the first array along a receive axis, which is offset transversely relative to the transmit axis, thereby giving rise to a parallax shift as a function of distance between the target scene and the device. Control circuitry sets the respective count periods of the counters, responsively to the parallax shift, to cover different, respective time intervals following each of the light pulses.

    close-range measurement of time of flight using parallax shift

    公开(公告)号:US20230016025A1

    公开(公告)日:2023-01-19

    申请号:US17512708

    申请日:2021-10-28

    Applicant: APPLE INC.

    Inventor: Moshe Laifenfeld

    Abstract: An optical sensing device includes a light source, which emits one or more beams of light pulses toward a target scene at respective angles about a transmit axis of the light source. A first array of single-photon detectors output electrical pulses in response to photons that are incident thereon. A second array of counters count the electrical pulses output during respective count periods by respective sets of one or more of the single-photon detectors. Light collection optics form an image of the target scene on the first array along a receive axis, which is offset transversely relative to the transmit axis, thereby giving rise to a parallax shift as a function of distance between the target scene and the device. Control circuitry sets the respective count periods of the counters, responsively to the parallax shift, to cover different, respective time intervals following each of the light pulses.

Patent Agency Ranking