公开(公告)号：US20240267644A1

公开(公告)日：2024-08-08

申请号：US18634063

申请日：2024-04-12

Applicant: APPLE INC.

Inventor： Emanuele MANDELLI ,  Andrew K. McMAHON ,  Nikolai E. BOCK

IPC: H04N25/53 ,  H01L27/146 ,  H04N25/46 ,  H04N25/47 ,  H04N25/707 ,  H04N25/709

CPC classification number: H04N25/53 ,  H04N25/46 ,  H04N25/47 ,  H04N25/707 ,  H04N25/709 ,  H01L27/14643 ,  H01L27/14665

Abstract: Various implementations disclosed herein include devices, systems, and methods implemented by an electronic device with an imaging sensor including a plurality of pixels (e.g., a matrix of pixels) that each are capable of detecting illumination intensity or contrast change using at least one shared photosensor. In some implementations, the imaging sensor is capable of operating in a first illumination intensity detecting mode (e.g., in a frame-based camera mode) or in a second contrast change detecting mode (e.g., in an event camera mode). In some implementations, the first illumination intensity detecting mode and the second contrast change detecting mode are mutually exclusive. In some implementations, pixels at an imaging sensor include two transfer transistors (e.g., gates) where a first transfer transistor allows intensity detection, and a second transfer transistor allows contrast change detection.

公开(公告)号：US20230008550A1

公开(公告)日：2023-01-12

申请号：US17774878

申请日：2020-11-10

Applicant: APPLE INC.

Inventor： Nikolai E. BOCK ,  Emanuele MANDELLI ,  Gennady A. MANOKHIN

IPC: H04N5/378 ,  H04N5/3745 ,  H04N5/376 ,  H04N5/341 ,  H04N5/351

Abstract: Various implementations disclosed herein include devices, systems, and methods that buffer events in device memory during synchronous readout of a plurality of frames by a sensor. Various implementations disclosed herein include devices, systems, and methods that disable a sensor communication link until the buffered events are sufficient for transmission by the sensor. In some implementations, the sensor using a synchronous readout may select a readout mode for one or more frames based on how many of the pixels are detecting events. In some implementations, a first mode that reads out only data for a low percentage of pixels that have events uses the device memory and a second mode bypasses the device memory based on accumulation criteria such as high percentage of pixels detecting events. In the second mode, less data per pixel may be readout.

公开(公告)号：US20220394196A1

公开(公告)日：2022-12-08

申请号：US17774727

申请日：2020-11-05

Applicant: APPLE INC.

Inventor： Nikolai E. BOCK ,  Emanuele MANDELLI ,  Gennady A. MANOKHIN

IPC: H04N5/351 ,  H04N5/378

Abstract: Various implementations disclosed herein include devices, systems, and methods that determine a control signal before synchronous readout of a frame (or part of the frame) is performed by a sensor. Various implementations disclosed herein include devices, systems, and methods that determine event density (e.g., a dense row signal or a dense frame signal) before synchronous readout is performed by the sensor. In some implementations, the event camera is capable of operating in a first readout mode and a second readout mode based on a number of events. In the second readout mode, less data per pixel may be readout.

公开(公告)号：US20210377465A1

公开(公告)日：2021-12-02

申请号：US17401385

申请日：2021-08-13

Applicant: APPLE INC.

Inventor： Emanuele MANDELLI ,  Walter NISTICO

IPC: H04N5/343 ,  H04N5/345

Abstract: In one implementation, an event sensor includes a plurality of pixels and an event compiler. The plurality of pixels are positioned to receive light from a scene disposed within a field of view of the event sensor. Each pixel is configured to have an operational state that is modified by control signals generated by a respective state circuit. The event compiler is configured to output a stream of pixel events. Each respective pixel event corresponds to a breach of a comparator threshold related to an intensity of incident illumination. Each control signal is generated based on feedback information that is received from an image pipeline configured to consume image data derived from the stream of pixel events.

公开(公告)号：US20220141403A1

公开(公告)日：2022-05-05

申请号：US17578601

申请日：2022-01-19

Applicant: APPLE INC.

Inventor： Emanuele MANDELLI ,  Andrew K. McMAHON ,  Nikolai E. BOCK

IPC: H04N5/353 ,  H04N5/347 ,  H04N5/369

Abstract: Various implementations disclosed herein include devices, systems, and methods implemented by an electronic device with an imaging sensor including a plurality of pixels (e.g., a matrix of pixels) that each are capable of detecting illumination intensity or contrast change using at least one shared photosensor. In some implementations, the imaging sensor is capable of operating in a first illumination intensity detecting mode (e.g., in a frame-based camera mode) or in a second contrast change detecting mode (e.g., in an event camera mode). In some implementations, the first illumination intensity detecting mode and the second contrast change detecting mode are mutually exclusive. In some implementations, pixels at an imaging sensor include two transfer transistors (e.g., gates) where a first transfer transistor allows intensity detection, and a second transfer transistor allows contrast change detection.

公开(公告)号：US20220139084A1

公开(公告)日：2022-05-05

申请号：US17579713

申请日：2022-01-20

Applicant: APPLE INC.

Inventor： Emanuele MANDELLI ,  Sai Harsha JANDHYALA ,  Walter NISTICO

IPC: G06V20/40 ,  G06V20/52 ,  G06F3/03 ,  G06F3/042

Abstract: Various implementations disclosed herein include devices, systems, and methods that obtain information from a first electronic device (e.g., to improve interactions for a CGR environment). In some implementations at a second electronic device having a processor, event camera data is obtained corresponding to modulated light (e.g., light including an information signal in its modulation) emitted by an optical source on the first electronic device and received at an event camera. The second electronic device is able to identify information from the first electronic device based on detecting a modulation pattern of the modulated light based on the event camera data. In some implementations, second electronic device is the same electronic device that has the event camera (e.g., laptop) or a different electronic device that receives the event data (e.g., a server receiving the event data from a laptop computer).

公开(公告)号：US20210344854A1

公开(公告)日：2021-11-04

申请号：US17376264

申请日：2021-07-15

Applicant: APPLE INC.

Inventor： Nikolai E. BOCK ,  Emanuele MANDELLI ,  Dario CLOCCHIATTI

IPC: H04N5/351 ,  H04N5/378 ,  H04N5/3745

Abstract: In one implementation, an event sensor includes a plurality of pixels, an external readout line shared among the plurality of pixels, and an external processing circuit. Each pixel is configured to output pixel data indicative of an intensity of incident illumination. The external processing circuit is configured to output a stream of pixel events. Each respective pixel event is generated when a comparator of the external processing circuit obtains a sample of pixel data from a particular pixel via the external readout line that breaches a threshold value.