-
公开(公告)号:US20240353923A1
公开(公告)日:2024-10-24
申请号:US18681275
申请日:2022-08-05
Applicant: APPLE INC.
Inventor: Walter NISTICO , Patrick R. GILL
Abstract: Various implementations disclosed herein include devices, systems, and methods that perform gaze tracking using combinations of ultrasound and imaging data. Some implementations detect a first attribute of an eye using imaging measurements in a first image of the eye, and a first location associated with the first attribute is determined in a 3D coordinate system based on depth information. A second attribute of the eye is detected based on depth information from ultrasound based measurements of the eye, and a second location associated with the second attribute is determined in the 3D coordinate system based on the depth information and a 3D model of a portion of the eye. A gaze direction in the 3D coordinate system is determined based on the first location and the second location. In some implementations. user characteristics are identified (e.g., authentication) using ultrasonic biometric characteristics with imaging biometrics.
-
公开(公告)号:US20210377465A1
公开(公告)日:2021-12-02
申请号:US17401385
申请日:2021-08-13
Applicant: APPLE INC.
Inventor: Emanuele MANDELLI , Walter NISTICO
Abstract: In one implementation, an event sensor includes a plurality of pixels and an event compiler. The plurality of pixels are positioned to receive light from a scene disposed within a field of view of the event sensor. Each pixel is configured to have an operational state that is modified by control signals generated by a respective state circuit. The event compiler is configured to output a stream of pixel events. Each respective pixel event corresponds to a breach of a comparator threshold related to an intensity of incident illumination. Each control signal is generated based on feedback information that is received from an image pipeline configured to consume image data derived from the stream of pixel events.
-
公开(公告)号:US20220139084A1
公开(公告)日:2022-05-05
申请号:US17579713
申请日:2022-01-20
Applicant: APPLE INC.
Inventor: Emanuele MANDELLI , Sai Harsha JANDHYALA , Walter NISTICO
Abstract: Various implementations disclosed herein include devices, systems, and methods that obtain information from a first electronic device (e.g., to improve interactions for a CGR environment). In some implementations at a second electronic device having a processor, event camera data is obtained corresponding to modulated light (e.g., light including an information signal in its modulation) emitted by an optical source on the first electronic device and received at an event camera. The second electronic device is able to identify information from the first electronic device based on detecting a modulation pattern of the modulated light based on the event camera data. In some implementations, second electronic device is the same electronic device that has the event camera (e.g., laptop) or a different electronic device that receives the event data (e.g., a server receiving the event data from a laptop computer).
-
公开(公告)号:US20210377512A1
公开(公告)日:2021-12-02
申请号:US17401672
申请日:2021-08-13
Applicant: APPLE INC.
Inventor: Walter NISTICO
IPC: H04N13/279 , H04N13/271 , H04N13/296 , H04N13/293
Abstract: In one implementation, a method includes receiving pixel events output by an event sensor that correspond to a feature disposed within a field of view of the event sensor. Each respective pixel event is generated in response to a specific pixel within a pixel array of the event sensor detecting a change in light intensity that exceeds a comparator threshold. A characteristic of the feature is determined at a first time based on the pixel events and a previous characteristic of the feature at a second time that precedes the first time. Movement of the feature relative to the event sensor is tracked over time based on the characteristic and the previous characteristic.
-
公开(公告)号:US20240398224A1
公开(公告)日:2024-12-05
申请号:US18693276
申请日:2022-09-20
Applicant: APPLE INC.
Inventor: Walter NISTICO , Avery L. WANG , Edward VAIL , Huiyang DENG , Samuel STEVEN , Seyedeh Mahsa KAMALI , Tong CHEN , Xibin ZHOU
Abstract: Various implementations disclosed herein include devices, systems, and methods that track a state of a user's eye (e.g., position/orientation, gaze direction accommodation, pupil dilation, etc.) using coherence-based measurement (e.g., optical coherence tomography (OCT)). The coherence-based measurement may provide sub-surface information, e.g., depth, cross section, or a volumetric model of the eye, based on reflections/scattering of light (e.g., using relatively long wavelength light to penetrate into the eye tissue).
-
公开(公告)号:US20210378509A1
公开(公告)日:2021-12-09
申请号:US17411163
申请日:2021-08-25
Applicant: APPLE INC.
Inventor: Walter NISTICO
Abstract: Various implementations determine a pupil characteristic (e.g., perimeter location, pupil shape, pupil diameter, pupil center, etc.) using on-axis illumination. On-axis illumination involves producing light from a light source that is approximately on-axis with an image sensor configured to capture reflections of the light from the light source off the eye. The light from the light source may passes through the pupil into the eye and reflect off the retina to produce a bright pupil-type light pattern in data obtained by the image sensor. The light may be pulsed at a frequency so that frequency segmentation may be used to distinguish reflections through the pupil off the retina from reflections of light from other light sources. In some implementations, the image sensor is an event camera that detects events. The pupil characteristics may be assessed by assessing events that recur in a given area at the given frequency.
-
-
-
-
-