HYBRID GAZE TRACKING SYSTEM
    1.
    发明公开

    公开(公告)号:US20240353923A1

    公开(公告)日:2024-10-24

    申请号:US18681275

    申请日:2022-08-05

    Applicant: APPLE INC.

    CPC classification number: G06F3/013 G06V40/18

    Abstract: Various implementations disclosed herein include devices, systems, and methods that perform gaze tracking using combinations of ultrasound and imaging data. Some implementations detect a first attribute of an eye using imaging measurements in a first image of the eye, and a first location associated with the first attribute is determined in a 3D coordinate system based on depth information. A second attribute of the eye is detected based on depth information from ultrasound based measurements of the eye, and a second location associated with the second attribute is determined in the 3D coordinate system based on the depth information and a 3D model of a portion of the eye. A gaze direction in the 3D coordinate system is determined based on the first location and the second location. In some implementations. user characteristics are identified (e.g., authentication) using ultrasonic biometric characteristics with imaging biometrics.

    HARDWARE IMPLEMENTATION OF SENSOR ARCHITECTURE WITH MULTIPLE POWER STATES

    公开(公告)号:US20210377465A1

    公开(公告)日:2021-12-02

    申请号:US17401385

    申请日:2021-08-13

    Applicant: APPLE INC.

    Abstract: In one implementation, an event sensor includes a plurality of pixels and an event compiler. The plurality of pixels are positioned to receive light from a scene disposed within a field of view of the event sensor. Each pixel is configured to have an operational state that is modified by control signals generated by a respective state circuit. The event compiler is configured to output a stream of pixel events. Each respective pixel event corresponds to a breach of a comparator threshold related to an intensity of incident illumination. Each control signal is generated based on feedback information that is received from an image pipeline configured to consume image data derived from the stream of pixel events.

    TRACKING USING SENSORS
    3.
    发明申请

    公开(公告)号:US20220139084A1

    公开(公告)日:2022-05-05

    申请号:US17579713

    申请日:2022-01-20

    Applicant: APPLE INC.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that obtain information from a first electronic device (e.g., to improve interactions for a CGR environment). In some implementations at a second electronic device having a processor, event camera data is obtained corresponding to modulated light (e.g., light including an information signal in its modulation) emitted by an optical source on the first electronic device and received at an event camera. The second electronic device is able to identify information from the first electronic device based on detecting a modulation pattern of the modulated light based on the event camera data. In some implementations, second electronic device is the same electronic device that has the event camera (e.g., laptop) or a different electronic device that receives the event data (e.g., a server receiving the event data from a laptop computer).

    PROCESSING OF SIGNALS USING A RECURRENT STATE ESTIMATOR

    公开(公告)号:US20210377512A1

    公开(公告)日:2021-12-02

    申请号:US17401672

    申请日:2021-08-13

    Applicant: APPLE INC.

    Inventor: Walter NISTICO

    Abstract: In one implementation, a method includes receiving pixel events output by an event sensor that correspond to a feature disposed within a field of view of the event sensor. Each respective pixel event is generated in response to a specific pixel within a pixel array of the event sensor detecting a change in light intensity that exceeds a comparator threshold. A characteristic of the feature is determined at a first time based on the pixel events and a previous characteristic of the feature at a second time that precedes the first time. Movement of the feature relative to the event sensor is tracked over time based on the characteristic and the previous characteristic.

    PUPIL ASSESSMENT USING MODULATED ON-AXIS ILLUMINATION

    公开(公告)号:US20210378509A1

    公开(公告)日:2021-12-09

    申请号:US17411163

    申请日:2021-08-25

    Applicant: APPLE INC.

    Inventor: Walter NISTICO

    Abstract: Various implementations determine a pupil characteristic (e.g., perimeter location, pupil shape, pupil diameter, pupil center, etc.) using on-axis illumination. On-axis illumination involves producing light from a light source that is approximately on-axis with an image sensor configured to capture reflections of the light from the light source off the eye. The light from the light source may passes through the pupil into the eye and reflect off the retina to produce a bright pupil-type light pattern in data obtained by the image sensor. The light may be pulsed at a frequency so that frequency segmentation may be used to distinguish reflections through the pupil off the retina from reflections of light from other light sources. In some implementations, the image sensor is an event camera that detects events. The pupil characteristics may be assessed by assessing events that recur in a given area at the given frequency.

Patent Agency Ranking