Method and device for eye tracking using event camera data

    公开(公告)号:US11150469B2

    公开(公告)日:2021-10-19

    申请号:US16651228

    申请日:2018-09-27

    Applicant: Apple Inc.

    Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints and determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.

    METHOD AND DEVICE FOR EYE TRACKING USING EVENT CAMERA DATA

    公开(公告)号:US20230314798A1

    公开(公告)日:2023-10-05

    申请号:US17961963

    申请日:2022-10-07

    Applicant: Apple Inc.

    Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints. The method includes determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.

    Method and device for eye tracking using event camera data

    公开(公告)号:US12105280B2

    公开(公告)日:2024-10-01

    申请号:US17961963

    申请日:2022-10-07

    Applicant: Apple Inc.

    Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints. The method includes determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.

    Training a network to inhibit performance of a secondary task

    公开(公告)号:US11734570B1

    公开(公告)日:2023-08-22

    申请号:US16666850

    申请日:2019-10-29

    Applicant: Apple Inc.

    CPC classification number: G06N3/084 G06F9/48 G06N5/046 G06N20/00

    Abstract: The present disclosure describes techniques for training a neural network such that the trained network can be implemented to perform a utility task (e.g., a classification task) while inhibiting performance of a secondary task (e.g., a privacy-violating task). In some embodiments, the techniques include training a neural network using a first loss associated with a first task and a second loss associated with a second task different from the first task. In some embodiments, this includes performing a first training operation associated with the first loss, and performing a second training operation associated with the second loss, wherein the second training operation includes providing, to the neural network, a plurality of input items associated with the second task.

    METHOD AND DEVICE FOR EYE TRACKING USING EVENT CAMERA DATA

    公开(公告)号:US20220003994A1

    公开(公告)日:2022-01-06

    申请号:US17481272

    申请日:2021-09-21

    Applicant: Apple Inc.

    Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints. The method includes determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.

    Method and device for eye tracking using event camera data

    公开(公告)号:US11474348B2

    公开(公告)日:2022-10-18

    申请号:US17481272

    申请日:2021-09-21

    Applicant: Apple Inc.

    Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints. The method includes determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.

    Event camera-based gaze tracking using neural networks

    公开(公告)号:US11442539B2

    公开(公告)日:2022-09-13

    申请号:US16963633

    申请日:2019-01-23

    Applicant: APPLE INC.

    Abstract: One implementation involves a device receiving a stream of pixel events output by an event camera. The device derives an input image by accumulating pixel events for multiple event camera pixels. The device generates a gaze characteristic using the derived input image as input to a neural network trained to determine the gaze characteristic. The neural network is configured in multiple stages. The first stage of the neural network is configured to determine an initial gaze characteristic, e.g., an initial pupil center, using reduced resolution input(s). The second stage of the neural network is configured to determine adjustments to the initial gaze characteristic using location-focused input(s), e.g., using only a small input image centered around the initial pupil center. The determinations at each stage are thus efficiently made using relatively compact neural network configurations. The device tracks a gaze of the eye based on the gaze characteristic.

    METHOD AND DEVICE FOR EYE TRACKING USING EVENT CAMERA DATA

    公开(公告)号:US20200278539A1

    公开(公告)日:2020-09-03

    申请号:US16651228

    申请日:2017-09-28

    Applicant: Apple Inc.

    Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints and determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.

Patent Agency Ranking