-
公开(公告)号:US11150469B2
公开(公告)日:2021-10-19
申请号:US16651228
申请日:2018-09-27
Applicant: Apple Inc.
Inventor: Branko Petljanski , Raffi A. Bedikian , Daniel Kurz , Thomas Gebauer , Li Jia
Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints and determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.
-
公开(公告)号:US11861873B2
公开(公告)日:2024-01-02
申请号:US17881692
申请日:2022-08-05
Applicant: Apple Inc.
Inventor: Thomas Gebauer , Raffi Bedikian
IPC: G06V10/141 , G06F3/01 , G06T3/40 , G06V40/18 , G06F18/214 , G06F18/2413 , G06V10/764 , G06V10/82 , G06V10/44
CPC classification number: G06V10/141 , G06F3/013 , G06F18/214 , G06F18/2413 , G06T3/4046 , G06V10/454 , G06V10/764 , G06V10/82 , G06V40/193
Abstract: One implementation involves a device receiving a stream of pixel events output by an event camera. The device derives an input image by accumulating pixel events for multiple event camera pixels. The device generates a gaze characteristic using the derived input image as input to a neural network trained to determine the gaze characteristic. The neural network is configured in multiple stages. The first stage of the neural network is configured to determine an initial gaze characteristic, e.g., an initial pupil center, using reduced resolution input(s). The second stage of the neural network is configured to determine adjustments to the initial gaze characteristic using location-focused input(s), e.g., using only a small input image centered around the initial pupil center. The determinations at each stage are thus efficiently made using relatively compact neural network configurations. The device tracks a gaze of the eye based on the gaze characteristic.
-
公开(公告)号:US20230314798A1
公开(公告)日:2023-10-05
申请号:US17961963
申请日:2022-10-07
Applicant: Apple Inc.
Inventor: Branko Petljanski , Raffi A. Bedikian , Daniel Kurz , Thomas Gebauer , Li Jia
CPC classification number: G02B27/0093 , G02B27/0101 , G02B27/0172 , G02B27/0179 , G06F3/013 , G02B2027/0138 , G02B2027/014 , G02B2027/0187
Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints. The method includes determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.
-
公开(公告)号:US12105280B2
公开(公告)日:2024-10-01
申请号:US17961963
申请日:2022-10-07
Applicant: Apple Inc.
Inventor: Branko Petljanski , Raffi A. Bedikian , Daniel Kurz , Thomas Gebauer , Li Jia
CPC classification number: G02B27/0093 , G02B27/0101 , G02B27/0172 , G02B27/0179 , G06F3/013 , G02B2027/0138 , G02B2027/014 , G02B2027/0187
Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints. The method includes determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.
-
公开(公告)号:US11734570B1
公开(公告)日:2023-08-22
申请号:US16666850
申请日:2019-10-29
Applicant: Apple Inc.
Inventor: Daniel Kurz , Thomas Gebauer , Dewey H. Lee , Muhammad Ahmed Riaz , Qian Wang
Abstract: The present disclosure describes techniques for training a neural network such that the trained network can be implemented to perform a utility task (e.g., a classification task) while inhibiting performance of a secondary task (e.g., a privacy-violating task). In some embodiments, the techniques include training a neural network using a first loss associated with a first task and a second loss associated with a second task different from the first task. In some embodiments, this includes performing a first training operation associated with the first loss, and performing a second training operation associated with the second loss, wherein the second training operation includes providing, to the neural network, a plurality of input items associated with the second task.
-
公开(公告)号:US20220003994A1
公开(公告)日:2022-01-06
申请号:US17481272
申请日:2021-09-21
Applicant: Apple Inc.
Inventor: Branko Petljanski , Raffi A. Bedikian , Daniel Kurz , Thomas Gebauer , Li Jia
Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints. The method includes determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.
-
公开(公告)号:US11474348B2
公开(公告)日:2022-10-18
申请号:US17481272
申请日:2021-09-21
Applicant: Apple Inc.
Inventor: Branko Petljanski , Raffi A. Bedikian , Daniel Kurz , Thomas Gebauer , Li Jia
Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints. The method includes determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.
-
公开(公告)号:US11442539B2
公开(公告)日:2022-09-13
申请号:US16963633
申请日:2019-01-23
Applicant: APPLE INC.
Inventor: Thomas Gebauer , Raffi Bedikian
IPC: G06F3/01 , G06K9/62 , G06T3/40 , G06V10/141 , G06V40/18
Abstract: One implementation involves a device receiving a stream of pixel events output by an event camera. The device derives an input image by accumulating pixel events for multiple event camera pixels. The device generates a gaze characteristic using the derived input image as input to a neural network trained to determine the gaze characteristic. The neural network is configured in multiple stages. The first stage of the neural network is configured to determine an initial gaze characteristic, e.g., an initial pupil center, using reduced resolution input(s). The second stage of the neural network is configured to determine adjustments to the initial gaze characteristic using location-focused input(s), e.g., using only a small input image centered around the initial pupil center. The determinations at each stage are thus efficiently made using relatively compact neural network configurations. The device tracks a gaze of the eye based on the gaze characteristic.
-
公开(公告)号:US20200278539A1
公开(公告)日:2020-09-03
申请号:US16651228
申请日:2017-09-28
Applicant: Apple Inc.
Inventor: Branko Petljanski , Raffi A. Bedikian , Daniel Kurz , Thomas Gebauer , Li Jia
Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints and determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.
-
-
-
-
-
-
-
-