Method and system for eye tracking with glint space recalibration on wearable heads-up display

    公开(公告)号:US10976814B2

    公开(公告)日:2021-04-13

    申请号:US16376319

    申请日:2019-04-05

    Applicant: GOOGLE LLC

    Abstract: A method of tracking an eye of a user includes generating an infrared light, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye over an eye tracking period. A plurality of glints is identified from the reflections of the infrared light detected. A glint center position of each glint in a glint space is determined and transformed to a gaze position in a display space. At least once during the eye tracking period, an image of the eye is reconstructed from a portion of the reflections of the infrared light detected. A pupil is detected from the image, and a pupil center position is determined. A glint-pupil vector is determined from the pupil center position and the glint center position of at least one glint corresponding in space to the pupil. The glint space is recalibrated based on the glint-pupil vector.

    Method and system of eye tracking with glint drift correction on wearable heads-up display

    公开(公告)号:US10936056B2

    公开(公告)日:2021-03-02

    申请号:US16376674

    申请日:2019-04-05

    Applicant: GOOGLE LLC

    Abstract: A method of tracking an eye of a user includes generating infrared light over an eye tracking period, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye. Shifts in a position of a wearable heads-up display (WHUD) worn on the head of the user are detected during at least a portion of the eye tracking period. Glints are identified from the detected reflections of the infrared light. A drift in a glint center position of an identified glint relative to a glint space is determined based on a detected shift in position of the WHUD corresponding in space to the identified glint. The glint center position is adjusted to compensate for the drift. The adjusted glint center position is transformed from the glint space to a gaze position in a display space in a field of view of the eye.

    Method and system for eye tracking with glint space recalibration on wearable heads-up display

    公开(公告)号:US11619992B2

    公开(公告)日:2023-04-04

    申请号:US17224823

    申请日:2021-04-07

    Applicant: GOOGLE LLC

    Abstract: A method of tracking an eye of a user includes generating an infrared light, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye over an eye tracking period. A plurality of glints is identified from the reflections of the infrared light detected. A glint center position of each glint in a glint space is determined and transformed to a gaze position in a display space. At least once during the eye tracking period, an image of the eye is reconstructed from a portion of the reflections of the infrared light detected. A pupil is detected from the image, and a pupil center position is determined. A glint-pupil vector is determined from the pupil center position and the glint center position of at least one glint corresponding in space to the pupil. The glint space is recalibrated based on the glint-pupil vector.

    METHOD AND SYSTEM FOR EYE TRACKING WITH GLINT SPACE RECALIBRATION ON WEARABLE HEADS-UP DISPLAY

    公开(公告)号:US20210223863A1

    公开(公告)日:2021-07-22

    申请号:US17224823

    申请日:2021-04-07

    Applicant: GOOGLE LLC

    Abstract: A method of tracking an eye of a user includes generating an infrared light, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye over an eye tracking period. A plurality of glints is identified from the reflections of the infrared light detected. A glint center position of each glint in a glint space is determined and transformed to a gaze position in a display space. At least once during the eye tracking period, an image of the eye is reconstructed from a portion of the reflections of the infrared light detected. A pupil is detected from the image, and a pupil center position is determined. A glint-pupil vector is determined from the pupil center position and the glint center position of at least one glint corresponding in space to the pupil. The glint space is recalibrated based on the glint-pupil vector.

    Laser safety in wearable heads-up displays

    公开(公告)号:US11487125B2

    公开(公告)日:2022-11-01

    申请号:US17229523

    申请日:2021-04-13

    Applicant: GOOGLE LLC

    Abstract: Systems, devices, and methods provide for the prevention of laser light escaping a foldable wearable heads-up display (WHUD) when the WHUD is folded. For a WHUD that adopts the form factor of conventional eyeglasses or sunglasses, enabling the WHUD to fold “like glasses” can cause an interruption in the optical path of display light and enable display light to escape into the external environment. This can be hazardous when laser light is used to provide display light. Systems, devices, and methods that automatically detect, sense, and/or respond to the fold configuration state of a WHUD are described. When the WHUD is unfolded a laser-based display operates normally. When the WHUD is folded the laser-based display is disabled to prevent laser light from projecting out of the WHUD through the folded region. Proximity sensors and laser light containing mechanisms also may be employed as alternative or supplementary safety elements.

    LASER SAFETY IN WEARABLE HEADS-UP DISPLAYS

    公开(公告)号:US20220269091A1

    公开(公告)日:2022-08-25

    申请号:US17229523

    申请日:2021-04-13

    Applicant: GOOGLE LLC

    Abstract: Systems, devices, and methods provide for the prevention of laser light escaping a foldable wearable heads-up display (WHUD) when the WHUD is folded. For a WHUD that adopts the form factor of conventional eyeglasses or sunglasses, enabling the WHUD to fold “like glasses” can cause an interruption in the optical path of display light and enable display light to escape into the external environment. This can be hazardous when laser light is used to provide display light. Systems, devices, and methods that automatically detect, sense, and/or respond to the fold configuration state of a WHUD are described. When the WHUD is unfolded a laser-based display operates normally. When the WHUD is folded the laser-based display is disabled to prevent laser light from projecting out of the WHUD through the folded region. Proximity sensors and laser light containing mechanisms also may be employed as alternative or supplementary safety elements.

    Eye tracking system and method, eyeglass lens, and wearable heads-up display

    公开(公告)号:US11042031B2

    公开(公告)日:2021-06-22

    申请号:US16269385

    申请日:2019-02-06

    Applicant: GOOGLE LLC

    Abstract: An eye tracking system for tracking an eye of a user includes at least one infrared laser diode to output an infrared light and an optical scanner positioned to receive the infrared light outputted by the at least one infrared laser diode and controllable to scan the infrared light over a target area. A holographic optical element is positioned at the target area to receive the infrared light from the optical scanner and redirect the infrared light to the eye of the user. An infrared detector is aligned to detect at least a portion of the infrared light returned from the eye of the user. An infrared filter is disposed in a position to selectively block transmission of infrared wavelengths through the holographic optical element from a side of the holographic optical element. An eyeglass lens, a wearable heads-up display, and a method of eye tracking are also described.

    Method and system for dual mode eye tracking on wearable heads-up display

    公开(公告)号:US11157077B2

    公开(公告)日:2021-10-26

    申请号:US16376604

    申请日:2019-04-05

    Applicant: GOOGLE LLC

    Abstract: A method of tracking an eye of a user on a wearable heads-up display (WHUD) worn on the head of the user includes generating infrared light over an eye tracking period, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye. A motion parameter that is sensitive to motion of the WHUD is measured. Eye tracking is performed in a first mode that is based on glint for values of the motion parameter that fall within a first range of motion parameter values for which an error in measurement of glint position. Eye tracking is performed in a second mode that is based on glint-pupil vector for values of the motion parameter that fall within a second range of motion parameter values for which an error in measurement of glint position exceeds the error threshold. A head-mounted apparatus with eye tracking is disclosed.

    Eye tracking method and system and integration of the same with wearable heads-up displays

    公开(公告)号:US11093034B2

    公开(公告)日:2021-08-17

    申请号:US16668677

    申请日:2019-10-30

    Applicant: GOOGLE LLC

    Abstract: A method of tracking a gaze position of an eye in a target space in a field of view of the eye over an eye tracking period includes performing a plurality of scans of the eye with infrared light within the eye tracking period. Each scan includes generating infrared light signals over a scan period and projecting the infrared light signals from a plurality of virtual light projectors to the eye to form a plurality of illumination areas on the eye. Reflections of the infrared light signals from the eye are detected for each scan. The gaze position of the eye in the target space is determined from the detected reflections of the infrared light signals for each scan.

Patent Agency Ranking