Recovery from eye-tracking loss in foveated displays

    公开(公告)号:US11244660B2

    公开(公告)日:2022-02-08

    申请号:US17174138

    申请日:2021-02-11

    Applicant: Apple Inc.

    Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.

    Electronic devices with monocular gaze estimation capabilities

    公开(公告)号:US11442543B1

    公开(公告)日:2022-09-13

    申请号:US17543171

    申请日:2021-12-06

    Applicant: Apple Inc.

    Abstract: A head-mounted display may display images in eye boxes. Right and left gaze tracking sensors may gather left eye gaze information from a left eye box and right eye gaze information from a right eye box. During operation in a first mode in which the right and left gaze tracking sensors are not impaired, gaze information from the right and left gaze tracking sensors may be used in presenting foveated and distortion-corrected image content on the displays and/or in otherwise operating the left and right displays. During operation in a second mode in which one of the gaze tracking sensors is impaired, gaze information for the impaired sensor may be estimated from gaze information for the unimpaired sensor in combination with an object depth estimate based on depth buffer information, vestibulo-ocular-reflex gain information, and historical information.

    RECOVERY FROM EYE-TRACKING LOSS IN FOVEATED DISPLAYS

    公开(公告)号:US20220130350A1

    公开(公告)日:2022-04-28

    申请号:US17569312

    申请日:2022-01-05

    Applicant: Apple Inc.

    Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.

    RECOVERY FROM EYE-TRACKING LOSS IN FOVEATED DISPLAYS

    公开(公告)号:US20210287633A1

    公开(公告)日:2021-09-16

    申请号:US17174138

    申请日:2021-02-11

    Applicant: Apple Inc.

    Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.

    Electronic Device With Foveated Display and Gaze Prediction

    公开(公告)号:US20190339770A1

    公开(公告)日:2019-11-07

    申请号:US16376329

    申请日:2019-04-05

    Applicant: Apple Inc.

    Abstract: An electronic device may have a foveated display, an eye-tracking system and a head movement detection system. The eye-tracking system may gather information on a user's point of regard on the display while the head movement detection system may capture information regarding the rotation of the observer's head. Based on the point-of-regard information, head rotation information, image data, the type of eye/head movement that is underway, and/or tiredness information, control circuitry in the electronic device may produce image data for a display, with areas of different resolutions and(or) visual quality. A full-resolution and(or) quality portion of the image may overlap the point of regard. One or more lower resolution portions of the image may surround the full-resolution portion. The control circuitry may include a gaze prediction system for predicting the movement of the user's gaze during a saccade.

    Rendering Layers with Different Perception Quality

    公开(公告)号:US20240404165A1

    公开(公告)日:2024-12-05

    申请号:US18672922

    申请日:2024-05-23

    Applicant: Apple Inc.

    Abstract: In one implementation, a method of displaying image is performed by a device including one or more processors and non-transitory memory. The method includes obtaining gaze information. The method includes obtaining, based on the gaze information, a first resolution function and a second resolution function different than the first resolution function. The method includes rendering a first layer based on first virtual content and the first resolution function. The method includes rendering a second layer based on second virtual content and the second resolution function. The method includes compositing the first layer and the second layer into an image. The method includes displaying, on the display, the image.

Patent Agency Ranking