-
公开(公告)号:US11244660B2
公开(公告)日:2022-02-08
申请号:US17174138
申请日:2021-02-11
Applicant: Apple Inc.
Inventor: Yashas Rai Kurlethimar , Can Jin , Nicolas Pierre Marie Frederic Bonnier , Jiaying Wu , Andrew B. Watson
Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.
-
公开(公告)号:US11442543B1
公开(公告)日:2022-09-13
申请号:US17543171
申请日:2021-12-06
Applicant: Apple Inc.
Inventor: Yashas Rai Kurlethimar , Giovanni Carbone , Milad Akhlaghi Bouzan , Nicolas P. Bonnier , William W. Sprague
Abstract: A head-mounted display may display images in eye boxes. Right and left gaze tracking sensors may gather left eye gaze information from a left eye box and right eye gaze information from a right eye box. During operation in a first mode in which the right and left gaze tracking sensors are not impaired, gaze information from the right and left gaze tracking sensors may be used in presenting foveated and distortion-corrected image content on the displays and/or in otherwise operating the left and right displays. During operation in a second mode in which one of the gaze tracking sensors is impaired, gaze information for the impaired sensor may be estimated from gaze information for the unimpaired sensor in combination with an object depth estimate based on depth buffer information, vestibulo-ocular-reflex gain information, and historical information.
-
公开(公告)号:US20220130350A1
公开(公告)日:2022-04-28
申请号:US17569312
申请日:2022-01-05
Applicant: Apple Inc.
Inventor: Yashas Rai Kurlethimar , Can Jin , Nicolas Pierre Marie Frederic Bonnier , Jiaying Wu , Andrew B. Watson
Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.
-
公开(公告)号:US11789529B2
公开(公告)日:2023-10-17
申请号:US17569312
申请日:2022-01-05
Applicant: Apple Inc.
Inventor: Yashas Rai Kurlethimar , Can Jin , Nicolas Pierre Marie Frederic Bonnier , Jiaying Wu , Andrew B. Watson
CPC classification number: G06F3/013 , G02B27/0093 , G06V10/462 , G06V40/193 , G09G5/38 , G09G2354/00
Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.
-
公开(公告)号:US20210287633A1
公开(公告)日:2021-09-16
申请号:US17174138
申请日:2021-02-11
Applicant: Apple Inc.
Inventor: Yashas Rai Kurlethimar , Can Jin , Nicolas Pierre Marie Frederic Bonnier , Jiaying Wu , Andrew B. Watson
Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.
-
公开(公告)号:US20250104580A1
公开(公告)日:2025-03-27
申请号:US18828527
申请日:2024-09-09
Applicant: Apple Inc.
Inventor: Stanley K. Melax , Seyedpooya Mirhosseini , Fuyi Yang , Seyedkoosha Mirhosseini , Dagny Fleischman , David M. Cook , Yashas Rai Kurlethimar , Xin Wang , Travis W. Brown , Ara H. Aroyan , Jin Wook Chang , Abbas Haddadi , Yang Li , Alexander G. Berardino , Mengu Sukan , Ermal Dreshaj , Kyrollos Yanny , William W. Sprague
Abstract: Various implementations disclosed herein include devices, systems, and methods that present content items (e.g., movies, TV shows, home-made videos, etc.) on electronic devices such as HMDs. Some implementations adjust what is being displayed by the electronic devices to mitigate optical module-based artifacts (e.g., ghosting). For example, in an HMD with a catadioptric lens, a mirror layer may leak some light to produce ghosting artifacts that may be mitigated by adjusting brightness, dynamic range, contrast, light-spill, color, etc. Some implementations utilize adjustments that are based on content item awareness (e.g., adjustments based on the peak brightness of the scene in a movie that is being displayed within an extended reality (XR) environment, etc.). Some implementations provide adjustments based on environment awareness (e.g., how dark is the surroundings or pass-through environment) and/or optical module modeling. The adjustments may change a particular content item and/or an environment in which it is presented.
-
公开(公告)号:US12093454B2
公开(公告)日:2024-09-17
申请号:US18343623
申请日:2023-06-28
Applicant: Apple Inc.
Inventor: Yashas Rai Kurlethimar , Can Jin , Nicolas Pierre Marie Frederic Bonnier , Jiaying Wu , Andrew B. Watson
CPC classification number: G06F3/013 , G02B27/0093 , G02B27/0172 , G06V10/462 , G06V40/193 , G09G3/2092 , G09G5/38 , G09G2354/00
Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.
-
公开(公告)号:US20190339770A1
公开(公告)日:2019-11-07
申请号:US16376329
申请日:2019-04-05
Applicant: Apple Inc.
Inventor: Yashas Rai Kurlethimar , Andrew B. Watson , Nicolas P. Bonnier , Mehmet N. Agaoglu , Alexander G. Berardino , Elijah H. Kleeman
Abstract: An electronic device may have a foveated display, an eye-tracking system and a head movement detection system. The eye-tracking system may gather information on a user's point of regard on the display while the head movement detection system may capture information regarding the rotation of the observer's head. Based on the point-of-regard information, head rotation information, image data, the type of eye/head movement that is underway, and/or tiredness information, control circuitry in the electronic device may produce image data for a display, with areas of different resolutions and(or) visual quality. A full-resolution and(or) quality portion of the image may overlap the point of regard. One or more lower resolution portions of the image may surround the full-resolution portion. The control circuitry may include a gaze prediction system for predicting the movement of the user's gaze during a saccade.
-
公开(公告)号:US20240404165A1
公开(公告)日:2024-12-05
申请号:US18672922
申请日:2024-05-23
Applicant: Apple Inc.
Inventor: Yashas Rai Kurlethimar , Jonathan Moorman , Mark L. Ma , Michael E. Buerli , Seyedkoosha Mirhosseini , Sushant Ojal
Abstract: In one implementation, a method of displaying image is performed by a device including one or more processors and non-transitory memory. The method includes obtaining gaze information. The method includes obtaining, based on the gaze information, a first resolution function and a second resolution function different than the first resolution function. The method includes rendering a first layer based on first virtual content and the first resolution function. The method includes rendering a second layer based on second virtual content and the second resolution function. The method includes compositing the first layer and the second layer into an image. The method includes displaying, on the display, the image.
-
公开(公告)号:US20240331661A1
公开(公告)日:2024-10-03
申请号:US18616064
申请日:2024-03-25
Applicant: Apple Inc.
CPC classification number: G09G5/391 , G02B27/0093 , G02B27/0172 , G06F3/012 , G06T9/007 , G06T17/005 , H04N19/625 , H04N19/96 , G06T2207/20052 , G09G2340/0407
Abstract: Prior to rendering a current frame, a device obtains a previously rendered frame. The device determines that a first portion of the previously rendered frame is associated with a particular type of content. The device renders a first portion of the current frame that corresponds to the first portion of the previously rendered frame with a first rendering characteristic while rendering a second portion of the current frame with a second rendering characteristic that is different from the first rendering characteristic.
-
-
-
-
-
-
-
-
-