公开(公告)号：US20240205380A1

公开(公告)日：2024-06-20

申请号：US18488613

申请日：2023-10-17

Applicant: Apple Inc.

Inventor： James C McIlree ,  Jacob Wilson ,  Jérôme Decoodt ,  Pierre d'Herbemont ,  Seyedpooya Mirhosseini ,  Xutao Jiang

IPC: H04N13/156 ,  H04N13/167 ,  H04N13/189 ,  H04N13/327 ,  H04N13/383

CPC classification number: H04N13/156 ,  H04N13/167 ,  H04N13/189 ,  H04N13/327 ,  H04N13/383

Abstract: A head-mounted device is provided that includes a variety of subsystems for generating extended reality content, displaying the extended reality content, and recording the extended reality content. The device can include a graphics rendering pipeline configured to render virtual content, tracking sensors configured to obtain user tracking information, a virtual content compositor configured to composite virtual frames based on the virtual content and the user tracking information, cameras configured to capture a video feed, a media merging compositor configured to overlay the composited virtual frames and the video feed to output merged video frames having a first frame rate for display, and a recording pipeline configured to record content having a second frame rate different than the first frame rate. The recording pipeline can record content exhibiting a higher quality than the content being displayed. A portion of the recorded content containing sensitive information can optionally be blurred.

公开(公告)号：US20230305625A1

公开(公告)日：2023-09-28

申请号：US18056526

申请日：2022-11-17

Applicant: Apple Inc.

Inventor： Jacob Wilson ,  Tobias Eble ,  Sabine Webel ,  Hariprasad Puthukkootil Rajagopal ,  Andreas Gapel ,  Ritesh Gangadhar Sholapur

IPC: G06F3/01 ,  G06V10/44 ,  G06V40/18 ,  G06V40/19

CPC classification number: G06F3/013 ,  G06V10/44 ,  G06V40/19 ,  G06V40/193

Abstract: Eye tracking is performed by determining an initial pupil position of a user in relation to a lens situated in front of the user, detecting a change in pupil position in relation to the lens to an updated pupil position in relation to the lens, and determining that the updated pupil position is outside a bounding box associated with the lens. The updated pupil position is a replacement pupil position with a replacement pupil position within the bounding box associated with the lens, and the updated pupil position is utilized for eye-tracking functionality. Eye tracking is also performed by determining that a first pixel associated with a gaze direction is outside a visibility region, identifying a replacement pixel within the visibility region, determining an updated gaze angle based on the replacement pixel, and performing eye tracking using the updated gaze angle.

公开(公告)号：US20250071255A1

公开(公告)日：2025-02-27

申请号：US18773732

申请日：2024-07-16

Applicant: Apple Inc.

Inventor： Jacob Wilson ,  Sushant Ojal ,  Seyedkoosha Mirhosseini

IPC: H04N13/398 ,  G06T5/70 ,  G06T17/00 ,  H04N13/351

Abstract: Various examples disclosed herein maintain stereo consistency in extended reality (XR) environments when receiving content data with a content frame depicting both a left eye portion of a content item corresponding to a first left eye viewpoint of the content item within the XR environment, and a right eye portion of the content item corresponding to a first right eye viewpoint of the content item within the XR environment. Stereo consistency may be maintained by determining to use an adjusted version of the content frame to provide a view of the content item wherein a left eye view from a second left eye viewpoint is different than the first left eye viewpoint and a right eye view from a second right eye viewpoint is different than the first right eye viewpoint, and presenting the left eye view and the right eye view based on the content frame and the adjustment.