-
公开(公告)号:US20200333591A1
公开(公告)日:2020-10-22
申请号:US16921112
申请日:2020-07-06
Applicant: Apple Inc.
Inventor: Simon Fortin-Deschenes , Ian Powell
Abstract: An optical lens arrangement comprises a first Fresnel lens element and a second lens element. The first Fresnel lens element defines a flat surface side and an opposite faceted surface side defining wedge and draft faces. The flat surface side faces towards the eye of a user and the opposite faceted surface side faces away from the eye of the user. The second lens element interfaces with the faceted surface side of first Fresnel lens. The second lens element is selected from the group consisting of: a second Fresnel lens element, a singlet lens element, a doublet lens element and any combination thereof. The first Fresnel lens is proximal relative to the eye of the user and the second lens element is distal relative to the eye of the user. Head mounted devices (HMD) including these optical lens arrangements are provided. Methods of making such optical lens arrangements and HMDs are also provided.
-
公开(公告)号:US20240089605A1
公开(公告)日:2024-03-14
申请号:US18455476
申请日:2023-08-24
Applicant: Apple Inc.
Inventor: Luke A Pillans , Simon Fortin-Deschenes
CPC classification number: H04N23/72 , G06F3/012 , H04N23/13 , H04N23/73 , H04N23/745 , H04N23/76 , H04N23/88
Abstract: A head-mounted device may include one or more sensors for capturing images of a real-world environment and for determining where the head-mounted device is facing in the real-world environment. The sensors can be used to capture images for creating a lighting map that indicates where one or more light sources are located within the environment and for creating a physical map representing a geometry of the environment. The sensors can be used to predict a direction in which the head-mounted device will be facing in the real-world environment. One of the sensors can include an image sensor for capturing images that are displayed to a user of the head-mounted device. One or more settings of the image sensor can be adjusted based on the lighting map and based on the predicted direction of where the head-mounted device will be facing when capturing a future frame.
-
公开(公告)号:US11301969B1
公开(公告)日:2022-04-12
申请号:US16575994
申请日:2019-09-19
Applicant: Apple Inc.
Inventor: Moinul Khan , Simon Fortin-Deschenes , Yanli Zhang , Bennett S. Wilburn , Sterling G. Orsten , Nan Zhu , James Zhou
Abstract: Some implementations provide improved user experiences on head mounted devices (HMDs) that provide near eye viewing, e.g., HMDs that display distorted images and provide lenses that undistort the images for the user. The images are produced using distortion that is corrected dynamically based on context to conserve device resources. To do so, a context associated with a state of the user, the HMD, or content being viewed on the HMD is tracked during the user experience. For example, the device may predict pupil position, eye state, eye gaze direction, or eye fixation, content type, connection mode, and other context. The device uses the tracked context to determine how to correct distortion for the images at different points during the user experience. For example, new distortion corrections may be computed and used while the user's gaze is moving and previously-determined distortion corrections may be used while the user's gaze is fixed.
-
公开(公告)号:US12169276B2
公开(公告)日:2024-12-17
申请号:US18209651
申请日:2023-06-14
Applicant: Apple Inc.
Inventor: Simon Fortin-Deschenes , Vincent Chapdelaine-Couture , Yan Cote , Anthony Ghannoum
Abstract: A Head-Mounted Display system together with associated techniques for performing accurate and automatic inside-out positional, user body and environment tracking for virtual or mixed reality are disclosed. The system uses computer vision methods and data fusion from multiple sensors to achieve real-time tracking. High frame rate and low latency is achieved by performing part of the processing on the HMD itself.
-
公开(公告)号:US20240404185A1
公开(公告)日:2024-12-05
申请号:US18672958
申请日:2024-05-23
Applicant: Apple Inc.
Abstract: In one implementation, a method of pipelined blending an image with virtual content is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes capturing, with the image sensor, a first portion of an image of a physical environment. The method includes warping the first portion of the image of the physical environment to generate a warped first portion. The method includes blending the warped first portion with a first portion of virtual content to generate a blended first portion. The method includes displaying, on the display, the blended first portion. The method includes capturing, with the image sensor, a second portion of the image of the physical environment. The method includes warping the second portion of the image of the physical environment to generate a warped second portion. The method includes blending the warped second portion with a second portion of the virtual content to generate a blended second portion. The method includes displaying, on the display, the blended second portion, wherein displaying the blended first portion is initiated before blending the warped second portion is completed.
-
公开(公告)号:US11778154B2
公开(公告)日:2023-10-03
申请号:US16637087
申请日:2018-08-08
Applicant: Apple Inc.
Inventor: Vincent Chapdelaine-Couture , Anthony Ghannoum , Yan Cote , Irving Lustigman , Marc-Andre Chenier , Simon Fortin-Deschenes , Bertrand Nepveu
IPC: G06T19/00 , H04N9/75 , H04N13/344 , H04N5/265
CPC classification number: H04N9/75 , G06T19/006 , H04N5/265 , H04N13/344
Abstract: A Head-Mounted Display with camera sensors to perform chroma keying in a mixed reality context is presented. Low latency is achieved by embedding the processing in the HMD itself, specifically, format camera images, detect the selected color range and make a composite with the virtual content.
-
公开(公告)号:US20250067980A1
公开(公告)日:2025-02-27
申请号:US18946168
申请日:2024-11-13
Applicant: Apple Inc.
Inventor: Simon Fortin-Deschenes , Vincent Chapdelaine-Couture , Yan Cote , Anthony Ghannoum
Abstract: A Head-Mounted Display system together with associated techniques for performing accurate and automatic inside-out positional, user body and environment tracking for virtual or mixed reality are disclosed. The system uses computer vision methods and data fusion from multiple sensors to achieve real-time tracking. High frame rate and low latency is achieved by performing part of the processing on the HMD itself.
-
公开(公告)号:US20240272435A1
公开(公告)日:2024-08-15
申请号:US18472138
申请日:2023-09-21
Applicant: Apple Inc.
Inventor: Simon Fortin-Deschenes , Amanda K Abramson , Luke A Pillans , Nicholas C Soldner
IPC: G02B27/01
CPC classification number: G02B27/0172 , G02B27/0176 , G02B2027/0118 , G02B2027/0138
Abstract: A head-mounted device may include a component such as a sidewall structure that is switchable between an opaque mode and a transparent mode. In the opaque mode, the component may block ambient light from passing into the interior of the head-mounted device (such that the user cannot see the surrounding environment). In the transparent mode, the component may allow ambient light to pass into the interior of the head-mounted device (such that the user can see portions of the surrounding environment). The opaque mode may provide a more immersive experience for the user of the head-mounted device, whereas the transparent mode may allow the user to see objects in their surrounding physical environment. Instead or in addition, the head-mounted device may include one or more sidewall displays.
-
9.
公开(公告)号:US20230324684A1
公开(公告)日:2023-10-12
申请号:US18209651
申请日:2023-06-14
Applicant: Apple Inc.
Inventor: Simon Fortin-Deschenes , Vincent Chapdelaine-Couture , Yan Cote , Anthony Ghannoum
CPC classification number: G02B27/017 , G02B27/0093 , G06T19/006 , G02B2027/0134 , G02B2027/0138 , G02B2027/014 , G02B2027/0187
Abstract: A Head-Mounted Display system together with associated techniques for performing accurate and automatic inside-out positional, user body and environment tracking for virtual or mixed reality are disclosed. The system uses computer vision methods and data fusion from multiple sensors to achieve real-time tracking. High frame rate and low latency is achieved by performing part of the processing on the HMD itself.
-
公开(公告)号:US20240348933A1
公开(公告)日:2024-10-17
申请号:US18634197
申请日:2024-04-12
Applicant: Apple Inc.
Inventor: Simon Fortin-Deschenes , Christian I. Moore , Daniel A. Glynn , Anthony Ghannoum , Paolo Di Febbo , Luke A. Pillans , Christophe Seyve , Zhongmin Wang
IPC: H04N23/73 , H04N13/239 , H04N13/296 , H04N13/344 , H04N13/371 , H04N13/383 , H04N23/68 , H04N23/71 , H04N23/745 , H04N23/76
CPC classification number: H04N23/73 , H04N13/239 , H04N13/296 , H04N13/344 , H04N13/371 , H04N13/383 , H04N23/6812 , H04N23/684 , H04N23/71 , H04N23/745 , H04N23/76
Abstract: Various implementations disclosed herein improve the appearance of captured video by accounting for motion-induced blur, noise, lighting, and/or other factors related to the appearance of video captured by rotating or otherwise moving wearable electronic device. Some implementations reduce or eliminate camera motion blur during video capture by dynamically adjusting the exposure used to capture the video based on user motion. For example, exposure may be reduced to reduce the amount of blur during motion. Since such a reduced exposure captures a lesser amount of light, gain may be increased such that the captured video maintains a relatively constant image brightness in spite of the changing exposure over time.
-
-
-
-
-
-
-
-
-