公开(公告)号：US20220100271A1

公开(公告)日：2022-03-31

申请号：US17483744

申请日：2021-09-23

Applicant: Apple Inc.

Inventor： Thomas S. Hulbert ,  Karlin Y. Bark ,  Alfred B. Huergo Wagner ,  Felipe Bacim De Araujo E Silva ,  Seung Wook Kim ,  William A. Sorrentino, III

IPC: G06F3/01 ,  G06F3/0346

Abstract: An electronic device, while the electronic device is worn over a predefined portion of the user's body, displays, via a display generation component arranged on the electronic device opposite the predefined portion of the user's body, a graphical representation of an exterior view of a body part that corresponds to the predefined portion of the user's body. The electronic device detects a change in position of the electronic device with respect to the predefined portion of the user's body. The electronic device, in response to detecting the change in the position of the electronic device with respect to the predefined portion of the user's body, modifies the graphical representation of the exterior view of the body part that corresponds to predefined portion of the user's body in accordance with the detected change in position of the electronic device with respect to the predefined portion of the user's body.

公开(公告)号：US20250022392A1

公开(公告)日：2025-01-16

申请号：US18537216

申请日：2023-12-12

Applicant: Apple Inc.

Inventor： Harini Kishan ,  Ralf Habel ,  Zhen Zhang ,  Yi Huang ,  Miguel Angel Lopez Alvarez ,  Shobhit Chaudhry ,  Pavel V Dudrenov ,  Gilles M Cadet ,  Ping-Yen Chou ,  Yang Li ,  Kevin Cossu ,  Alfred B Huergo Wagner ,  Seung Wook Kim ,  Felipe Bacim De Araujo E Silva ,  Jessica Murphy ,  Lincoln-Shaun Sanders ,  Francisco H Imai ,  Jiaying Wu ,  Juan He ,  Jackson K Roland

IPC: G09G3/00

Abstract: A head-mounted device may have an inner display that displays images for a user and an outer display that informs nearby people of the status of the user and inner display. For example, the outer display may display an image of a face, an abstract layer, or both, depending on whether the inner display is operating in passthrough mode, mixed reality mode, or virtual reality mode. An ambient light sensor in the head-mounted device may be used to measure the brightness and color of ambient light. The white point of the face layer on the outer display may be adapted to the color of ambient light, whereas the white point of the abstract layer on the outer display may remain fixed. The white point of a display may be a correlated color temperature setting (e.g., measured in degrees Kelvin) that determines the warmth or coolness of displayed colors.

公开(公告)号：US20230368432A1

公开(公告)日：2023-11-16

申请号：US18359126

申请日：2023-07-26

Applicant: Apple Inc.

Inventor： Felipe Bacim De Araujo E Silva ,  Dan C. Lelescu ,  Sebastien Eric Gilles Leprince ,  Gary L Vondran, JR.

IPC: G06T11/00 ,  G06T7/55 ,  G06T3/00

CPC classification number: G06T11/00 ,  G06T7/55 ,  G06T3/00 ,  G06T2207/20212

Abstract: Novel viewpoints may be rendered using arrays of camera images with synthesized viewpoints. Different viewpoints of a scene may be captured via image sensors. Depth information may be determined for the captured viewpoints. An array of images may be generated that includes synthetic viewpoints generated from the captured viewpoints and depth information. A request to render a novel viewpoint may be received. Then novel viewpoint may be rendered using the array of images with synthetic viewpoints.

公开(公告)号：US11748918B1

公开(公告)日：2023-09-05

申请号：US17483703

申请日：2021-09-23

Applicant: Apple Inc.

Inventor： Felipe Bacim De Araujo E Silva ,  Dan C Lelescu ,  Sebastien Eric Gilles Leprince ,  Gary L Vondran, Jr.

IPC: G06T11/00 ,  G06T7/55 ,  G06T3/00

CPC classification number: G06T11/00 ,  G06T3/00 ,  G06T7/55 ,  G06T2207/20212

Abstract: Novel viewpoints may be rendered using arrays of camera images with synthesized viewpoints. Different viewpoints of a scene may be captured via image sensors. Depth information may be determined for the captured viewpoints. An array of images may be generated that includes synthetic viewpoints generated from the captured viewpoints and depth information. A request to render a novel viewpoint may be received. Then novel viewpoint may be rendered using the array of images with synthetic viewpoints.

公开(公告)号：US11579693B2

公开(公告)日：2023-02-14

申请号：US17483744

申请日：2021-09-23

Applicant: Apple Inc.

Inventor： Thomas S. Hulbert ,  Karlin Y. Bark ,  Alfred B. Huergo Wagner ,  Felipe Bacim De Araujo E Silva ,  Seung Wook Kim ,  William A. Sorrentino, III

IPC: G06F3/0346 ,  G06F3/01

Abstract: An electronic device, while the electronic device is worn over a predefined portion of the user's body, displays, via a display generation component arranged on the electronic device opposite the predefined portion of the user's body, a graphical representation of an exterior view of a body part that corresponds to the predefined portion of the user's body. The electronic device detects a change in position of the electronic device with respect to the predefined portion of the user's body. The electronic device, in response to detecting the change in the position of the electronic device with respect to the predefined portion of the user's body, modifies the graphical representation of the exterior view of the body part that corresponds to predefined portion of the user's body in accordance with the detected change in position of the electronic device with respect to the predefined portion of the user's body.

公开(公告)号：US20210286502A1

公开(公告)日：2021-09-16

申请号：US17200676

申请日：2021-03-12

Applicant: Apple Inc.

Inventor： Stephen O. Lemay ,  Jonathan Ive ,  William A. Sorrentino, III ,  Alfred B. Huergo Wagner ,  Felipe Bacim De Araujo E Silva ,  Alan C. Dye ,  Gregg S. Suzuki ,  Peter D. Anton ,  Richard D. Lyons ,  Wan Si Wan ,  Pavel Pivonka ,  Seung Wook Kim

IPC: G06F3/0481 ,  G06F3/01 ,  G06T19/00

Abstract: A computing system displays, via a first display generation component, a first computer-generated environment and concurrently displays, via a second display generation component: a visual representation of a portion of a user of the computing system who is in a position to view the first computer-generated environment via the first display generation component, and one or more graphical elements that provide a visual indication of content in the first computer-generated environment. The computing system changes the visual representation of the portion of the user to represent changes in an appearance of the user over a respective period of time and changes the one or more graphical elements to represent changes in the first computer-generated environment over the respective period of time.

公开(公告)号：US12200185B1

公开(公告)日：2025-01-14

申请号：US17885455

申请日：2022-08-10

Applicant: Apple Inc.

Inventor： Felipe Bacim De Araujo E Silva ,  Seung Wook Kim ,  Edwin Iskandar ,  Pavel V Dudrenov ,  Zachary D Corley ,  Hao Chen ,  Ping-Yen Chou

IPC: H04N13/305 ,  H04N13/15 ,  H04N13/167 ,  H04N13/327 ,  H04N13/398 ,  H04N13/366

Abstract: An electronic device may include a lenticular display. The lenticular display may have a lenticular lens film formed over an array of pixels. The display may include ray tracing circuitry that is configured to, using ray tracing, a three-dimensional image, and deflection measurements for the array of pixels, output a display calibration map that includes, for each pixel in the array of pixels, a corresponding location on a two-dimensional image. The display may also include pixel mapping circuitry configured to, using the display calibration map from the ray tracing circuitry, map the two-dimensional image to respective pixels on the array of pixels to obtain pixel data for the array of pixels.

公开(公告)号：US20240201512A1

公开(公告)日：2024-06-20

申请号：US18067604

申请日：2022-12-16

Applicant: Apple Inc.

Inventor： Felipe Bacim De Araujo E Silva ,  Noah D. Bedard ,  Bosheng Zhang ,  Brett D. Miller ,  Seung Wook Kim

IPC: G02B30/27 ,  G02B27/01 ,  G06F3/01 ,  G06T15/00 ,  H04N13/275

CPC classification number: G02B30/27 ,  G02B27/017 ,  G06F3/011 ,  G06T15/005 ,  H04N13/275

Abstract: Methods and apparatus for generating images to be displayed on lenticular displays. In these methods, a fixed mesh is generated offline, and in real-time texture information is mapped to the fixed mesh. In an offline process, texture and 3D mesh information for an object is used to render UV map views for multiple viewpoints of the object, view maps are generated from display calibration data, and a lenticular to UV map is generated from the UV map views and view maps. In real-time, texture information is captured, and a composite process is performed that generates a lenticular image for multiple viewpoints by sampling pixels from the texture based on the lenticular to UV map. The lenticular image is then displayed on the lenticular display. Detected positions of persons in the environment may be used to limit the number of viewpoints that are generated during the real-time composite process.

公开(公告)号：US11962742B1

公开(公告)日：2024-04-16

申请号：US17348281

申请日：2021-06-15

Applicant: Apple Inc.

Inventor： Sheng Zhang ,  Chaohao Wang ,  Felipe Bacim De Araujo E Silva ,  Karol E. Czaradzki ,  Pavel V. Dudrenov ,  Yi-Pai Huang ,  Yue Ma

IPC: G09G3/20 ,  G06T5/20 ,  G06T5/92 ,  G06T11/40 ,  H04N13/133 ,  H04N13/15 ,  H04N13/305

CPC classification number: H04N13/133 ,  G06T5/20 ,  G06T5/92 ,  G06T11/40 ,  G09G3/2044 ,  H04N13/15 ,  H04N13/305 ,  G09G2320/0242 ,  G09G2320/0276 ,  G09G2320/046 ,  G09G2360/141 ,  G09G2360/144

Abstract: An electronic device may include a lenticular display. The lenticular display may have a lenticular lens film formed over an array of pixels. The display may have a number of independently controllable viewing zones. Each viewing zone displays a respective two-dimensional image. Each eye of the viewer may receive a different one of the two-dimensional images, resulting in a perceived three-dimensional image. The electronic device may include display pipeline circuitry that generates and processes content to be displayed on the lenticular display. Content generating circuitry may initially generate content that includes a plurality of two-dimensional images, each two-dimensional image corresponding to a respective viewing zone. The two-dimensional images may be processed by per-view processing circuitry. Pixel mapping circuitry may be used to map the two-dimensional images to the array of pixels in the lenticular display. After pixel mapping, additional panel-level processing may be performed.

公开(公告)号：US11750795B2

公开(公告)日：2023-09-05

申请号：US17231941

申请日：2021-04-15

Applicant: Apple Inc.

Inventor： Yi-Pai Huang ,  Felipe Bacim De Araujo E Silva ,  Ping-Yen Chou ,  Byoungsuk Kim ,  Chaohao Wang ,  Yi Huang ,  Michael J. Rockwell ,  Seung Wook Kim ,  Pretesh A. Mascarenhas

IPC: H04N13/383 ,  H04N13/305 ,  H04N13/368 ,  H04N13/133

CPC classification number: H04N13/383 ,  H04N13/133 ,  H04N13/305 ,  H04N13/368

Abstract: An electronic device may include a lenticular display. The lenticular display may have a lenticular lens film formed over an array of pixels. The lenticular lenses may be configured to enable stereoscopic viewing of the display such that a viewer perceives three-dimensional images. The display may have a number of independently controllable viewing zones. A eye and/or head tracking system may use a camera to capture images of a viewer of the display. Control circuitry in the electronic device may use the captured images from the eye and/or head tracking system to determine which viewing zones are occupied by the viewer's eyes. The control circuitry may disable or dim viewing zones that are not occupied by the viewer's eyes in order to conserve power. An unoccupied viewing zone and an adjacent, occupied viewing zone may display the same image to increase sharpness in the display.