公开(公告)号：US11636578B1

公开(公告)日：2023-04-25

申请号：US17238285

申请日：2021-04-23

Applicant: Apple Inc.

Inventor： Daniel Kurz ,  Gowri Somanath ,  Tobias Holl

IPC: G06T5/00 ,  G06T3/20

Abstract: Various implementations disclosed herein include devices, systems, and methods that complete content for a missing part of an image of an environment. For example, an example process may include obtaining an image including defined content and missing parts for which content is undefined, determining a spatial image transformation for the image based on the defined content and the missing parts of the image, altering the image by applying the spatial image transformation, and completing the altered image.

公开(公告)号：US20200273212A1

公开(公告)日：2020-08-27

申请号：US16740972

申请日：2020-01-13

Applicant: Apple Inc.

Inventor： Daniel Kurz ,  Tobias Holl

IPC: G06T11/00

Abstract: Various implementations disclosed herein render virtual content with noise that is similar to or that otherwise better matches the noise found in the images with which the virtual content is combined. Some implementations involve identifying noise data for an image, creating a parameterized noise model based on the noise data, generating a noise pattern approximating noise of the image or another image using the parameterized noise model, and rendering content that includes the image and virtual content with noise added based on the noise pattern.

公开(公告)号：US10825255B2

公开(公告)日：2020-11-03

申请号：US16687446

申请日：2019-11-18

Applicant: Apple Inc.

Inventor： Mark B. Rober ,  Sawyer I. Cohen ,  Daniel Kurz ,  Tobias Holl ,  Benjamin B. Lyon ,  Peter Georg Meier ,  Jeffrey M. Riepling ,  Holly Gerhard

IPC: G06T19/00 ,  B60R1/00 ,  B60Q9/00 ,  B60W50/08 ,  B60W10/04 ,  B60W10/18 ,  B60W10/20 ,  B60W10/22 ,  G06F3/01 ,  G06K9/00 ,  B60K35/00 ,  B60K37/06 ,  G06T13/40 ,  G05D1/00 ,  G06F3/0481

Abstract: A VR system for vehicles that may implement methods that address problems with vehicles in motion that may result in motion sickness for passengers. The VR system may provide augmented or virtual views that match visual cues with the physical motions that a passenger experiences. The VR system may project virtual content so that the content appears as a distant object stabilized or fixed in the external environment. The VR system may aid in productivity, as passengers may perform work while riding in the vehicle without experiencing motion sickness. In addition, the VR system may provide enhanced virtual experiences to passengers in moving vehicles by matching accelerations and motions of the vehicle to accelerations and motions in the virtual experiences.

公开(公告)号：US20200082638A1

公开(公告)日：2020-03-12

申请号：US16687446

申请日：2019-11-18

Applicant: Apple Inc.

Inventor： Mark B. Rober ,  Sawyer I. Cohen ,  Daniel Kurz ,  Tobias Holl ,  Benjamin B. Lyon ,  Peter Georg Meier ,  Jeffrey M. Riepling ,  Holly Gerhard

IPC: G06T19/00 ,  G06T13/40 ,  G06F3/01 ,  G06K9/00 ,  B60W10/22 ,  B60W10/20 ,  B60W10/18 ,  B60W10/04 ,  B60W50/08 ,  B60Q9/00 ,  B60R1/00 ,  B60K37/06 ,  B60K35/00

Abstract: A VR system for vehicles that may implement methods that address problems with vehicles in motion that may result in motion sickness for passengers. The VR system may provide augmented or virtual views that match visual cues with the physical motions that a passenger experiences. The VR system may project virtual content so that the content appears as a distant object stabilized or fixed in the external environment. The VR system may aid in productivity, as passengers may perform work while riding in the vehicle without experiencing motion sickness. In addition, the VR system may provide enhanced virtual experiences to passengers in moving vehicles by matching accelerations and motions of the vehicle to accelerations and motions in the virtual experiences.

公开(公告)号：US20180089900A1

公开(公告)日：2018-03-29

申请号：US15713421

申请日：2017-09-22

Applicant: Apple Inc.

Inventor： Mark B. Rober ,  Sawyer I. Cohen ,  Daniel Kurz ,  Tobias Holl ,  Benjamin B. Lyon ,  Peter Georg Meier ,  Jeffrey M. Riepling ,  Holly Gerhard

IPC: G06T19/00 ,  G06K9/00 ,  B60R1/00 ,  B60Q9/00 ,  B60W50/08 ,  B60W10/04 ,  B60W10/18 ,  B60W10/20 ,  B60W10/22

CPC classification number: G06T19/006 ,  B60K35/00 ,  B60K37/06 ,  B60K2370/177 ,  B60Q9/00 ,  B60R1/00 ,  B60R2300/207 ,  B60R2300/60 ,  B60W10/04 ,  B60W10/18 ,  B60W10/20 ,  B60W10/22 ,  B60W50/08 ,  B60W2540/22 ,  G05D1/0088 ,  G06F3/011 ,  G06F3/012 ,  G06F3/016 ,  G06F3/0481 ,  G06K9/00335 ,  G06K9/00671 ,  G06K9/00791 ,  G06K9/00832 ,  G06T13/40

Abstract: A VR system for vehicles that may implement methods that address problems with vehicles in motion that may result in motion sickness for passengers. The VR system may provide augmented or virtual views that match visual cues with the physical motions that a passenger experiences. The VR system may project virtual content so that the content appears as a distant object stabilized or fixed in the external environment. The VR system may aid in productivity, as passengers may perform work while riding in the vehicle without experiencing motion sickness. In addition, the VR system may provide enhanced virtual experiences to passengers in moving vehicles by matching accelerations and motions of the vehicle to accelerations and motions in the virtual experiences.

公开(公告)号：US12002165B1

公开(公告)日：2024-06-04

申请号：US17412507

申请日：2021-08-26

Applicant: Apple Inc.

Inventor： Daniel Kurz ,  Gowri Somanath ,  Tobias Holl

IPC: G06T19/00 ,  G06T15/50 ,  G06T19/20

CPC classification number: G06T19/006 ,  G06T15/506 ,  G06T19/20 ,  G06T2215/16

Abstract: Various implementations disclosed herein include devices, systems, and methods that use light probes to facilitate the display of virtual objects in 3D environments. A light probe provides lighting information that describes light incident on a point in space in a 3D environment. For example, a light probe may describe such incident light using an environment map. Such lighting information can be used to provide realistic appearances for objects placed at or near light probe locations in the 3D environment. Implementations disclosed herein determine the light probe locations in real-time or other 3D environments that are generated based on a live physical environment. A digital representation of the live physical environment is used to determine where to position the light probes, how many light probes to use, and/or various light probe attributes.

公开(公告)号：US11790616B2

公开(公告)日：2023-10-17

申请号：US17709273

申请日：2022-03-30

Applicant: Apple Inc.

Inventor： Mark B. Rober ,  Sawyer I. Cohen ,  Daniel Kurz ,  Tobias Holl ,  Benjamin B. Lyon ,  Peter Georg Meier ,  Jeffrey M. Riepling ,  Holly Gerhard

IPC: G06T19/00 ,  G06F3/01 ,  B60R1/00 ,  B60Q9/00 ,  B60W50/08 ,  B60W10/04 ,  B60W10/18 ,  B60W10/20 ,  B60W10/22 ,  B60K35/00 ,  B60K37/06 ,  G06V20/20 ,  G06V20/56 ,  G06V20/59 ,  G06T13/40 ,  G05D1/00 ,  G06V40/20 ,  G06F3/0481

CPC classification number: G06T19/006 ,  B60K35/00 ,  B60K37/06 ,  B60Q9/00 ,  B60R1/00 ,  B60W10/04 ,  B60W10/18 ,  B60W10/20 ,  B60W10/22 ,  B60W50/08 ,  G06F3/011 ,  G06F3/012 ,  G06F3/016 ,  G06T13/40 ,  G06V20/20 ,  G06V20/56 ,  G06V20/59 ,  B60K2370/177 ,  B60R2300/207 ,  B60R2300/60 ,  B60W2540/22 ,  G05D1/0088 ,  G06F3/0481 ,  G06V40/20

Abstract: A VR system for vehicles that may implement methods that address problems with vehicles in motion that may result in motion sickness for passengers. The VR system may provide virtual views that match visual cues with the physical motions that a passenger experiences. The VR system may provide immersive VR experiences by replacing the view of the real world with virtual environments. Active vehicle systems and/or vehicle control systems may be integrated with the VR system to provide physical effects with the virtual experiences. The virtual environments may be altered to accommodate a passenger upon determining that the passenger is prone to or is exhibiting signs of motion sickness.

公开(公告)号：US11308652B2

公开(公告)日：2022-04-19

申请号：US16740972

申请日：2020-01-13

Applicant: Apple Inc.

Inventor： Daniel Kurz ,  Tobias Holl

IPC: G06T11/00 ,  G06T19/00

Abstract: Various implementations disclosed herein render virtual content with noise that is similar to or that otherwise better matches the noise found in the images with which the virtual content is combined. Some implementations involve identifying noise data for an image, creating a parameterized noise model based on the noise data, generating a noise pattern approximating noise of the image or another image using the parameterized noise model, and rendering content that includes the image and virtual content with noise added based on the noise pattern.

公开(公告)号：US20240378822A1

公开(公告)日：2024-11-14

申请号：US18658039

申请日：2024-05-08

Applicant: Apple Inc.

Inventor： Tobias Holl ,  Seyedkoosha Mirhosseini ,  David M. Cook

IPC: G06T19/00 ,  G06T3/40 ,  G06T5/92 ,  G06V10/60

Abstract: Various implementations disclosed herein include devices, systems, and methods that adjust a tone map used to display virtual content in an extended reality (XR) environment based a tone map of pass-through video. For example, a process may obtain virtual content associated with a virtual content tone map relating pixel luminance values to display space luminance values. The process further obtains pass-through video depicting a physical environment. The pass-through video is associated with an image signal processing (ISP) tone map relating pixel luminance values of the pass-through video signal to display space luminance values. The process further determines an adjustment adjusting the virtual content tone map based on the ISP tone map. The process further displays a view of an XR environment. The view includes the pass-through video displayed using the ISP tone map and the virtual content displayed using the virtual content tone map with the adjustment.

公开(公告)号：US20220222904A1

公开(公告)日：2022-07-14

申请号：US17709273

申请日：2022-03-30

Applicant: Apple Inc.

Inventor： Mark B. Rober ,  Sawyer I. Cohen ,  Daniel Kurz ,  Tobias Holl ,  Benjamin B. Lyon ,  Peter Georg Meier ,  Jeffrey M. Riepling ,  Holly Gerhard

IPC: G06T19/00 ,  B60R1/00 ,  B60Q9/00 ,  B60W50/08 ,  B60W10/04 ,  B60W10/18 ,  B60W10/20 ,  B60W10/22 ,  G06F3/01 ,  B60K35/00 ,  B60K37/06 ,  G06V20/20 ,  G06V20/56 ,  G06V20/59 ,  G06T13/40

Abstract: A VR system for vehicles that may implement methods that address problems with vehicles in motion that may result in motion sickness for passengers. The VR system may provide virtual views that match visual cues with the physical motions that a passenger experiences. The VR system may provide immersive VR experiences by replacing the view of the real world with virtual environments. Active vehicle systems and/or vehicle control systems may be integrated with the VR system to provide physical effects with the virtual experiences. The virtual environments may be altered to accommodate a passenger upon determining that the passenger is prone to or is exhibiting signs of motion sickness.