公开(公告)号：US11935263B1

公开(公告)日：2024-03-19

申请号：US17718816

申请日：2022-04-12

Applicant: Apple Inc.

Inventor： Daniel Kurz

IPC: G06T7/70 ,  G06T7/80 ,  G06T17/05

CPC classification number: G06T7/70 ,  G06T7/80 ,  G06T17/05

Abstract: Various implementations disclosed herein include devices, systems, and methods that determine an orientation of a three-dimensional (3D) model with respect to a global reference direction. For example, an example process may include obtaining an image from an image sensor, determining an orientation of the image sensor with respect to the direction of a celestial element, determining an orientation of the image sensor with respect to a global reference direction based on the orientation of the image sensor with respect to the direction of the celestial element and a relationship between the direction of the celestial element and the global reference direction, obtaining a 3D model of the physical environment, determining an orientation of the image sensor with respect to the 3D model, and determining an orientation of the 3D model with respect to the global reference direction.

公开(公告)号：US11790616B2

公开(公告)日：2023-10-17

申请号：US17709273

申请日：2022-03-30

Applicant: Apple Inc.

Inventor： Mark B. Rober ,  Sawyer I. Cohen ,  Daniel Kurz ,  Tobias Holl ,  Benjamin B. Lyon ,  Peter Georg Meier ,  Jeffrey M. Riepling ,  Holly Gerhard

IPC: G06T19/00 ,  G06F3/01 ,  B60R1/00 ,  B60Q9/00 ,  B60W50/08 ,  B60W10/04 ,  B60W10/18 ,  B60W10/20 ,  B60W10/22 ,  B60K35/00 ,  B60K37/06 ,  G06V20/20 ,  G06V20/56 ,  G06V20/59 ,  G06T13/40 ,  G05D1/00 ,  G06V40/20 ,  G06F3/0481

CPC classification number: G06T19/006 ,  B60K35/00 ,  B60K37/06 ,  B60Q9/00 ,  B60R1/00 ,  B60W10/04 ,  B60W10/18 ,  B60W10/20 ,  B60W10/22 ,  B60W50/08 ,  G06F3/011 ,  G06F3/012 ,  G06F3/016 ,  G06T13/40 ,  G06V20/20 ,  G06V20/56 ,  G06V20/59 ,  B60K2370/177 ,  B60R2300/207 ,  B60R2300/60 ,  B60W2540/22 ,  G05D1/0088 ,  G06F3/0481 ,  G06V40/20

Abstract: A VR system for vehicles that may implement methods that address problems with vehicles in motion that may result in motion sickness for passengers. The VR system may provide virtual views that match visual cues with the physical motions that a passenger experiences. The VR system may provide immersive VR experiences by replacing the view of the real world with virtual environments. Active vehicle systems and/or vehicle control systems may be integrated with the VR system to provide physical effects with the virtual experiences. The virtual environments may be altered to accommodate a passenger upon determining that the passenger is prone to or is exhibiting signs of motion sickness.

公开(公告)号：US11734570B1

公开(公告)日：2023-08-22

申请号：US16666850

申请日：2019-10-29

Applicant: Apple Inc.

Inventor： Daniel Kurz ,  Thomas Gebauer ,  Dewey H. Lee ,  Muhammad Ahmed Riaz ,  Qian Wang

IPC: G06N3/084 ,  G06F9/48 ,  G06N20/00 ,  G06N5/046

CPC classification number: G06N3/084 ,  G06F9/48 ,  G06N5/046 ,  G06N20/00

Abstract: The present disclosure describes techniques for training a neural network such that the trained network can be implemented to perform a utility task (e.g., a classification task) while inhibiting performance of a secondary task (e.g., a privacy-violating task). In some embodiments, the techniques include training a neural network using a first loss associated with a first task and a second loss associated with a second task different from the first task. In some embodiments, this includes performing a first training operation associated with the first loss, and performing a second training operation associated with the second loss, wherein the second training operation includes providing, to the neural network, a plurality of input items associated with the second task.

公开(公告)号：US11308652B2

公开(公告)日：2022-04-19

申请号：US16740972

申请日：2020-01-13

Applicant: Apple Inc.

Inventor： Daniel Kurz ,  Tobias Holl

IPC: G06T11/00 ,  G06T19/00

Abstract: Various implementations disclosed herein render virtual content with noise that is similar to or that otherwise better matches the noise found in the images with which the virtual content is combined. Some implementations involve identifying noise data for an image, creating a parameterized noise model based on the noise data, generating a noise pattern approximating noise of the image or another image using the parameterized noise model, and rendering content that includes the image and virtual content with noise added based on the noise pattern.

公开(公告)号：US20220003994A1

公开(公告)日：2022-01-06

申请号：US17481272

申请日：2021-09-21

Applicant: Apple Inc.

Inventor： Branko Petljanski ,  Raffi A. Bedikian ,  Daniel Kurz ,  Thomas Gebauer ,  Li Jia

IPC: G02B27/00 ,  G02B27/01 ,  G06F3/01

Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints. The method includes determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.

公开(公告)号：US11182978B1

公开(公告)日：2021-11-23

申请号：US16851259

申请日：2020-04-17

Applicant: Apple Inc.

Inventor： Daniel Kurz

IPC: G06T5/00 ,  G06T19/00 ,  G06T19/20

Abstract: Various implementations disclosed herein render virtual content while accounting for air-born particles or lens-based artifacts to improve coherence or to otherwise better match the appearance of real content in the images with which the virtual content is combined.

公开(公告)号：US11030784B2

公开(公告)日：2021-06-08

申请号：US15316103

申请日：2014-06-03

Applicant: Apple Inc.

Inventor： Daniel Kurz ,  Anton Fedosov

IPC: G06T11/60 ,  G06T19/00 ,  H04N7/18 ,  G06F3/16

Abstract: The invention is related to a method of presenting a digital information related to a real object, comprising determining a real object, providing a plurality of presentation modes, wherein the plurality of presentation modes comprises an augmented reality mode, and at least one of a virtual reality mode and an audio mode, providing at least one representation of a digital information related to the real object, determining a spatial relationship between a camera and a reference coordinate system under consideration of an image captured by the camera, selecting a presentation mode from the plurality of presentation modes according to the spatial relationship, and presenting the at least one representation of the digital information using the selected presentation mode.

公开(公告)号：US20210064910A1

公开(公告)日：2021-03-04

申请号：US17001788

申请日：2020-08-25

Applicant: Apple Inc.

Inventor： Peter Meier ,  Daniel Kurz ,  Brian Chris Clark ,  Mohamed Selim Ben Himane

IPC: G06K9/46 ,  G06K9/20 ,  G06T7/73 ,  G06K9/00

Abstract: Various implementations disclosed herein include devices, systems, and methods that detect surfaces and reflections in such surfaces. Some implementations involve providing a CGR environment that includes virtual content that replaces the appearance of a user or the user's device in a mirror or other surface providing a reflection. For example, a CGR environment may be modified to include a reflection of the user that does not include the device that the user is holding or wearing. In another example, the CGR environment is modified so that virtual content, such as a newer version of the electronic device or a virtual wand, replaces the electronic device in the reflection. In another example, the CGR environment is modified so that virtual content, such as a user avatar, replaces the user in the reflection.

公开(公告)号：US10819962B2

公开(公告)日：2020-10-27

申请号：US14758121

申请日：2012-12-28

Applicant: Apple Inc.

Inventor： Peter Meier ,  Mohamed Selim Ben Himane ,  Daniel Kurz

IPC: H04N9/31 ,  H04N5/225 ,  H04N5/33 ,  H04N13/128 ,  H04N13/15 ,  H04N13/257 ,  G01B11/24 ,  G01B11/25 ,  H04N13/00

Abstract: A method of projecting digital information on a real object in a real environment includes the steps of projecting digital information on a real object or part of a real object with a visible light projector, capturing at least one image of the real object with the projected digital information using a camera, providing a depth sensor registered with the camera, the depth sensor capturing depth data of the real object or part of the real object, and calculating a spatial transformation between the visible light projector and the real object based on the at least one image and the depth data. The invention is also concerned with a corresponding system.

公开(公告)号：US20200066025A1

公开(公告)日：2020-02-27

申请号：US16546998

申请日：2019-08-21

Applicant: Apple Inc.

Inventor： Bradley W. Peebler ,  Daniel Kurz

IPC: G06T15/04 ,  G06T7/11 ,  G06T7/579 ,  G06K9/62

Abstract: In one implementation, a method is disclosed for providing visual coherency between virtual objects and a physical environment. The method includes obtaining, at an electronic device, first content depicting a physical surface in the physical environment using an image sensor of the electronic device. An extrinsic property exhibited by the physical surface is determined based on the first content using a visual coherency model. Second content representing a virtual object is generated based on the extrinsic property to present on a display.