-
51.
公开(公告)号:US11652965B2
公开(公告)日:2023-05-16
申请号:US17028360
申请日:2020-09-22
Applicant: Apple Inc.
Inventor: Peter Meier , Mohamed Selim Ben Himane , Daniel Kurz
IPC: H04N9/31 , H04N5/225 , H04N13/128 , G01B11/24 , G01B11/25 , H04N13/15 , H04N5/33 , H04N13/257 , H04N13/00
CPC classification number: H04N9/3185 , G01B11/24 , G01B11/25 , H04N5/2256 , H04N5/332 , H04N9/3191 , H04N9/3194 , H04N13/128 , H04N13/15 , H04N13/257 , H04N2013/0081
Abstract: A method of projecting digital information on a real object in a real environment includes the steps of projecting digital information on a real object or part of a real object with a visible light projector, capturing at least one image of the real object with the projected digital information using a camera, providing a depth sensor registered with the camera, the depth sensor capturing depth data of the real object or part of the real object, and calculating a spatial transformation between the visible light projector and the real object based on the at least one image and the depth data. The invention is also concerned with a corresponding system.
-
公开(公告)号:US11544865B1
公开(公告)日:2023-01-03
申请号:US16732790
申请日:2020-01-02
Applicant: Apple Inc.
Inventor: Daniel Kurz
Abstract: Various implementations disclosed herein include devices, systems, and methods for detecting and correcting the posture of users of electronic devices. In some implementations, an image capture device or other sensor is used to estimate or otherwise determine a posture of a user. As a specific example, a head mounted device (HMD) may include a camera that captures an image of the user wearing the device and the image may be analyzed to identify 3D joint locations representing the current posture of the user relative to the HMD. The user's posture is analyzed to assess whether a posture correction or change is desirable, for example, by classifying the posture as good or bad or by scoring the posture on a numerical scale. If a posture correction or change is desirable, appropriate feedback to encourage the user to adopt the posture correction or otherwise change his or her posture is identified and provided.
-
公开(公告)号:US20220391608A1
公开(公告)日:2022-12-08
申请号:US17824339
申请日:2022-05-25
Applicant: Apple Inc.
Inventor: Daniel Kurz , Anselm Grundhoefer , Tushar Gupta
Abstract: Various implementations disclosed herein include devices, systems, and methods that use a marking on a transparent surface (e.g., a prescription lens insert for an HMD) to identify information (e.g., prescription parameters) about the transparent surface. In some implementations, the markings do not interfere with eye tracking through the transparent surface or using the transparent surface to view virtual content or a physical environment. In some implementations, image data is obtained from an image sensor of an electronic device, the image data corresponding to a transparent surface attached to the electronic device. Then, a code is identified in the image data, wherein the code is detectable on the transparent surface by the image sensor without interfering with a function of the electronic device involving the transparent surface. In some implementations, content is provided at the electronic device based on the identified code, wherein the content is viewable through the transparent surface.
-
公开(公告)号:US11423308B1
公开(公告)日:2022-08-23
申请号:US17021340
申请日:2020-09-15
Applicant: Apple Inc.
Inventor: Gowri Somanath , Daniel Kurz
Abstract: Implementations disclosed herein provide systems and methods that use classification-based machine learning to generate perceptually-plausible content for a missing part (e.g., some or all) of an image. The machine learning model may be trained to generate content for the missing part that appears plausible by learning to generate content that cannot be distinguished from real image content, for example, using adversarial loss-based training. To generate the content, a probabilistic classifier may be used to select color attribute values (e.g., RGB values) for each pixel of the missing part of the image. To do so, a pixel color attribute is segmented into a number of bins (e.g., value ranges) that are used as classes. The classifier determines probabilities for each of the bins of a color attribute for each pixel and generates the content by selecting the bin having the highest probability for each color attribute for each pixel.
-
公开(公告)号:US20220191407A1
公开(公告)日:2022-06-16
申请号:US17645886
申请日:2021-12-23
Applicant: Apple Inc.
Inventor: Sebastian Knorr , Daniel Kurz
Abstract: A method of generating at least one image of a real environment comprises providing at least one environment property related to at least part of the real environment, providing at least one virtual object property related to a virtual object, determining at least one imaging parameter according to the at least one provided virtual object property and the at least one provided environment property, and generating at least one image of the real environment representing information about light leaving the real environment according to the determined at least one imaging parameter, wherein the light leaving the real environment is measured by at least one camera.
-
公开(公告)号:US11282171B1
公开(公告)日:2022-03-22
申请号:US16583103
申请日:2019-09-25
Applicant: Apple Inc.
Inventor: Daniel Kurz
Abstract: In some implementations, a method includes obtaining a computer graphic generated based on one or more visual elements within a first video frame. In some implementations, the first video frame is associated with a first time. In some implementations, the method includes obtaining a second video frame associated with a second time. In some implementations, the second time is different from the first time. In some implementations, the method includes applying an intensity transformation to the computer graphic in order to generate a transformed computer graphic. In some implementations, the intensity transformation is based on an intensity difference between the first video frame and the second video frame. In some implementations, the method includes rendering the transformed computer graphic based on one or more visual elements within the second video frame.
-
公开(公告)号:US11150469B2
公开(公告)日:2021-10-19
申请号:US16651228
申请日:2018-09-27
Applicant: Apple Inc.
Inventor: Branko Petljanski , Raffi A. Bedikian , Daniel Kurz , Thomas Gebauer , Li Jia
Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints and determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.
-
公开(公告)号:US20210117042A1
公开(公告)日:2021-04-22
申请号:US17133043
申请日:2020-12-23
Applicant: Apple Inc.
Inventor: Daniel Kurz
Abstract: The present disclosure is related to a method and device for detecting a touch between at least part of a first object and at least part of a second object, wherein the at least part of the first object has a different temperature than the at least part of the second object. The method includes providing at least one thermal image of a portion of the second object, determining in at least part of the at least one thermal image a pattern which is indicative of a particular value or range of temperature or a particular value or range of temperature change, and using the determined pattern for detecting a touch between the at least part of the first object and the at least part of the second object.
-
公开(公告)号:US10825255B2
公开(公告)日:2020-11-03
申请号:US16687446
申请日:2019-11-18
Applicant: Apple Inc.
Inventor: Mark B. Rober , Sawyer I. Cohen , Daniel Kurz , Tobias Holl , Benjamin B. Lyon , Peter Georg Meier , Jeffrey M. Riepling , Holly Gerhard
IPC: G06T19/00 , B60R1/00 , B60Q9/00 , B60W50/08 , B60W10/04 , B60W10/18 , B60W10/20 , B60W10/22 , G06F3/01 , G06K9/00 , B60K35/00 , B60K37/06 , G06T13/40 , G05D1/00 , G06F3/0481
Abstract: A VR system for vehicles that may implement methods that address problems with vehicles in motion that may result in motion sickness for passengers. The VR system may provide augmented or virtual views that match visual cues with the physical motions that a passenger experiences. The VR system may project virtual content so that the content appears as a distant object stabilized or fixed in the external environment. The VR system may aid in productivity, as passengers may perform work while riding in the vehicle without experiencing motion sickness. In addition, the VR system may provide enhanced virtual experiences to passengers in moving vehicles by matching accelerations and motions of the vehicle to accelerations and motions in the virtual experiences.
-
公开(公告)号:US20200082638A1
公开(公告)日:2020-03-12
申请号:US16687446
申请日:2019-11-18
Applicant: Apple Inc.
Inventor: Mark B. Rober , Sawyer I. Cohen , Daniel Kurz , Tobias Holl , Benjamin B. Lyon , Peter Georg Meier , Jeffrey M. Riepling , Holly Gerhard
IPC: G06T19/00 , G06T13/40 , G06F3/01 , G06K9/00 , B60W10/22 , B60W10/20 , B60W10/18 , B60W10/04 , B60W50/08 , B60Q9/00 , B60R1/00 , B60K37/06 , B60K35/00
Abstract: A VR system for vehicles that may implement methods that address problems with vehicles in motion that may result in motion sickness for passengers. The VR system may provide augmented or virtual views that match visual cues with the physical motions that a passenger experiences. The VR system may project virtual content so that the content appears as a distant object stabilized or fixed in the external environment. The VR system may aid in productivity, as passengers may perform work while riding in the vehicle without experiencing motion sickness. In addition, the VR system may provide enhanced virtual experiences to passengers in moving vehicles by matching accelerations and motions of the vehicle to accelerations and motions in the virtual experiences.
-
-
-
-
-
-
-
-
-