METHOD OF DISPLAYING VIRTUAL INFORMATION IN A VIEW OF A REAL ENVIRONMENT

    公开(公告)号:US20210166489A1

    公开(公告)日:2021-06-03

    申请号:US17170054

    申请日:2021-02-08

    Applicant: Apple Inc.

    Inventor: Peter Meier

    Abstract: A method of displaying virtual information in a view of a real environment comprising the following steps: providing the system relative to at least one part of the real environment and providing accuracy information of the current pose, providing multiple pieces of virtual information, and assigning a respective one of the pieces of virtual information to one of different parameters indicative of different pose accuracy information, and displaying at least one of the pieces of virtual information in the view of the real environment according to the accuracy information of the current pose in relation to the assigned parameter.

    System for determining position both indoor and outdoor

    公开(公告)号:US10739142B2

    公开(公告)日:2020-08-11

    申请号:US15695780

    申请日:2017-09-05

    Applicant: Apple Inc.

    Abstract: An apparatus, method, and computer readable medium related to determining the position of a device, for example determining the pose of a camera. Varying embodiments discuss the use of sensors and captured images to construct an environment property map, which provides reference information in the form of environment properties that are associated with positions, such as camera poses. Embodiments of the disclosure discuss using the environment property map online (e.g. in real time) in order to determine the position of a device. In some embodiments, the environment property map provides a coarse position that is used to refine or limit the necessary work for determining a more precise position.

    ENVIRONMENT-BASED APPLICATION PRESENTATION
    14.
    发明申请

    公开(公告)号:US20200226383A1

    公开(公告)日:2020-07-16

    申请号:US16833364

    申请日:2020-03-27

    Applicant: Apple Inc.

    Abstract: In an exemplary process for providing content in an augmented reality environment, image data correspond to a physical environment are obtained. Based on the image data, predefined entities of the plurality of predefined entities in the physical environment are identified using classifiers corresponding to predefined entities. Based on the one or more of the identified predefined entities, a geometric layout of the physical environment is determined. Based on the geometric layout, an area corresponding to a particular entity is determined. The particular entity corresponds to one or more identified predefined entities. Based on the area corresponding to the particular entity, the particular entity in the physical environment is identified using classifiers corresponding to the determined area. Based on the identified particular entity, a type of the physical environment is determined. Based on the type of the physical environment, virtual-reality objects are displayed corresponding to a representation of the physical environment.

    Method and system for presenting at least part of an image of a real object in a view of a real environment, and method and system for selecting a subset of a plurality of images

    公开(公告)号:US10659750B2

    公开(公告)日:2020-05-19

    申请号:US15328349

    申请日:2014-07-23

    Applicant: Apple Inc.

    Abstract: The disclosure relates to a method and system for presenting at least part of an image of a real object in a view of a real environment, comprising providing a first image of at least part of a real object captured by a first camera, determining at least part of the real object in the first image as an object image area, determining a first 3D plane relative to the first camera, the first camera being at a position where the first image is captured, providing at least one image feature related to the real object in the first image, providing at least one first ray passing an optical center of the first camera being at a position where the first image is captured and the at least one image feature, determining, according to a first plane normal direction of the first 3D plane, at least one first angle between the first 3D plane and the at least one first ray, providing a second image of a real environment captured by a second camera, determining a second 3D plane relative to the second camera, the second camera being at a position where the second image is captured, mapping at least part of the object image area to a target space in a view of the real environment captured at a viewpoint, wherein the at least one image feature is mapped to at least one target position in a coordinate system of the view, determining at least one second angle between the second 3D plane and at least one second ray passing the viewpoint of capturing the view and the at least one target position according to a second plane normal direction of the second 3D plane, wherein the at least one image feature is mapped to the at least one target position such that a difference between the at least one first angle and the at least one second angle is minimized.

    Method for determining the pose of a camera and for recognizing an object of a real environment

    公开(公告)号:US10580162B2

    公开(公告)日:2020-03-03

    申请号:US16258110

    申请日:2019-01-25

    Applicant: Apple Inc.

    Inventor: Peter Meier

    Abstract: A method for determining the pose of a camera relative to a real environment includes the following steps: taking at least one image of a real environment by means of a camera, the image containing at least part of a real object, performing a tracking method that evaluates information with respect to correspondences between features associated with the real object and corresponding features of the real object as it is contained in the image of the real environment, so as to obtain conclusions about the pose of the camera, determining at least one parameter of an environmental situation, and performing the tracking method in accordance with the at least one parameter. Analogously, the method can also be utilized in a method for recognizing an object of a real environment in an image taken by a camera.

    Method of Tracking a Mobile Device and Method of Generating a Geometrical Model of a Real Environment Using a Camera of a Mobile Device

    公开(公告)号:US20190075274A1

    公开(公告)日:2019-03-07

    申请号:US16180457

    申请日:2018-11-05

    Applicant: Apple Inc.

    Abstract: A method of tracking a mobile device comprising at least one camera in a real environment comprises the steps of receiving image information associated with at least one image captured by the at least one camera, generating a first geometrical model of at least part of the real environment based on environmental data or mobile system state data acquired in an acquisition process by at least one sensor of a mobile system, which is different from the mobile device, and performing a tracking process based on the image information associated with the at least one image and at least partially according to the first geometrical model, wherein the tracking process determines at least one parameter of a pose of the mobile device relative to the real environment. The invention is also related to a method of generating a geometrical model of at least part of a real environment using image information from at least one camera of a mobile device

    Method of tracking a mobile device and method of generating a geometrical model of a real environment using a camera of a mobile device

    公开(公告)号:US10121247B2

    公开(公告)日:2018-11-06

    申请号:US15167391

    申请日:2016-05-27

    Applicant: Apple Inc.

    Abstract: A method of tracking a mobile device comprising at least one camera in a real environment comprises the steps of receiving image information associated with at least one image captured by the at least one camera, generating a first geometrical model of at least part of the real environment based on environmental data or mobile system state data acquired in an acquisition process by at least one sensor of a mobile system, which is different from the mobile device, and performing a tracking process based on the image information associated with the at least one image and at least partially according to the first geometrical model, wherein the tracking process determines at least one parameter of a pose of the mobile device relative to the real environment. The invention is also related to a method of generating a geometrical model of at least part of a real environment using image information from at least one camera of a mobile device.

    System For Determining Position Both Indoor and Outdoor

    公开(公告)号:US20180066945A1

    公开(公告)日:2018-03-08

    申请号:US15695780

    申请日:2017-09-05

    Applicant: Apple Inc.

    Abstract: An apparatus, method, and computer readable medium related to determining the position of a device, for example determining the pose of a camera. Varying embodiments discuss the use of sensors and captured images to construct an environment property map, which provides reference information in the form of environment properties that are associated with positions, such as camera poses. Embodiments of the disclosure discuss using the environment property map online (e.g. in real time) in order to determine the position of a device. In some embodiments, the environment property map provides a coarse position that is used to refine or limit the necessary work for determining a more precise position.

    Method and Device for Presenting Synthesized Reality Companion Content

    公开(公告)号:US20250045978A1

    公开(公告)日:2025-02-06

    申请号:US18919375

    申请日:2024-10-17

    Applicant: Apple Inc.

    Abstract: In one implementation, a method includes: obtaining a user input to view SR content associated with video content; if the video content includes a first scene when the user input was detected: obtaining first SR content for a first time period of the video content associated with the first scene; obtaining a task associated with the first scene; and causing presentation of the first SR content and a first indication of the task associated with the first scene; and if the video content includes a second scene when the user input was detected: obtaining second SR content for a second time period of the video content associated with the second scene; obtaining a task associated with the second scene; and causing presentation of the second SR content and a second indication of the task associated with the second scene.

Patent Agency Ranking