Method of Providing Image Feature Descriptors

    公开(公告)号:US20190156143A1

    公开(公告)日:2019-05-23

    申请号:US16259367

    申请日:2019-01-28

    Applicant: Apple Inc.

    CPC classification number: G06K9/623 G06K9/46 G06K9/4671 G06K9/6255 G06K9/6262

    Abstract: A method of providing a set of feature descriptors configured to be used in matching an object in an image of a camera is provided. The method includes: a) providing at least two images of a first object; b) extracting in at least two of the images at least one feature from the respective image, c) providing at least one descriptor for an extracted feature, and storing the descriptors; d) matching descriptors in the first set of descriptors; e) computing a score parameter based on the result of the matching process; f) selecting at least one descriptor based on its score parameter; g) adding the selected descriptor(s) to a second set of descriptors; and h) updating the score parameter of descriptors in the first set based on a selection process and to the result of the matching process.

    TRACKING AND DRIFT CORRECTION
    32.
    发明申请

    公开(公告)号:US20250155968A1

    公开(公告)日:2025-05-15

    申请号:US19024397

    申请日:2025-01-16

    Applicant: Apple Inc.

    Abstract: Some implementations provide improved user interfaces for interacting with a virtual environment. The virtual environment is presented by a display of a first device having an image sensor. The first device uses the image sensor to determine a relative position and orientation of a second device based on a marker displayed on a display of the second device. The first device uses the determined relative position of the second device to display a representation of the second device including virtual content in place of the marker.

    Systems and methods for providing personalized saliency models

    公开(公告)号:US11854242B2

    公开(公告)日:2023-12-26

    申请号:US17448456

    申请日:2021-09-22

    Applicant: Apple Inc.

    CPC classification number: G06V10/462 G06F18/21 G06V10/40 G06V30/274

    Abstract: Methods, systems, and computer readable media for providing personalized saliency models, e.g., for use in mixed reality environments, are disclosed herein, comprising: obtaining, from a server, a first saliency model for the characterization of captured images, wherein the first saliency model represents a global saliency model; capturing a first plurality of images by a first device; obtaining information indicative of a reaction of a first user of the first device to the capture of one or more images of the first plurality images; updating the first saliency model based, at least in part, on the obtained information to form a personalized, second saliency model; and transmitting at least a portion of the second saliency model to the server for inclusion into the global saliency model. In some embodiments, a user's personalized (i.e., updated) saliency model may be used to modify one or more characteristics of at least one subsequently captured image.

    Object detection using multiple three dimensional scans

    公开(公告)号:US11100659B2

    公开(公告)日:2021-08-24

    申请号:US16458425

    申请日:2019-07-01

    Applicant: Apple Inc.

    Abstract: One exemplary implementation facilitates object detection using multiple scans of an object in different conditions. For example, a first scan of the object can be created by capturing images of the object by moving an image sensor on a first path in a first condition, e.g., bright lighting. A second scan of the object can then be created by capturing additional images of the object by moving the image sensor on a second path in a second condition, e.g., dim lighting. Implementations determine a transform that associates the scan data from these multiple scans to one another and use the transforms to generate a 3D model of the object in a single coordinate system. Augmented content can be positioned relative to that object in the single coordinate system and thus will be displayed in the appropriate location regardless of the condition in which the physical object is later detected.

    LOCATION AWARE VISUAL MARKERS
    39.
    发明申请

    公开(公告)号:US20210097714A1

    公开(公告)日:2021-04-01

    申请号:US17032227

    申请日:2020-09-25

    Applicant: Apple Inc.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that determine the relative positioning (e.g., offset) between a mobile electronic device and a visual marker. In some implementations, the determined relative positioning and a known position of the visual marker are used to determine a position (e.g., geo coordinates) of the mobile electronic device that is more accurate than existing techniques. In some implementations, the determined relative positioning is used with a position of the mobile electronic device to crowd source the stored position of the visual marker. In some implementations, the determined relative positioning and a position of the visual marker are used to determine a position of an object detected in an image by the mobile electronic device. In some implementations at an electronic device having a processor, locally-determined locations of a visual marker are received from mobile electronic devices that scan a visual marker.

    Dense-based object tracking using multiple reference images

    公开(公告)号:US10964056B1

    公开(公告)日:2021-03-30

    申请号:US16408658

    申请日:2019-05-10

    Applicant: Apple Inc.

    Abstract: One exemplary implementation involves a pixel-based (also referred to as a dense-based approach) to object detection and tracking that can provide more accurate results than a feature-based approach. The efficiency of the detection and tracking is improved by using a reference image of the object that has similar characteristics (e.g., scale, lighting, blur, and the like) as the depiction of the object in the frame. In some implementations, a reference image of an appropriate scale is selected or interpolated based on the scale of the object depicted in the real world image. In other implementations, the real world image is adjusted to better match the reference image. The detection and tracking of the object can be performed with sufficient accuracy and efficiency for computer-generated reality (CGR) and other applications in which it is desirable to detect and track objects in real time.

Patent Agency Ranking