Head-mounted device with active optical foveation

    公开(公告)号:US10962788B2

    公开(公告)日:2021-03-30

    申请号:US16831306

    申请日:2020-03-26

    Applicant: Apple Inc.

    Abstract: A pass-through camera in a head-mounted device may capture image data for displaying on a display in the head-mounted device. However, only low-resolution image data may be needed to display low-resolution images in the periphery of the user's field of view on the display. Therefore, the pass-through camera may only capture high-resolution images that correspond to the portion of the user's field-of-view that is being directly viewed and may capture lower resolution image data that corresponds to the real-world objects in the user's peripheral vision. To enable the camera module to selectively capture high-resolution images, the pass-through camera may include an image sensor with two or more pixel densities, a distortion lens, and/or one or more planar or curved mirrors. Any of the components in the camera module may be adjusted to change which portion of a scene is captured with high-resolution image data.

    SHARED DATA AND COLLABORATION FOR HEAD-MOUNTED DEVICES

    公开(公告)号:US20230350633A1

    公开(公告)日:2023-11-02

    申请号:US18214448

    申请日:2023-06-26

    Applicant: Apple Inc.

    CPC classification number: G06F3/147 H04N23/90 G06V20/20 G06F3/012 G06F3/017

    Abstract: A system can include head-mounted devices that collaborate to process views from cameras of the respective head-mounted devices and identify objects from different perspectives and/or objects that are within the view of only one of the head-mounted devices. Sharing sensory input between multiple head-mounted devices can complement and enhance individual units by interpreting and reconstructing objects, surfaces, and/or an external environment with perceptive data from multiple angles and positions, which also reduces occlusions and inaccuracies. As more detailed information is available at a specific moment in time, the speed and accuracy of object recognition, hand and body tracking, surface mapping, and/or digital reconstruction can be improved. Such collaboration can provide more effective and efficient mapping of space, surfaces, objects, gestures and users.

    Head-Mounted Device with Active Optical Foveation

    公开(公告)号:US20200225489A1

    公开(公告)日:2020-07-16

    申请号:US16831306

    申请日:2020-03-26

    Applicant: Apple Inc.

    Abstract: A pass-through camera in a head-mounted device may capture image data for displaying on a display in the head-mounted device. However, only low-resolution image data may be needed to display low-resolution images in the periphery of the user's field of view on the display. Therefore, the pass-through camera may only capture high-resolution images that correspond to the portion of the user's field-of-view that is being directly viewed and may capture lower resolution image data that corresponds to the real-world objects in the user's peripheral vision. To enable the camera module to selectively capture high-resolution images, the pass-through camera may include an image sensor with two or more pixel densities, a distortion lens, and/or one or more planar or curved mirrors. Any of the components in the camera module may be adjusted to change which portion of a scene is captured with high-resolution image data.

    Object tracking for head-mounted devices

    公开(公告)号:US11189059B2

    公开(公告)日:2021-11-30

    申请号:US16920333

    申请日:2020-07-02

    Applicant: Apple Inc.

    Abstract: A head-mounted device can be operated with another device and/or object for which information is gathered to facilitate visual display of a representation thereof. An object can be provided with indicators that allow a head-mounted device to determine both an identity and a characteristic (e.g., position, orientation, distance, etc.) of the object. Additionally or alternatively, the head-mounted device can determine both an identity and a characteristic (e.g., position, orientation, distance, etc.) of an electronic device attached to an object for producing a virtual representation of the object. Additionally or alternatively, the head-mounted device can receive data from an electronic device attached to an object for producing a virtual representation of the object. The virtual representation of the object can resemble the physical object, even where the object itself is not independently analyzed.

    Head-Mounted Device with Active Optical Foveation

    公开(公告)号:US20190331919A1

    公开(公告)日:2019-10-31

    申请号:US16130775

    申请日:2018-09-13

    Applicant: Apple Inc.

    Abstract: A pass-through camera in a head-mounted device may capture image data for displaying on a display in the head-mounted device. However, only low-resolution image data may be needed to display low-resolution images in the periphery of the user's field of view on the display. Therefore, the pass-through camera may only capture high-resolution images that correspond to the portion of the user's field-of-view that is being directly viewed and may capture lower resolution image data that corresponds to the real-world objects in the user's peripheral vision. To enable the camera module to selectively capture high-resolution images, the pass-through camera may include an image sensor with two or more pixel densities, a distortion lens, and/or one or more planar or curved mirrors. Any of the components in the camera module may be adjusted to change which portion of a scene is captured with high-resolution image data.

    Shared data and collaboration for head-mounted devices

    公开(公告)号:US12001751B2

    公开(公告)日:2024-06-04

    申请号:US18214448

    申请日:2023-06-26

    Applicant: Apple Inc.

    CPC classification number: G06F3/147 G06F3/012 G06F3/017 G06V20/20 H04N23/90

    Abstract: A system can include head-mounted devices that collaborate to process views from cameras of the respective head-mounted devices and identify objects from different perspectives and/or objects that are within the view of only one of the head-mounted devices. Sharing sensory input between multiple head-mounted devices can complement and enhance individual units by interpreting and reconstructing objects, surfaces, and/or an external environment with perceptive data from multiple angles and positions, which also reduces occlusions and inaccuracies. As more detailed information is available at a specific moment in time, the speed and accuracy of object recognition, hand and body tracking, surface mapping, and/or digital reconstruction can be improved. Such collaboration can provide more effective and efficient mapping of space, surfaces, objects, gestures and users.

Patent Agency Ranking