SYSTEM AND METHOD FOR NATURAL THREE-DIMENSIONAL CALIBRATION FOR ROBUST EYE TRACKING

    公开(公告)号:US20200326774A1

    公开(公告)日:2020-10-15

    申请号:US16379713

    申请日:2019-04-09

    Abstract: A method for eye tracking in a head-mountable device (HMD) includes determining at least one object within a three-dimensional (3D) extended reality (XR) environment as an eye tracking calibration point and determining a 3D location of the eye tracking calibration point within the XR environment. The method also includes detecting a gaze point of a user of the HMD and comparing the detected gaze point to an area of the XR environment that includes the 3D location of the eye tracking calibration point. The method further includes, in response to determining that the user is looking at the eye tracking calibration point based on the detected gaze point being within the area, calibrating, using a processor, the HMD to correct a difference between the eye tracking calibration point and the detected gaze point. In addition, the method includes, in response to determining that the user is not looking at the eye tracking calibration point based on the detected gaze point being outside of the area, maintaining an existing calibration of the HMD.

    Super-resolution depth map generation for multi-camera or other environments

    公开(公告)号:US11503266B2

    公开(公告)日:2022-11-15

    申请号:US16811585

    申请日:2020-03-06

    Abstract: A method includes obtaining, using at least one processor, first and second input image frames, where the first and second input image frames are associated with first and second image planes, respectively. The method also includes obtaining, using the at least one processor, a depth map associated with the first input image frame. The method further includes producing another version of the depth map by performing one or more times: (a) projecting, using the at least one processor, the first input image frame to the second image plane in order to produce a projected image frame using (i) the depth map and (ii) information identifying a conversion from the first image plane to the second image plane and (b) adjusting, using the at least one processor, at least one of the depth map and the information identifying the conversion from the first image plane to the second image plane.

    System and method for natural three-dimensional calibration for robust eye tracking

    公开(公告)号:US10936057B2

    公开(公告)日:2021-03-02

    申请号:US16379713

    申请日:2019-04-09

    Abstract: A method for eye tracking in a head-mountable device (HMD) includes determining at least one object within a three-dimensional (3D) extended reality (XR) environment as an eye tracking calibration point and determining a 3D location of the eye tracking calibration point within the XR environment. The method also includes detecting a gaze point of a user of the HMD and comparing the detected gaze point to an area of the XR environment that includes the 3D location of the eye tracking calibration point. The method further includes, in response to determining that the user is looking at the eye tracking calibration point based on the detected gaze point being within the area, calibrating, using a processor, the HMD to correct a difference between the eye tracking calibration point and the detected gaze point. In addition, the method includes, in response to determining that the user is not looking at the eye tracking calibration point based on the detected gaze point being outside of the area, maintaining an existing calibration of the HMD.

    APPARATUS AND METHOD FOR OPERATING MULTIPLE CAMERAS FOR DIGITAL PHOTOGRAPHY

    公开(公告)号:US20200186710A1

    公开(公告)日:2020-06-11

    申请号:US16704982

    申请日:2019-12-05

    Abstract: A method includes, in a first mode, positioning first and second tiltable image sensor modules of an image sensor array of an electronic device so that a first optical axis of the first tiltable image sensor module and a second optical axis of the second tiltable image sensor module are substantially perpendicular to a surface of the electronic device, and the first and second tiltable image sensor modules are within a thickness profile of the electronic device. The method also includes, in a second mode, tilting the first and second tiltable image sensor modules so that the first optical axis of the first tiltable image sensor module and the second optical axis of the second tiltable image sensor module are not perpendicular to the surface of the electronic device, and at least part of the first and second tiltable image sensor modules are no longer within the thickness profile of the electronic device.

Patent Agency Ranking